00000001:02000400:2.0F:1787439989.197706:0:2964:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg658-server.virtnet: executing set_hostid 00000001:02000400:1.0F:1787440011.720803:0:3184:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg658-server.virtnet: executing load_modules_local 00000001:01000000:2.0:1787440013.267965:0:3229:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 1035 MB/s 00000001:01000000:2.0:1787440013.517724:0:3229:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 1443 MB/s 00000001:01000000:2.0:1787440013.767543:0:3229:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 9187 MB/s 00000020:02000000:3.0F:1787440014.413805:0:3278:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.57_64_ga728441 00000400:02000000:3.0:1787440015.249189:0:3293:0:(api-ni.c:2823:lnet_startup_lndni()) Added LNI 192.168.206.158@tcp [8/256/0/180] 00008000:02000000:0.0F:1787440019.761791:0:3442:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:2.0:1787440081.356294:0:5250:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg658-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1787440091.133136:0:5830:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787440091.133142:0:5830:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:2.0:1787440091.133289:0:5830:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000491c6bc9 00000080:02000400:2.0:1787440091.133298:0:5830:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:2.0:1787440091.137459:0:5830:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:2.0:1787440091.137473:0:5830:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1787440091.137891:0:5830:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000dc968802) 00000020:00000080:3.0:1787440091.137912:0:5830:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1787440091.156410:0:5830:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:1.0:1787440091.157089:0:5830:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0:1787440091.184596:0:5830:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1787440091.184633:0:5830:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1787440091.184791:0:5830:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1787440091.184853:0:5830:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1787440091.185000:0:5830:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1787440091.185425:0:5830:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1787440091.185432:0:5830:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787440091.185440:0:5830:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x85f5fa77adf3bf5f 00000020:01000004:3.0:1787440091.185446:0:5830:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:3.0:1787440091.185451:0:5830:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1787440091.185455:0:5830:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000491c6bc9 from MGS 00000020:01000004:3.0:1787440091.185459:0:5830:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1787440091.185467:0:5830:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000ac705bee) 00000020:00000080:3.0:1787440091.185475:0:5830:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1787440091.185624:0:5830:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000491c6bc9 from MGS, refs=2 00080000:01000000:3.0:1787440091.185630:0:5830:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787440091.185773:0:5830:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x85f5fa77adf3bf6d 00000100:00100000:3.0:1787440091.186010:0:5830:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1787440091.186235:0:5830:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1787440091.186242:0:5830:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1787440091.187038:0:5830:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1787440091.187046:0:5830:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1787440091.188226:0:5830:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787440091.188399:0:5830:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1787440091.188405:0:5830:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1787440091.189405:0:5830:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1787440091.189414:0:5830:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1787440091.190283:0:5830:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1787440091.190292:0:5830:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1787440091.191217:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787440091.191221:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787440091.191223:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787440091.191784:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787440091.191787:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787440091.191789:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787440091.192450:0:5830:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1787440091.196995:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:2.0:1787440091.441733:0:5830:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 3487 MB/s 00000001:01000000:1.0:1787440091.691598:0:5830:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 5587 MB/s 00000001:01000000:3.0:1787440091.944285:0:5830:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 650 MB/s 00000001:01000000:2.0:1787440092.193890:0:5830:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 675 MB/s 00080000:10000000:3.0:1787440092.212131:0:5830:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00010000:00010000:1.0:1787440092.252763:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:2.0:1787440092.263182:0:5830:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:2.0:1787440092.263199:0:5830:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1787440092.263202:0:5830:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:2.0:1787440092.268432:0:5841:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1787440092.268529:0:5830:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1787440092.268577:0:5830:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:1.0:1787440092.273790:0:5830:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1787440092.273842:0:5830:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1787440092.274171:0:5830:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787440092.274356:0:5830:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1787440092.274362:0:5830:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1787440092.274997:0:5830:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1787440092.275005:0:5830:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1787440092.275360:0:5830:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1787440092.275366:0:5830:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1787440092.275958:0:5830:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1787440092.275977:0:5830:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.206.158@tcp' 00000020:01000004:1.0:1787440092.275979:0:5830:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000100:00080000:2.0:1787440092.276096:0:5845:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:01000004:1.0:1787440092.277443:0:5830:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.206.158@tcp (typ=mgc) 00000020:00000080:1.0:1787440092.277468:0:5830:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.206.158@tcp (00000000c04cf94f) 00000020:00000080:1.0:1787440092.277512:0:5830:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1787440092.277636:0:5830:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000fb4eb318@MGC192.168.206.158@tcp: add connection 192.168.206.158@tcp at head 00010000:00010000:1.0:1787440092.277884:0:5830:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.206.158@tcp-0 is initialized 00000040:01000000:1.0:1787440092.277892:0:5830:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.158@tcp ctxt 1 is initialized 10000000:01000000:0.0:1787440092.293570:0:5847:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1787440092.293623:0:5830:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.206.158@tcp (uuid 168176ea-29d1-49de-a254-317e90d54802) 00000020:00000080:0.0:1787440092.293644:0:5830:0:(genops.c:1385:class_connect()) connect: client 168176ea-29d1-49de-a254-317e90d54802, cookie 0x85f5fa77adf3bf7b 00000100:00080000:0.0:1787440092.293656:0:5830:0:(import.c:510:import_select_connection()) MGC192.168.206.158@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787440092.293661:0:5830:0:(import.c:624:import_select_connection()) MGC192.168.206.158@tcp: import 00000000fb4eb318 using connection 192.168.206.158@tcp/0@lo 00000100:00100000:0.0:1787440092.293705:0:5830:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000006942fd4c x1874266701168768/t0(0) o250->MGC192.168.206.158@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787440092.293728:0:5830:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 168176ea-29d1-49de-a254-317e90d54802->MGS 00000020:01000004:0.0:1787440092.293745:0:5830:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1787440092.293777:0:5830:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1787440092.293797:0:5830:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000e6532b53) 00000020:00000080:0.0:1787440092.293809:0:5830:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1787440092.302418:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006942fd4c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:168176ea-29d1-49de-a254-317e90d54802:3308:1874266701168768:0@lo:250: 00000100:00100000:2.0:1787440092.302517:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440092.302905:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701168768 00000100:00100000:2.0:1787440092.302913:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701168768 00000100:00100000:2.0:1787440092.302962:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787440092.302968:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ae786d5a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3308:x1874266701168768:12345-0@lo:250: 00010000:00080000:2.0:1787440092.302991:0:5842:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 168176ea-29d1-49de-a254-317e90d54802@0@lo t0 exp 0000000000000000 cur 190 last 0 00000020:00000080:2.0:1787440092.303015:0:5842:0:(genops.c:1385:class_connect()) connect: client 168176ea-29d1-49de-a254-317e90d54802, cookie 0x85f5fa77adf3bf89 00000100:00080000:2.0:1787440092.303130:0:5842:0:(import.c:65:import_set_state_nolock()) 0000000059204a99 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787440092.303192:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ae786d5a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:168176ea-29d1-49de-a254-317e90d54802+5:3308:x1874266701168768:12345-0@lo:250: Request processed in 223us (676us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440092.303200:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787440092.303243:0:3308:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.206.158@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1787440092.303258:0:3308:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.206.158@tcp: connect to target with instance 0 00000100:00080000:2.0:1787440092.303265:0:3308:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.206.158@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1787440092.303269:0:3308:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1787440092.303271:0:3308:0:(import.c:65:import_set_state_nolock()) 00000000fb4eb318 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1787440092.303274:0:3308:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1787440092.305394:0:3308:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1787440092.305410:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006942fd4c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:168176ea-29d1-49de-a254-317e90d54802:3308:1874266701168768:0@lo:250: 00000100:00100000:1.0:1787440092.324997:0:5830:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787440092.325207:0:5830:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1787440092.325214:0:5830:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1787440092.327449:0:5830:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1787440092.327461:0:5830:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1787440092.328163:0:5830:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1787440092.328170:0:5830:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1787440092.329150:0:5830:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787440092.330183:0:5830:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1787440092.330191:0:5830:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1787440092.331855:0:5830:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1787440092.331867:0:5830:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1787440092.367616:0:5830:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787440092.367934:0:5830:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1787440092.367941:0:5830:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1787440092.369864:0:5830:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1787440092.369875:0:5830:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1787440092.370960:0:5830:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787440092.371135:0:5830:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1787440092.371150:0:5830:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1787440092.371808:0:5830:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1787440092.371815:0:5830:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1787440092.372522:0:5830:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787440092.372664:0:5830:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1787440092.372780:0:5830:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1787440092.373789:0:5830:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1787440092.373797:0:5830:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1787440092.374420:0:5830:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787440092.374616:0:5830:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1787440092.374620:0:5830:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1787440092.375339:0:5830:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1787440092.375346:0:5830:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1787440092.431049:0:5830:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787440092.431245:0:5830:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1787440092.431252:0:5830:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1787440092.434063:0:5830:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1787440092.434079:0:5830:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1787440092.437095:0:5830:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1787440092.437120:0:5830:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1787440092.438927:0:5830:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1787440092.438956:0:5830:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:3.0:1787440092.438962:0:5830:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.158@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1787440092.439166:0:5830:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.158@tcp ctxt 0 is initialized 00000020:01000004:3.0:1787440092.439208:0:5830:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.206.158@tcp, index=0000, flags=0x20065 00000020:01000004:3.0:1787440092.439213:0:5830:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1787440092.439214:0:5830:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787440092.439215:0:5830:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787440092.439216:0:5830:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787440092.439217:0:5830:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787440092.439219:0:5830:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787440092.439220:0:5830:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787440092.439221:0:5830:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787440092.439222:0:5830:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787440092.439228:0:5830:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787440092.439229:0:5830:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787440092.439230:0:5830:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787440092.439233:0:5830:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:3.0:1787440092.439235:0:5830:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787440092.439236:0:5830:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787440092.439237:0:5830:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787440092.439237:0:5830:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787440092.439238:0:5830:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787440092.439239:0:5830:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787440092.439239:0:5830:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787440092.439240:0:5830:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787440092.439241:0:5830:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787440092.439242:0:5830:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787440092.439243:0:5830:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787440092.439243:0:5830:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787440092.439274:0:5830:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1787440092.439409:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ed89535f pname:cluuid:pid:xid:nid:opc:job mount.lustre:168176ea-29d1-49de-a254-317e90d54802:5830:1874266701168896:0@lo:253: 00000100:00100000:3.0:1787440092.439486:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440092.439818:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set 00000000eaf0b2fe going to sleep for 11 seconds 00000100:00100000:2.0:1787440092.439921:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701168896 00000100:00100000:2.0:1787440092.439928:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701168896 00000100:00100000:2.0:1787440092.440007:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787440092.440015:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d2670fd4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:168176ea-29d1-49de-a254-317e90d54802+5:5830:x1874266701168896:12345-0@lo:253: 20000000:01000000:2.0:1787440092.440127:0:5844:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1787440092.440130:0:5844:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:2.0:1787440092.440788:0:5865:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1787440092.440901:0:5844:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:3.0:1787440092.441260:0:5844:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787440092.444387:0:5866:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:3.0:1787440092.450584:0:5844:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1787440092.450591:0:5844:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:3.0:1787440092.450610:0:5844:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:3.0:1787440092.450613:0:5844:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:3.0:1787440092.450629:0:5844:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:3.0:1787440092.450851:0:5844:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787440092.451107:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:3.0:1787440092.451121:0:5844:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1787440092.451184:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:3.0:1787440092.451233:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:3.0:1787440092.451272:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:3.0:1787440092.451709:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:3.0:1787440092.451717:0:5844:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:3.0:1787440092.451762:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:3.0:1787440092.451778:0:5844:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:3.0:1787440092.451810:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:3.0:1787440092.451817:0:5844:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:3.0:1787440092.451847:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:3.0:1787440092.451892:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:3.0:1787440092.451922:0:5844:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1787440092.451927:0:5844:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:3.0:1787440092.451940:0:5844:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787440092.452128:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:3.0:1787440092.452154:0:5844:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1787440092.452189:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:3.0:1787440092.452224:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:3.0:1787440092.452302:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:3.0:1787440092.452586:0:5844:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:3.0:1787440092.452667:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:3.0:1787440092.452676:0:5844:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1787440092.452721:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:3.0:1787440092.452758:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:3.0:1787440092.452809:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:3.0:1787440092.452821:0:5844:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:3.0:1787440092.453228:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:3.0:1787440092.453239:0:5844:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:3.0:1787440092.453270:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:3.0:1787440092.453300:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:3.0:1787440092.453580:0:5844:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:3.0:1787440092.453644:0:5844:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:3.0:1787440092.453651:0:5844:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:3.0:1787440092.456610:0:5867:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:2.0:1787440092.457032:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:2.0:1787440092.457058:0:5844:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.206.158@tcp for mdt 20000000:01000000:2.0:1787440092.457061:0:5844:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.158@tcp (null) (null) (null) 00000040:00080000:2.0:1787440092.457097:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:2.0:1787440092.457106:0:5844:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1787440092.457172:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:2.0:1787440092.457180:0:5844:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.206.158@tcp (null) (null) 00000040:00080000:2.0:1787440092.457225:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:2.0:1787440092.457235:0:5844:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:2.0:1787440092.457265:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:2.0:1787440092.457547:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:2.0:1787440092.457618:0:5844:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:2.0:1787440092.457621:0:5844:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1787440092.457624:0:5844:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1787440092.457634:0:5844:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1787440092.457636:0:5844:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1787440092.457671:0:5844:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1787440092.457673:0:5844:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:2.0:1787440092.458859:0:5868:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:3.0:1787440092.459238:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:3.0:1787440092.459299:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:3.0:1787440092.459346:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 20000000:01000000:3.0:1787440092.459360:0:5844:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1787440092.459371:0:5844:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:0.0:1787440092.460212:0:5869:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:3.0:1787440092.461077:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:3.0:1787440092.461121:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:3.0:1787440092.461202:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 00000020:00000080:3.0:1787440092.461219:0:5844:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787440092.461221:0:5844:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:3.0:1787440092.461228:0:5844:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1787440092.461230:0:5844:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1787440092.461235:0:5844:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:3.0:1787440092.461241:0:5844:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:0.0:1787440092.462777:0:5870:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:3.0:1787440092.463000:0:5844:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:3.0:1787440092.479678:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:3.0:1787440092.479738:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:3.0:1787440092.479942:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:3.0:1787440092.479964:0:5844:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1787440092.479982:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000038211e85/0x85f5fa77adf3bf90 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440092.479996:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000038211e85/0x85f5fa77adf3bf90 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440092.480005:0:5844:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000038211e85/0x85f5fa77adf3bf90 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440092.480011:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000038211e85/0x85f5fa77adf3bf90 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440092.480016:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000038211e85/0x85f5fa77adf3bf90 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440092.480020:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000038211e85/0x85f5fa77adf3bf90 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440092.480032:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000038211e85 already unused, calling callback (000000000be79b10) 00010000:00010000:3.0:1787440092.480036:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000038211e85/0x85f5fa77adf3bf90 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440092.480098:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000038211e85/0x85f5fa77adf3bf90 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440092.480109:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000038211e85/0x85f5fa77adf3bf90 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440092.480115:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000038211e85/0x85f5fa77adf3bf90 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440092.480119:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000038211e85/0x85f5fa77adf3bf90 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787440092.480134:0:5844:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1787440092.724987:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d2670fd4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:168176ea-29d1-49de-a254-317e90d54802+5:5830:x1874266701168896:12345-0@lo:253: Request processed in 284967us (285494us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440092.725008:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787440092.725081:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ed89535f pname:cluuid:pid:xid:nid:opc:job mount.lustre:168176ea-29d1-49de-a254-317e90d54802:5830:1874266701168896:0@lo:253: 10000000:01000000:0.0:1787440092.725096:0:5830:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1787440092.725099:0:5830:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787440092.725100:0:5830:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787440092.725113:0:5830:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787440092.725114:0:5830:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:0.0:1787440092.725115:0:5830:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787440092.725117:0:5830:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787440092.725118:0:5830:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787440092.725119:0:5830:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787440092.725121:0:5830:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1787440092.725122:0:5830:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787440092.725123:0:5830:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1787440092.725154:0:5830:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000491c6bc9 from lustre-MDT0000 10000000:01000000:0.0:1787440092.725176:0:5830:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1787440092.725179:0:5830:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1787440092.725182:0:5830:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8ee04a7e3370 10000000:01000000:0.0:1787440092.725186:0:5830:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787440092.725192:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8ee04a7e3370 from 1 10000000:01000000:0.0:1787440092.725194:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1787440092.725223:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.158@tcp lock: 000000003588fc5d/0x85f5fa77adf3bf97 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440092.725233:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.158@tcp lock: 000000003588fc5d/0x85f5fa77adf3bf97 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440092.725241:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.158@tcp lock: 000000003588fc5d/0x85f5fa77adf3bf97 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440092.725255:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000cda6389b pname:cluuid:pid:xid:nid:opc:job mount.lustre:168176ea-29d1-49de-a254-317e90d54802:5830:1874266701169024:0@lo:101: 00000100:00100000:0.0:1787440092.725366:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440092.725442:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set 000000007f28b509 going to sleep for 11 seconds 00000100:00100000:2.0:1787440092.725516:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701169024 00000100:00100000:2.0:1787440092.725522:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701169024 00000100:00100000:2.0:1787440092.725557:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787440092.725563:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000538cad55 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:168176ea-29d1-49de-a254-317e90d54802+5:5830:x1874266701169024:12345-0@lo:101: 00010000:00010000:2.0:1787440092.725573:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440092.725583:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000056f40619/0x85f5fa77adf3bf9e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x85f5fa77adf3bf97 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440092.725600:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000056f40619/0x85f5fa77adf3bf9e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x85f5fa77adf3bf97 expref: 6 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440092.725608:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000056f40619/0x85f5fa77adf3bf9e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f5fa77adf3bf97 expref: 6 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440092.725616:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000056f40619, rc 0) 00000100:00100000:2.0:1787440092.725648:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000538cad55 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:168176ea-29d1-49de-a254-317e90d54802+6:5830:x1874266701169024:12345-0@lo:101: Request processed in 86us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440092.725653:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787440092.725783:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000cda6389b pname:cluuid:pid:xid:nid:opc:job mount.lustre:168176ea-29d1-49de-a254-317e90d54802:5830:1874266701169024:0@lo:101: 00010000:00010000:3.0:1787440092.725794:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.158@tcp lock: 000000003588fc5d/0x85f5fa77adf3bf97 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3bf9e expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440092.725800:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.158@tcp lock: 000000003588fc5d/0x85f5fa77adf3bf97 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x85f5fa77adf3bf9e expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440092.725913:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005a7306fb pname:cluuid:pid:xid:nid:opc:job mount.lustre:168176ea-29d1-49de-a254-317e90d54802:5830:1874266701169152:0@lo:501: 00000100:00100000:3.0:1787440092.725949:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440092.726005:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701169152 00000100:00100000:0.0:1787440092.726009:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701169152 00000100:00100000:0.0:1787440092.726039:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787440092.726045:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d6b502c2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:168176ea-29d1-49de-a254-317e90d54802+6:5830:x1874266701169152:12345-0@lo:501: 00000100:00100000:0.0:1787440092.726264:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d6b502c2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:168176ea-29d1-49de-a254-317e90d54802+6:5830:x1874266701169152:12345-0@lo:501: Request processed in 220us (315us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787440092.726277:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787440092.726429:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set 000000009c653cb0 going to sleep for 11 seconds 00000100:00100000:3.0:1787440092.726443:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005a7306fb pname:cluuid:pid:xid:nid:opc:job mount.lustre:168176ea-29d1-49de-a254-317e90d54802:5830:1874266701169152:0@lo:501: 10000000:01000000:3.0:1787440092.726465:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.158@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1787440092.726483:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.158@tcp lock: 000000003588fc5d/0x85f5fa77adf3bf97 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3bf9e expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440092.726490:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.158@tcp lock: 000000003588fc5d/0x85f5fa77adf3bf97 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3bf9e expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787440092.726565:0:5830:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8ee045f41000 10000000:01000000:2.0:1787440092.726635:0:5830:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1787440092.726641:0:5830:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8ee045f41000 10000000:01000000:2.0:1787440092.726644:0:5830:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1787440092.726646:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8ee045f41000 from 1 10000000:01000000:2.0:1787440092.726648:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1787440092.726678:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.158@tcp lock: 00000000d050eb52/0x85f5fa77adf3bfa5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440092.726685:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.158@tcp lock: 00000000d050eb52/0x85f5fa77adf3bfa5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440092.726770:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.158@tcp lock: 00000000d050eb52/0x85f5fa77adf3bfa5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440092.726783:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000043da56a4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:168176ea-29d1-49de-a254-317e90d54802:5830:1874266701169280:0@lo:101: 00000100:00100000:2.0:1787440092.726809:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440092.726900:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set 0000000055918aa0 going to sleep for 11 seconds 00000100:00100000:1.0:1787440092.726909:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701169280 00000100:00100000:1.0:1787440092.726914:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701169280 00000100:00100000:1.0:1787440092.726945:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787440092.726951:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005f8587cb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:168176ea-29d1-49de-a254-317e90d54802+6:5830:x1874266701169280:12345-0@lo:101: 00010000:00010000:1.0:1787440092.726959:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440092.726970:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000e67028e9/0x85f5fa77adf3bfac lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x85f5fa77adf3bfa5 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440092.726984:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e67028e9/0x85f5fa77adf3bfac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x85f5fa77adf3bfa5 expref: 7 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440092.726997:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000e67028e9/0x85f5fa77adf3bfac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f5fa77adf3bfa5 expref: 7 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440092.727004:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000e67028e9, rc 0) 00000100:00100000:1.0:1787440092.727050:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005f8587cb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:168176ea-29d1-49de-a254-317e90d54802+7:5830:x1874266701169280:12345-0@lo:101: Request processed in 100us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440092.727056:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787440092.727379:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000043da56a4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:168176ea-29d1-49de-a254-317e90d54802:5830:1874266701169280:0@lo:101: 00010000:00010000:2.0:1787440092.727390:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.158@tcp lock: 00000000d050eb52/0x85f5fa77adf3bfa5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3bfac expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440092.727397:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.158@tcp lock: 00000000d050eb52/0x85f5fa77adf3bfa5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x85f5fa77adf3bfac expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787440092.727408:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.158@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1787440092.727423:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.158@tcp lock: 00000000d050eb52/0x85f5fa77adf3bfa5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3bfac expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440092.727429:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.158@tcp lock: 00000000d050eb52/0x85f5fa77adf3bfa5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3bfac expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787440092.727436:0:5830:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1787440092.727440:0:5830:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787440092.727445:0:5830:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8ee045f41000 10000000:01000000:2.0:1787440092.727447:0:5830:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1787440092.727451:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1787440092.727452:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1787440092.727467:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.158@tcp lock: 00000000ab20d29f/0x85f5fa77adf3bfb3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440092.727478:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.158@tcp lock: 00000000ab20d29f/0x85f5fa77adf3bfb3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440092.727485:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.158@tcp lock: 00000000ab20d29f/0x85f5fa77adf3bfb3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440092.727524:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000043da56a4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:168176ea-29d1-49de-a254-317e90d54802:5830:1874266701169408:0@lo:101: 00000100:00100000:2.0:1787440092.727549:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440092.727620:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set 0000000055918aa0 going to sleep for 11 seconds 00000100:00100000:3.0:1787440092.728202:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701169408 00000100:00100000:3.0:1787440092.728208:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701169408 00000100:00100000:3.0:1787440092.728276:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787440092.728343:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006dba7780 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:168176ea-29d1-49de-a254-317e90d54802+7:5830:x1874266701169408:12345-0@lo:101: 00010000:00010000:3.0:1787440092.728354:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440092.728365:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000038211e85/0x85f5fa77adf3bfba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x85f5fa77adf3bfb3 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440092.728381:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000038211e85/0x85f5fa77adf3bfba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x85f5fa77adf3bfb3 expref: 8 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440092.728389:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000038211e85/0x85f5fa77adf3bfba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f5fa77adf3bfb3 expref: 8 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440092.728395:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000038211e85, rc 0) 00000100:00100000:3.0:1787440092.728436:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006dba7780 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:168176ea-29d1-49de-a254-317e90d54802+8:5830:x1874266701169408:12345-0@lo:101: Request processed in 94us (886us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440092.728442:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787440092.728538:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000043da56a4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:168176ea-29d1-49de-a254-317e90d54802:5830:1874266701169408:0@lo:101: 00010000:00010000:2.0:1787440092.728550:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.158@tcp lock: 00000000ab20d29f/0x85f5fa77adf3bfb3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3bfba expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440092.728556:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.158@tcp lock: 00000000ab20d29f/0x85f5fa77adf3bfb3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x85f5fa77adf3bfba expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440092.728602:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000043da56a4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:168176ea-29d1-49de-a254-317e90d54802:5830:1874266701169536:0@lo:501: 00000100:00100000:2.0:1787440092.728649:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440092.728914:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set 0000000055918aa0 going to sleep for 11 seconds 00000100:00100000:0.0:1787440092.728961:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701169536 00000100:00100000:0.0:1787440092.728965:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701169536 00000100:00100000:0.0:1787440092.728987:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787440092.728992:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fb5c5e0b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:168176ea-29d1-49de-a254-317e90d54802+8:5830:x1874266701169536:12345-0@lo:501: 00000100:00100000:0.0:1787440092.729235:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fb5c5e0b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:168176ea-29d1-49de-a254-317e90d54802+9:5830:x1874266701169536:12345-0@lo:501: Request processed in 243us (586us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440092.729242:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787440092.729324:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000043da56a4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:168176ea-29d1-49de-a254-317e90d54802:5830:1874266701169536:0@lo:501: 00000100:00100000:2.0:1787440092.729352:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000043da56a4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:168176ea-29d1-49de-a254-317e90d54802:5830:1874266701169664:0@lo:503: 00000100:00100000:2.0:1787440092.729387:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440092.729407:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set 0000000055918aa0 going to sleep for 11 seconds 00000100:00100000:0.0:1787440092.729516:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701169664 00000100:00100000:0.0:1787440092.729520:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701169664 00000100:00100000:0.0:1787440092.729538:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787440092.729544:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009bf2e255 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:168176ea-29d1-49de-a254-317e90d54802+9:5830:x1874266701169664:12345-0@lo:503: 00000100:00100000:0.0:1787440092.729683:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009bf2e255 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:168176ea-29d1-49de-a254-317e90d54802+9:5830:x1874266701169664:12345-0@lo:503: Request processed in 139us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440092.729699:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787440092.729835:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000043da56a4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:168176ea-29d1-49de-a254-317e90d54802:5830:1874266701169664:0@lo:503: 00000100:00100000:0.0:1787440092.730208:0:5872:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000025152a1f pname:cluuid:pid:xid:nid:opc:job llog_process_th:168176ea-29d1-49de-a254-317e90d54802:5872:1874266701169792:0@lo:502: 00000100:00100000:0.0:1787440092.730251:0:5872:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440092.730293:0:5872:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a164b135 going to sleep for 11 seconds 00000100:00100000:2.0:1787440092.730396:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701169792 00000100:00100000:2.0:1787440092.730406:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701169792 00000100:00100000:2.0:1787440092.730428:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787440092.730434:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000017a63627 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:168176ea-29d1-49de-a254-317e90d54802+9:5872:x1874266701169792:12345-0@lo:502: 00000100:00100000:2.0:1787440092.730623:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000017a63627 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:168176ea-29d1-49de-a254-317e90d54802+9:5872:x1874266701169792:12345-0@lo:502: Request processed in 189us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440092.730631:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787440092.730781:0:5872:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000025152a1f pname:cluuid:pid:xid:nid:opc:job llog_process_th:168176ea-29d1-49de-a254-317e90d54802:5872:1874266701169792:0@lo:502: 00000020:01000000:0.0:1787440092.730804:0:5872:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787440092.730813:0:5872:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787440092.730815:0:5872:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1787440092.730885:0:5872:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1787440092.730890:0:5872:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787440092.730902:0:5872:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000b6a63236) 00000020:00000080:0.0:1787440092.730918:0:5872:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1787440092.730923:0:5872:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1787440092.730993:0:5872:0:(osd_handler.c:1564:osd_obd_connect()) connect #2 00000020:00000080:0.0:1787440092.731002:0:5872:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x85f5fa77adf3bfc8 00000020:00000080:0.0:1787440092.731216:0:5872:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1787440092.731220:0:5872:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787440092.731223:0:5872:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787440092.731225:0:5872:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1787440092.731227:0:5872:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787440092.731230:0:5872:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787440092.731231:0:5872:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1787440092.731234:0:5872:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787440092.731240:0:5872:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (000000001d92a4b7) 00000020:00000080:0.0:1787440092.731249:0:5872:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1787440092.731252:0:5872:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1787440092.731253:0:5872:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1787440092.731256:0:5872:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1787440092.731262:0:5872:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1787440092.731454:0:5872:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000491c6bc9 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1787440092.731467:0:5872:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (000000004c371e1e) 00000020:00000080:0.0:1787440092.731475:0:5872:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1787440092.731631:0:5872:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1787440092.731636:0:5872:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x85f5fa77adf3bfdd 00000020:00000080:0.0:1787440092.731808:0:5872:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1787440092.731814:0:5872:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1787440092.731883:0:5872:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x85f5fa77adf3bfe4 00080000:01000000:0.0:1787440092.731890:0:5872:0:(osd_handler.c:1564:osd_obd_connect()) connect #3 00000020:00000080:0.0:1787440092.731894:0:5872:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x85f5fa77adf3bfeb 00080000:10000000:0.0:1787440092.732274:0:5872:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:0.0:1787440092.732644:0:5872:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:0.0:1787440092.736975:0:5872:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:2.0:1787440092.815063:0:5872:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:2.0:1787440092.815375:0:5872:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:2.0:1787440092.817655:0:5872:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:2.0:1787440092.817940:0:5872:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1787440092.889528:0:5872:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (000000000272cc3a) 00000020:00000080:2.0:1787440092.889558:0:5872:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1787440092.889660:0:5872:0:(osd_handler.c:1564:osd_obd_connect()) connect #4 00000020:00000080:2.0:1787440092.889668:0:5872:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x85f5fa77adf3bff9 00000020:00000080:2.0:1787440092.890111:0:5872:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:2.0:1787440092.891336:0:5872:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:2.0:1787440092.982144:0:5872:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:2.0:1787440093.037237:0:5872:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:3.0:1787440093.185626:0:5872:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00010000:00010000:0.0:1787440093.283123:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:3.0:1787440093.316699:0:5872:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:3.0:1787440093.383170:0:5872:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:3.0:1787440093.419402:0:5872:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x85f5fa77adf3c000 00000020:00000080:1.0:1787440093.420312:0:5872:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1787440093.420324:0:5872:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787440093.420331:0:5872:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787440093.420333:0:5872:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1787440093.420343:0:5872:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787440093.420348:0:5872:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787440093.420349:0:5872:0:(obd_config.c:1563:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787440093.420352:0:5872:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787440093.420354:0:5872:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1787440093.420356:0:5872:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787440093.420359:0:5872:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787440093.420360:0:5872:0:(obd_config.c:1563:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000020:01000000:1.0:1787440093.420362:0:5872:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787440093.420366:0:5872:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787440093.420367:0:5872:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1787440093.420371:0:5872:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1787440093.420409:0:5872:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:1.0:1787440093.420471:0:5872:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003b2073a4 pname:cluuid:pid:xid:nid:opc:job llog_process_th:168176ea-29d1-49de-a254-317e90d54802:5872:1874266701169920:0@lo:502: 00000100:00100000:1.0:1787440093.420558:0:5872:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440093.420614:0:5872:0:(client.c:2715:ptlrpc_set_wait()) set 00000000182e9d51 going to sleep for 11 seconds 00000100:00100000:2.0:1787440093.420764:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701169920 00000100:00100000:2.0:1787440093.420773:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701169920 00000100:00100000:2.0:1787440093.420820:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787440093.420837:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000027a032cb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:168176ea-29d1-49de-a254-317e90d54802+9:5872:x1874266701169920:12345-0@lo:502: 00000100:00100000:2.0:1787440093.421231:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000027a032cb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:168176ea-29d1-49de-a254-317e90d54802+9:5872:x1874266701169920:12345-0@lo:502: Request processed in 395us (673us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440093.421239:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787440093.421335:0:5872:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003b2073a4 pname:cluuid:pid:xid:nid:opc:job llog_process_th:168176ea-29d1-49de-a254-317e90d54802:5872:1874266701169920:0@lo:502: 00000020:01000000:1.0:1787440093.421361:0:5872:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787440093.421365:0:5872:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787440093.421367:0:5872:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:1.0:1787440093.421370:0:5872:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:2.0:1787440093.421519:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:2.0:1787440093.421536:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.158@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1787440093.421549:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.158@tcp lock: 00000000ab20d29f/0x85f5fa77adf3bfb3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3bfba expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440093.421564:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.158@tcp lock: 00000000ab20d29f/0x85f5fa77adf3bfb3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3bfba expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787440093.421572:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8ee045f41000 from 1 10000000:01000000:2.0:1787440093.421575:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787440093.421598:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.158@tcp lock: 0000000068d5df5d/0x85f5fa77adf3c007 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440093.421604:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.158@tcp lock: 0000000068d5df5d/0x85f5fa77adf3c007 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440093.421611:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.158@tcp lock: 0000000068d5df5d/0x85f5fa77adf3c007 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440093.421622:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000043da56a4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:168176ea-29d1-49de-a254-317e90d54802:5830:1874266701170048:0@lo:101: 00000100:00100000:2.0:1787440093.421770:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440093.421884:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set 00000000fd44e757 going to sleep for 11 seconds 00000100:00100000:1.0:1787440093.422109:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701170048 00000100:00100000:1.0:1787440093.422114:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701170048 00000100:00100000:1.0:1787440093.422196:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787440093.422204:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f68bca78 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:168176ea-29d1-49de-a254-317e90d54802+9:5830:x1874266701170048:12345-0@lo:101: 00010000:00010000:1.0:1787440093.422215:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440093.422226:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000196b39d7/0x85f5fa77adf3c00e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x85f5fa77adf3c007 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440093.422245:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000196b39d7/0x85f5fa77adf3c00e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x85f5fa77adf3c007 expref: 10 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440093.422262:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000196b39d7/0x85f5fa77adf3c00e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f5fa77adf3c007 expref: 10 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440093.422270:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000196b39d7, rc 0) 00000100:00100000:1.0:1787440093.422314:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f68bca78 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:168176ea-29d1-49de-a254-317e90d54802+10:5830:x1874266701170048:12345-0@lo:101: Request processed in 111us (544us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440093.422321:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787440093.422390:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000043da56a4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:168176ea-29d1-49de-a254-317e90d54802:5830:1874266701170048:0@lo:101: 00010000:00010000:3.0:1787440093.422401:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.158@tcp lock: 0000000068d5df5d/0x85f5fa77adf3c007 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3c00e expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440093.422408:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.158@tcp lock: 0000000068d5df5d/0x85f5fa77adf3c007 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x85f5fa77adf3c00e expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440093.423160:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005a7306fb pname:cluuid:pid:xid:nid:opc:job mount.lustre:168176ea-29d1-49de-a254-317e90d54802:5830:1874266701170176:0@lo:256: 00000100:00100000:3.0:1787440093.423205:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440093.423235:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set 0000000025ef7072 going to sleep for 11 seconds 00000100:00100000:0.0:1787440093.423304:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701170176 00000100:00100000:0.0:1787440093.423310:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701170176 00000100:00100000:0.0:1787440093.423335:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787440093.423347:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000042a90f61 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:168176ea-29d1-49de-a254-317e90d54802+10:5830:x1874266701170176:12345-0@lo:256: 20000000:01000000:0.0:1787440093.423362:0:5843:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1787440093.423368:0:5843:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1787440093.423435:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000042a90f61 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:168176ea-29d1-49de-a254-317e90d54802+10:5830:x1874266701170176:12345-0@lo:256: Request processed in 89us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440093.423442:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787440093.423667:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005a7306fb pname:cluuid:pid:xid:nid:opc:job mount.lustre:168176ea-29d1-49de-a254-317e90d54802:5830:1874266701170176:0@lo:256: 10000000:01000000:3.0:1787440093.424890:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.158@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787440093.424915:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.158@tcp lock: 0000000068d5df5d/0x85f5fa77adf3c007 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3c00e expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440093.424927:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.158@tcp lock: 0000000068d5df5d/0x85f5fa77adf3c007 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3c00e expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787440093.424981:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8ee045f41000 from 1 10000000:01000000:0.0:1787440093.424985:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787440093.425021:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.158@tcp lock: 00000000d478a2b5/0x85f5fa77adf3c015 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440093.425029:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.158@tcp lock: 00000000d478a2b5/0x85f5fa77adf3c015 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440093.425037:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.158@tcp lock: 00000000d478a2b5/0x85f5fa77adf3c015 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440093.425054:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000025152a1f pname:cluuid:pid:xid:nid:opc:job mount.lustre:168176ea-29d1-49de-a254-317e90d54802:5830:1874266701170304:0@lo:101: 00000100:00100000:0.0:1787440093.425103:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440093.425155:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set 00000000974e6c6b going to sleep for 11 seconds 00000100:00100000:2.0:1787440093.425222:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701170304 00000100:00100000:2.0:1787440093.425229:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701170304 00000100:00100000:2.0:1787440093.425307:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787440093.425315:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000096455d94 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:168176ea-29d1-49de-a254-317e90d54802+10:5830:x1874266701170304:12345-0@lo:101: 00010000:00010000:2.0:1787440093.425326:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440093.425337:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000091030ef/0x85f5fa77adf3c01c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x85f5fa77adf3c015 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440093.425355:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000091030ef/0x85f5fa77adf3c01c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x85f5fa77adf3c015 expref: 11 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440093.425364:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000091030ef/0x85f5fa77adf3c01c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f5fa77adf3c015 expref: 11 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440093.425380:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000091030ef, rc 0) 00000100:00100000:2.0:1787440093.425420:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000096455d94 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:168176ea-29d1-49de-a254-317e90d54802+11:5830:x1874266701170304:12345-0@lo:101: Request processed in 107us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440093.425426:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787440093.425509:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000025152a1f pname:cluuid:pid:xid:nid:opc:job mount.lustre:168176ea-29d1-49de-a254-317e90d54802:5830:1874266701170304:0@lo:101: 00010000:00010000:0.0:1787440093.425521:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.158@tcp lock: 00000000d478a2b5/0x85f5fa77adf3c015 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3c01c expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440093.425528:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.158@tcp lock: 00000000d478a2b5/0x85f5fa77adf3c015 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x85f5fa77adf3c01c expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440093.425574:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000025152a1f pname:cluuid:pid:xid:nid:opc:job mount.lustre:168176ea-29d1-49de-a254-317e90d54802:5830:1874266701170432:0@lo:501: 00000100:00100000:0.0:1787440093.425599:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440093.425822:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set 00000000974e6c6b going to sleep for 11 seconds 00000100:00100000:1.0:1787440093.425954:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701170432 00000100:00100000:1.0:1787440093.425959:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701170432 00000100:00100000:1.0:1787440093.425991:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787440093.425997:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ef648c92 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:168176ea-29d1-49de-a254-317e90d54802+11:5830:x1874266701170432:12345-0@lo:501: 00000100:00100000:1.0:1787440093.427069:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ef648c92 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:168176ea-29d1-49de-a254-317e90d54802+11:5830:x1874266701170432:12345-0@lo:501: Request processed in 1070us (1467us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440093.427078:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787440093.427125:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000025152a1f pname:cluuid:pid:xid:nid:opc:job mount.lustre:168176ea-29d1-49de-a254-317e90d54802:5830:1874266701170432:0@lo:501: 00000100:00100000:0.0:1787440093.427180:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000025152a1f pname:cluuid:pid:xid:nid:opc:job mount.lustre:168176ea-29d1-49de-a254-317e90d54802:5830:1874266701170560:0@lo:503: 00000100:00100000:0.0:1787440093.427222:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440093.427255:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set 00000000974e6c6b going to sleep for 11 seconds 00000100:00100000:2.0:1787440093.427308:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701170560 00000100:00100000:2.0:1787440093.427314:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701170560 00000100:00100000:2.0:1787440093.427400:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787440093.427408:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008ee5356b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:168176ea-29d1-49de-a254-317e90d54802+11:5830:x1874266701170560:12345-0@lo:503: 00000040:00080000:2.0:1787440093.427466:0:5843:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787440093.427524:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008ee5356b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:168176ea-29d1-49de-a254-317e90d54802+11:5830:x1874266701170560:12345-0@lo:503: Request processed in 117us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440093.427530:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787440093.427614:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000025152a1f pname:cluuid:pid:xid:nid:opc:job mount.lustre:168176ea-29d1-49de-a254-317e90d54802:5830:1874266701170560:0@lo:503: 00000040:00080000:2.0:1787440093.428995:0:5876:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:0.0:1787440093.429234:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:0.0:1787440093.429253:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.158@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787440093.429271:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.158@tcp lock: 00000000d478a2b5/0x85f5fa77adf3c015 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3c01c expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440093.429282:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.158@tcp lock: 00000000d478a2b5/0x85f5fa77adf3c015 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3c01c expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787440093.429323:0:5830:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1787440093.429325:0:5830:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8ee045f41000 10000000:01000000:0.0:1787440093.429328:0:5830:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8ee045f41000 10000000:01000000:0.0:1787440093.429332:0:5830:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787440093.429338:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8ee045f41000 from 1 10000000:01000000:0.0:1787440093.429340:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787440093.429368:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.158@tcp lock: 00000000740c006c/0x85f5fa77adf3c023 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440093.429375:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.158@tcp lock: 00000000740c006c/0x85f5fa77adf3c023 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440093.429385:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.158@tcp lock: 00000000740c006c/0x85f5fa77adf3c023 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440093.429403:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000025152a1f pname:cluuid:pid:xid:nid:opc:job mount.lustre:168176ea-29d1-49de-a254-317e90d54802:5830:1874266701170688:0@lo:101: 00000100:00100000:0.0:1787440093.429475:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440093.429541:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f90d3f83 going to sleep for 11 seconds 00000100:00100000:3.0:1787440093.429814:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701170688 00000100:00100000:3.0:1787440093.429830:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701170688 00000100:00100000:3.0:1787440093.429975:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787440093.429983:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000044fe1c81 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:168176ea-29d1-49de-a254-317e90d54802+11:5830:x1874266701170688:12345-0@lo:101: 00010000:00010000:3.0:1787440093.429995:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440093.430015:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000eab82809/0x85f5fa77adf3c02a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x85f5fa77adf3c023 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440093.430036:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000eab82809/0x85f5fa77adf3c02a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x85f5fa77adf3c023 expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440093.430047:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000eab82809/0x85f5fa77adf3c02a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f5fa77adf3c023 expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440093.430054:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000eab82809, rc 0) 00000100:00100000:3.0:1787440093.430092:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000044fe1c81 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:168176ea-29d1-49de-a254-317e90d54802+12:5830:x1874266701170688:12345-0@lo:101: Request processed in 111us (618us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440093.430099:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787440093.430485:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000025152a1f pname:cluuid:pid:xid:nid:opc:job mount.lustre:168176ea-29d1-49de-a254-317e90d54802:5830:1874266701170688:0@lo:101: 00010000:00010000:0.0:1787440093.430736:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.158@tcp lock: 00000000740c006c/0x85f5fa77adf3c023 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3c02a expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440093.430980:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.158@tcp lock: 00000000740c006c/0x85f5fa77adf3c023 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x85f5fa77adf3c02a expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440093.431042:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000025152a1f pname:cluuid:pid:xid:nid:opc:job mount.lustre:168176ea-29d1-49de-a254-317e90d54802:5830:1874266701170816:0@lo:501: 00000100:00100000:0.0:1787440093.431080:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440093.431161:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f90d3f83 going to sleep for 11 seconds 00000100:00100000:2.0:1787440093.431208:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701170816 00000100:00100000:2.0:1787440093.431214:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701170816 00000100:00100000:2.0:1787440093.431251:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787440093.431259:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b07a45e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:168176ea-29d1-49de-a254-317e90d54802+12:5830:x1874266701170816:12345-0@lo:501: 00000100:00100000:2.0:1787440093.431578:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b07a45e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:168176ea-29d1-49de-a254-317e90d54802+12:5830:x1874266701170816:12345-0@lo:501: Request processed in 319us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440093.431586:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787440093.432044:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000025152a1f pname:cluuid:pid:xid:nid:opc:job mount.lustre:168176ea-29d1-49de-a254-317e90d54802:5830:1874266701170816:0@lo:501: 00000100:00100000:0.0:1787440093.432079:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000025152a1f pname:cluuid:pid:xid:nid:opc:job mount.lustre:168176ea-29d1-49de-a254-317e90d54802:5830:1874266701170944:0@lo:503: 00000100:00100000:0.0:1787440093.432120:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440093.432192:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f90d3f83 going to sleep for 11 seconds 00000100:00100000:2.0:1787440093.432229:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701170944 00000100:00100000:2.0:1787440093.432234:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701170944 00000100:00100000:2.0:1787440093.432296:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787440093.432304:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b2aa8fa8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:168176ea-29d1-49de-a254-317e90d54802+12:5830:x1874266701170944:12345-0@lo:503: 00000100:00100000:2.0:1787440093.433242:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b2aa8fa8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:168176ea-29d1-49de-a254-317e90d54802+12:5830:x1874266701170944:12345-0@lo:503: Request processed in 935us (1118us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440093.433266:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787440093.433335:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000025152a1f pname:cluuid:pid:xid:nid:opc:job mount.lustre:168176ea-29d1-49de-a254-317e90d54802:5830:1874266701170944:0@lo:503: 00000100:00100000:2.0:1787440093.434064:0:5877:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000969b801 pname:cluuid:pid:xid:nid:opc:job llog_process_th:168176ea-29d1-49de-a254-317e90d54802:5877:1874266701171072:0@lo:502: 00000100:00100000:2.0:1787440093.434107:0:5877:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440093.434194:0:5877:0:(client.c:2715:ptlrpc_set_wait()) set 00000000fd44e757 going to sleep for 11 seconds 00000100:00100000:3.0:1787440093.434228:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701171072 00000100:00100000:3.0:1787440093.434234:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701171072 00000100:00100000:3.0:1787440093.434409:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787440093.434427:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000228b752b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:168176ea-29d1-49de-a254-317e90d54802+12:5877:x1874266701171072:12345-0@lo:502: 00000100:00100000:3.0:1787440093.434686:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000228b752b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:168176ea-29d1-49de-a254-317e90d54802+12:5877:x1874266701171072:12345-0@lo:502: Request processed in 270us (578us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440093.434694:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787440093.434783:0:5877:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000969b801 pname:cluuid:pid:xid:nid:opc:job llog_process_th:168176ea-29d1-49de-a254-317e90d54802:5877:1874266701171072:0@lo:502: 00000020:01000004:2.0:1787440093.434846:0:5877:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1787440093.434859:0:5877:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000eeb56b5d) 00000020:00000080:2.0:1787440093.434881:0:5877:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:2.0:1787440093.434948:0:5877:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000491c6bc9 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1787440093.434951:0:5877:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000491c6bc9 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1787440093.434953:0:5877:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000491c6bc9 4 00010000:00080000:2.0:1787440093.434986:0:5877:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000034107df6@lustre-MDT0000-lwp-MDT0000: add connection 192.168.206.158@tcp at head 00010000:00010000:2.0:1787440093.436618:0:5877:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:2.0:1787440093.436807:0:5877:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1787440093.436839:0:5877:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787440093.436850:0:5877:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x85f5fa77adf3c038 00000100:00080000:2.0:1787440093.436858:0:5877:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787440093.436862:0:5877:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 0000000034107df6 using connection 192.168.206.158@tcp/0@lo 00000100:00100000:2.0:1787440093.436895:0:5877:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000000969b801 x1874266701171200/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787440093.436911:0:5877:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1787440093.437127:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000969b801 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874266701171200:0@lo:38: 00000100:00100000:3.0:1787440093.437210:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440093.437405:0:5877:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003b2073a4 pname:cluuid:pid:xid:nid:opc:job llog_process_th:168176ea-29d1-49de-a254-317e90d54802:5877:1874266701171328:0@lo:502: 00000100:00100000:1.0:1787440093.437447:0:5877:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440093.437479:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701171328 00000100:00100000:1.0:1787440093.437484:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701171328 00000100:00100000:1.0:1787440093.437543:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787440093.437550:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002ec2b083 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:168176ea-29d1-49de-a254-317e90d54802+12:5877:x1874266701171328:12345-0@lo:502: 00000100:00100000:1.0:1787440093.437738:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002ec2b083 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:168176ea-29d1-49de-a254-317e90d54802+12:5877:x1874266701171328:12345-0@lo:502: Request processed in 188us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440093.437745:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787440093.437786:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701171200 00000100:00100000:1.0:1787440093.437791:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701171200 00000100:00100000:1.0:1787440093.437814:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787440093.437824:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005a7306fb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3308:x1874266701171200:12345-0@lo:38: 00000100:00100000:1.0:1787440093.437865:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005a7306fb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3308:x1874266701171200:12345-0@lo:38: Request processed in 41us (656us total) trans 0 rc -11/-11 00000100:00100000:1.0:1787440093.437871:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787440093.437899:0:3308:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787440093.437905:0:3308:0:(import.c:65:import_set_state_nolock()) 0000000034107df6 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787440093.437909:0:3308:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1787440093.437911:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000969b801 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874266701171200:0@lo:38: 00000100:00100000:1.0:1787440093.437939:0:5877:0:(client.c:2715:ptlrpc_set_wait()) set 00000000960106b7 going to sleep for 11 seconds 00000100:00100000:1.0:1787440093.437950:0:5877:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003b2073a4 pname:cluuid:pid:xid:nid:opc:job llog_process_th:168176ea-29d1-49de-a254-317e90d54802:5877:1874266701171328:0@lo:502: 00000040:00080000:1.0:1787440093.437969:0:5877:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:3.0:1787440093.438330:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:3.0:1787440093.438349:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.158@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787440093.438369:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.158@tcp lock: 00000000740c006c/0x85f5fa77adf3c023 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3c02a expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440093.438379:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.158@tcp lock: 00000000740c006c/0x85f5fa77adf3c023 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3c02a expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1787440093.438434:0:5830:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1787440093.438436:0:5830:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787440093.438438:0:5830:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787440093.438439:0:5830:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787440093.438440:0:5830:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787440093.438441:0:5830:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787440093.438442:0:5830:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787440093.438443:0:5830:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787440093.438445:0:5830:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787440093.438446:0:5830:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787440093.438448:0:5830:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787440093.438449:0:5830:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787440093.438453:0:5830:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:3.0:1787440093.438455:0:5830:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787440093.438457:0:5830:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787440093.438458:0:5830:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787440093.438459:0:5830:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787440093.438460:0:5830:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787440093.438461:0:5830:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787440093.438462:0:5830:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787440093.438462:0:5830:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787440093.438463:0:5830:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787440093.438464:0:5830:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787440093.438465:0:5830:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787440093.438466:0:5830:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787440093.438480:0:5830:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1787440093.438489:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f447c822 pname:cluuid:pid:xid:nid:opc:job mount.lustre:168176ea-29d1-49de-a254-317e90d54802:5830:1874266701171456:0@lo:253: 00000100:00100000:3.0:1787440093.438542:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440093.438571:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set 00000000eaf0b2fe going to sleep for 11 seconds 00000100:00100000:1.0:1787440093.438621:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701171456 00000100:00100000:1.0:1787440093.438626:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701171456 00000100:00100000:1.0:1787440093.438657:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787440093.438663:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f99421e3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:168176ea-29d1-49de-a254-317e90d54802+12:5830:x1874266701171456:12345-0@lo:253: 20000000:01000000:1.0:1787440093.438690:0:5844:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1787440093.438703:0:5844:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1787440093.463059:0:5844:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1787440093.463071:0:5844:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1787440093.463308:0:5865:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1787440093.463313:0:5865:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1787440093.463330:0:5865:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000007c0594ea/0x85f5fa77adf3c03f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440093.463350:0:5865:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000196b39d7/0x85f5fa77adf3c00e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f5fa77adf3c007 expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440093.463369:0:5865:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000007c0594ea/0x85f5fa77adf3c03f lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440093.463406:0:5865:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000196b39d7/0x85f5fa77adf3c00e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x85f5fa77adf3c007 expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440093.463420:0:5865:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000196b39d7/0x85f5fa77adf3c00e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x85f5fa77adf3c007 expref: 12 pid: 5844 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440093.463433:0:5865:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ad912625 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5865:1874266701171584:0@lo:104: 00000100:00100000:2.0:1787440093.463535:0:5865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440093.463575:0:5865:0:(client.c:2715:ptlrpc_set_wait()) set 000000000a20d7d2 going to sleep for 11 seconds 00000100:00100000:1.0:1787440093.463739:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701171584 00000100:00100000:1.0:1787440093.463746:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701171584 00000100:00100000:1.0:1787440093.463786:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787440093.463794:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000eff44932 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:168176ea-29d1-49de-a254-317e90d54802+3:5865:x1874266701171584:12345-0@lo:104: 00010000:00010000:1.0:1787440093.463806:0:5832:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.158@tcp lock: 0000000068d5df5d/0x85f5fa77adf3c007 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x85f5fa77adf3c00e expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440093.464071:0:5832:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787440093.464077:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000eff44932 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:168176ea-29d1-49de-a254-317e90d54802+3:5865:x1874266701171584:12345-0@lo:104: Request processed in 285us (543us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440093.464093:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1787440093.465935:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787440093.465945:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.158@tcp lock: 0000000068d5df5d/0x85f5fa77adf3c007 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x85f5fa77adf3c00e expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440093.465957:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000068d5df5d already unused, calling callback (000000005edc3083) 10000000:00010000:3.0:1787440093.465960:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.158@tcp lock: 0000000068d5df5d/0x85f5fa77adf3c007 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x85f5fa77adf3c00e expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440093.465982:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.158@tcp lock: 0000000068d5df5d/0x85f5fa77adf3c007 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x85f5fa77adf3c00e expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787440093.465988:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.158@tcp lock: 0000000068d5df5d/0x85f5fa77adf3c007 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x85f5fa77adf3c00e expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787440093.465994:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787440093.466032:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.158@tcp lock: 0000000068d5df5d/0x85f5fa77adf3c007 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x85f5fa77adf3c00e expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440093.466038:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787440093.466055:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.158@tcp lock: 0000000068d5df5d/0x85f5fa77adf3c007 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x85f5fa77adf3c00e expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440093.466062:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.158@tcp lock: 0000000068d5df5d/0x85f5fa77adf3c007 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x85f5fa77adf3c00e expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440093.466080:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787440093.466082:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787440093.466084:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787440093.466213:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000098c9e9f8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:168176ea-29d1-49de-a254-317e90d54802:3310:1874266701171712:0@lo:103: 00000100:00100000:1.0:1787440093.466265:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440093.467976:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701171712 00000100:00100000:1.0:1787440093.467989:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701171712 00010000:00010000:1.0:1787440093.468021:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000196b39d7/0x85f5fa77adf3c00e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x85f5fa77adf3c007 expref: 13 pid: 5844 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440093.468064:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787440093.468073:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003b2073a4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:168176ea-29d1-49de-a254-317e90d54802+13:3310:x1874266701171712:12345-0@lo:103: 00010000:00010000:1.0:1787440093.468087:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787440093.468091:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000196b39d7/0x85f5fa77adf3c00e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x85f5fa77adf3c007 expref: 13 pid: 5844 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440093.468101:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000196b39d7/0x85f5fa77adf3c00e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x85f5fa77adf3c007 expref: 13 pid: 5844 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440093.468119:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000007c0594ea/0x85f5fa77adf3c03f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440093.468127:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000007c0594ea/0x85f5fa77adf3c03f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787440093.468151:0:5834:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004839126s 00010000:00010000:1.0:1787440093.468155:0:5834:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000007c0594ea/0x85f5fa77adf3c03f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440093.468161:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000007c0594ea/0x85f5fa77adf3c03f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440093.468183:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000007c0594ea/0x85f5fa77adf3c03f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440093.468188:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000007c0594ea/0x85f5fa77adf3c03f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440093.468193:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000007c0594ea already unused, calling callback (000000000be79b10) 00010000:00010000:1.0:1787440093.468197:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000007c0594ea/0x85f5fa77adf3c03f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440093.468203:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000007c0594ea/0x85f5fa77adf3c03f lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440093.468211:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000007c0594ea/0x85f5fa77adf3c03f lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440093.468219:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787440093.468274:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003b2073a4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:168176ea-29d1-49de-a254-317e90d54802+13:3310:x1874266701171712:12345-0@lo:103: Request processed in 203us (2010us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440093.468282:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787440093.468317:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000098c9e9f8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:168176ea-29d1-49de-a254-317e90d54802:3310:1874266701171712:0@lo:103: 00010000:00010000:2.0:1787440093.468592:0:5865:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000196b39d7/0x85f5fa77adf3c00e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x85f5fa77adf3c007 expref: 12 pid: 5844 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440093.468606:0:5865:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ad912625 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5865:1874266701171584:0@lo:104: 00010000:00010000:2.0:1787440093.468618:0:5865:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000007c0594ea/0x85f5fa77adf3c03f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440093.468625:0:5865:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000007c0594ea/0x85f5fa77adf3c03f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440093.468630:0:5865:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000007c0594ea/0x85f5fa77adf3c03f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440093.468636:0:5865:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000007c0594ea/0x85f5fa77adf3c03f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440093.480146:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f99421e3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:168176ea-29d1-49de-a254-317e90d54802+11:5830:x1874266701171456:12345-0@lo:253: Request processed in 41464us (41585us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440093.480162:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787440093.480483:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f447c822 pname:cluuid:pid:xid:nid:opc:job mount.lustre:168176ea-29d1-49de-a254-317e90d54802:5830:1874266701171456:0@lo:253: 10000000:01000000:3.0:1787440093.480723:0:5830:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1787440093.480727:0:5830:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787440093.480729:0:5830:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787440093.480730:0:5830:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787440093.480731:0:5830:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787440093.480733:0:5830:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787440093.480734:0:5830:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787440093.480735:0:5830:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787440093.480737:0:5830:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787440093.480738:0:5830:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787440093.480751:0:5830:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787440093.480753:0:5830:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787440093.480754:0:5830:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1787440093.480772:0:5830:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1787440093.489181:0:5830:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:2.0:1787440093.490622:0:5830:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1787440093.491063:0:5830:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:2.0:1787440093.491345:0:5830:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1787440093.491637:0:5830:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:2.0:1787440093.491987:0:5830:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:2.0:1787440093.493822:0:5830:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:2.0:1787440093.494189:0:5830:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:2.0:1787440093.494428:0:5830:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:2.0:1787440093.494757:0:5830:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:2.0:1787440093.495114:0:5830:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:2.0:1787440093.495301:0:5830:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:3.0:1787440093.538832:0:5830:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:2.0:1787440093.565851:0:5830:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:0.0:1787440093.566169:0:5882:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:0.0:1787440093.566175:0:5882:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:2.0:1787440093.566399:0:5883:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1787440093.574091:0:5830:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1787440093.574445:0:5830:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1787440093.575277:0:5830:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1787440093.575289:0:5830:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1787440093.575462:0:5830:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787440093.577579:0:5830:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1787440093.578270:0:5830:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1787440093.578310:0:5830:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1787440093.578598:0:5830:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1787440093.578798:0:5830:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:3.0:1787440093.580755:0:5830:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:3.0:1787440093.581012:0:5830:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:3.0:1787440093.581185:0:5830:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:3.0:1787440093.581339:0:5830:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:3.0:1787440093.581485:0:5830:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:3.0:1787440093.581665:0:5830:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:3.0:1787440093.581812:0:5830:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:3.0:1787440093.582227:0:5830:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:3.0:1787440093.582382:0:5830:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:3.0:1787440093.583176:0:5830:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:3.0:1787440093.583341:0:5830:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:3.0:1787440093.583464:0:5830:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:3.0:1787440093.583699:0:5830:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:3.0:1787440093.584124:0:5830:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:3.0:1787440093.584289:0:5830:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:3.0:1787440093.584423:0:5830:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:3.0:1787440093.584742:0:5830:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:3.0:1787440093.584994:0:5830:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:3.0:1787440093.585151:0:5830:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:3.0:1787440093.585308:0:5830:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:3.0:1787440093.585462:0:5830:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:3.0:1787440093.585669:0:5830:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:3.0:1787440093.585820:0:5830:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:3.0:1787440093.586267:0:5830:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:3.0:1787440093.586439:0:5830:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:3.0:1787440093.587030:0:5830:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:3.0:1787440093.587186:0:5830:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:3.0:1787440093.587416:0:5830:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:3.0:1787440093.587685:0:5830:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:3.0:1787440093.587840:0:5830:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:3.0:1787440093.588078:0:5830:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:3.0:1787440093.588211:0:5830:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:3.0:1787440093.588415:0:5830:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:2.0:1787440093.610004:0:5883:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:0.0:1787440093.658102:0:5830:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1787440093.658150:0:5830:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffba9601903988 00100000:10000000:0.0:1787440093.658158:0:5830:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1787440093.658771:0:5830:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1787440093.658784:0:5830:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.158@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1787440093.658795:0:5830:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1787440093.658969:0:5830:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:2.0:1787440093.698740:0:5883:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1787440093.698806:0:5883:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1787440093.698811:0:5883:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:0.0:1787440094.306844:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787440095.327697:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787440096.348701:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787440097.375420:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787440098.380048:0:6125:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg658-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1787440098.401708:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787440098.716839:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1787440098.716849:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787440098.716852:0:8:0:(import.c:65:import_set_state_nolock()) 0000000034107df6 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787440098.716864:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 0000000034107df6 using connection 192.168.206.158@tcp/0@lo 00000100:00100000:3.0:1787440098.716885:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000bf91f989 x1874266701171968/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787440098.717197:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787440098.717213:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f447c822 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:168176ea-29d1-49de-a254-317e90d54802:3312:1874266701171840:0@lo:400: 00000100:00100000:1.0:1787440098.717275:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440098.717350:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701171840 00000100:00100000:1.0:1787440098.717363:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701171840 00000100:00100000:1.0:1787440098.717402:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787440098.717410:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000250dc744 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:168176ea-29d1-49de-a254-317e90d54802+11:3312:x1874266701171840:12345-0@lo:400: 00000100:00100000:1.0:1787440098.717455:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000250dc744 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:168176ea-29d1-49de-a254-317e90d54802+11:3312:x1874266701171840:12345-0@lo:400: Request processed in 46us (180us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440098.717462:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787440098.718817:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000bf91f989 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874266701171968:0@lo:38: 00000100:00100000:2.0:1787440098.718910:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440098.719122:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701171968 00000100:00100000:3.0:1787440098.719129:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701171968 00000100:00100000:3.0:1787440098.719166:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787440098.719171:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ad912625 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3308:x1874266701171968:12345-0@lo:38: 00010000:00080000:3.0:1787440098.719195:0:5851:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 197 last 0 00000020:00000080:3.0:1787440098.719231:0:5851:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x85f5fa77adf3c046 00000004:00100000:3.0:1787440098.719289:0:5851:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787440098.719429:0:5851:0:(import.c:65:import_set_state_nolock()) 0000000026820b25 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787440098.719477:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ad912625 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874266701171968:12345-0@lo:38: Request processed in 304us (567us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440098.719485:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1787440098.719786:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000bf91f989 x1874266701171968/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787440108 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787440098.719802:0:3308:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1787440098.719809:0:3308:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1787440098.719814:0:3308:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1787440098.719825:0:3308:0:(import.c:65:import_set_state_nolock()) 0000000034107df6 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787440098.719830:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000bf91f989 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874266701171968:0@lo:38: 00000100:00100000:1.0:1787440098.720243:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f447c822 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:168176ea-29d1-49de-a254-317e90d54802:3312:1874266701171840:0@lo:400: 00010000:00010000:0.0:1787440099.428940:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787440100.444891:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787440101.469387:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787440102.310193:0:5847:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787440102.310203:0:5847:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8ee045f41000 from 3 10000000:01000000:2.0:1787440102.310209:0:5847:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787440102.310266:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.158@tcp lock: 00000000fd156403/0x85f5fa77adf3c04d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440102.310281:0:5847:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.158@tcp lock: 00000000fd156403/0x85f5fa77adf3c04d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440102.310295:0:5847:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.158@tcp lock: 00000000fd156403/0x85f5fa77adf3c04d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440102.310324:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003edcd53a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:168176ea-29d1-49de-a254-317e90d54802:5847:1874266701172096:0@lo:101: 00000100:00100000:2.0:1787440102.310418:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440102.310485:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set 0000000055e73f7a going to sleep for 11 seconds 00000100:00100000:0.0:1787440102.310618:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701172096 00000100:00100000:0.0:1787440102.310627:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701172096 00000100:00100000:0.0:1787440102.310693:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787440102.310703:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e9c52f0b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:168176ea-29d1-49de-a254-317e90d54802+11:5847:x1874266701172096:12345-0@lo:101: 00010000:00010000:0.0:1787440102.310719:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440102.310737:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000c14f0ca8/0x85f5fa77adf3c054 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x85f5fa77adf3c04d expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440102.310765:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c14f0ca8/0x85f5fa77adf3c054 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x85f5fa77adf3c04d expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440102.310775:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000c14f0ca8/0x85f5fa77adf3c054 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f5fa77adf3c04d expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440102.310784:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000c14f0ca8, rc 0) 00000100:00100000:0.0:1787440102.310839:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e9c52f0b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:168176ea-29d1-49de-a254-317e90d54802+12:5847:x1874266701172096:12345-0@lo:101: Request processed in 139us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440102.310848:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787440102.310931:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003edcd53a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:168176ea-29d1-49de-a254-317e90d54802:5847:1874266701172096:0@lo:101: 00010000:00010000:3.0:1787440102.310947:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.158@tcp lock: 00000000fd156403/0x85f5fa77adf3c04d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3c054 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440102.310955:0:5847:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.158@tcp lock: 00000000fd156403/0x85f5fa77adf3c04d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x85f5fa77adf3c054 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440102.311014:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e95f23fc pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:168176ea-29d1-49de-a254-317e90d54802:5847:1874266701172224:0@lo:256: 00000100:00100000:3.0:1787440102.311048:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440102.311073:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ba2893a0 going to sleep for 11 seconds 00000100:00100000:0.0:1787440102.311125:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701172224 00000100:00100000:0.0:1787440102.311130:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701172224 00000100:00100000:0.0:1787440102.311161:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787440102.311168:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f841af5a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:168176ea-29d1-49de-a254-317e90d54802+12:5847:x1874266701172224:12345-0@lo:256: 20000000:01000000:0.0:1787440102.311182:0:5843:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787440102.311200:0:5843:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787440102.311203:0:5843:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:0.0:1787440102.311281:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f841af5a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:168176ea-29d1-49de-a254-317e90d54802+12:5847:x1874266701172224:12345-0@lo:256: Request processed in 114us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440102.311289:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787440102.311323:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e95f23fc pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:168176ea-29d1-49de-a254-317e90d54802:5847:1874266701172224:0@lo:256: 10000000:01000000:0.0:1787440102.311366:0:5847:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.158@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787440102.311372:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.158@tcp lock: 00000000fd156403/0x85f5fa77adf3c04d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3c054 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440102.311380:0:5847:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.158@tcp lock: 00000000fd156403/0x85f5fa77adf3c04d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3c054 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440102.494910:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787440103.305718:0:6327:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff3d604930 20000000:00000080:3.0:1787440103.305742:0:6327:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8ee077b77400 uarg=0000000000000000 20000000:01000000:3.0:1787440103.305787:0:6327:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1787440103.305796:0:6327:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1787440103.305808:0:6327:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1787440103.315353:0:6327:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:3.0:1787440103.315371:0:6327:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:0.0:1787440103.322743:0:6327:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787440103.331933:0:6327:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1787440103.332066:0:6327:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:1.0:1787440103.332146:0:6327:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:1.0:1787440103.332170:0:6327:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1787440103.332195:0:6327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000196b39d7/0x85f5fa77adf3c05b lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440103.332217:0:6327:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000091030ef/0x85f5fa77adf3c01c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f5fa77adf3c015 expref: 11 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440103.332227:0:6327:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000196b39d7/0x85f5fa77adf3c05b lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440103.332276:0:6327:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000091030ef/0x85f5fa77adf3c01c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x85f5fa77adf3c015 expref: 11 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440103.332292:0:6327:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000091030ef/0x85f5fa77adf3c01c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x85f5fa77adf3c015 expref: 11 pid: 5843 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440103.332308:0:6327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000030f04382 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6327:1874266701172352:0@lo:104: 00000100:00100000:1.0:1787440103.332388:0:6327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440103.332467:0:6327:0:(client.c:2715:ptlrpc_set_wait()) set 000000000b01aa45 going to sleep for 11 seconds 00000100:00100000:2.0:1787440103.332680:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701172352 00000100:00100000:2.0:1787440103.332690:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701172352 00000100:00100000:2.0:1787440103.332756:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787440103.332765:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008785830f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:168176ea-29d1-49de-a254-317e90d54802+3:6327:x1874266701172352:12345-0@lo:104: 00010000:00010000:2.0:1787440103.332780:0:5833:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.158@tcp lock: 00000000d478a2b5/0x85f5fa77adf3c015 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x85f5fa77adf3c01c expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440103.332843:0:5833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787440103.332848:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008785830f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:168176ea-29d1-49de-a254-317e90d54802+3:6327:x1874266701172352:12345-0@lo:104: Request processed in 86us (462us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440103.332855:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:0.0:1787440103.332975:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787440103.332982:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.158@tcp lock: 00000000d478a2b5/0x85f5fa77adf3c015 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x85f5fa77adf3c01c expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440103.332989:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000d478a2b5 already unused, calling callback (000000005edc3083) 10000000:00010000:0.0:1787440103.332992:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.158@tcp lock: 00000000d478a2b5/0x85f5fa77adf3c015 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x85f5fa77adf3c01c expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440103.333000:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.158@tcp lock: 00000000d478a2b5/0x85f5fa77adf3c015 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x85f5fa77adf3c01c expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787440103.333006:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.158@tcp lock: 00000000d478a2b5/0x85f5fa77adf3c015 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x85f5fa77adf3c01c expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787440103.333012:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787440103.333053:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.158@tcp lock: 00000000d478a2b5/0x85f5fa77adf3c015 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x85f5fa77adf3c01c expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440103.333060:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787440103.333084:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.158@tcp lock: 00000000d478a2b5/0x85f5fa77adf3c015 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x85f5fa77adf3c01c expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440103.333114:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.158@tcp lock: 00000000d478a2b5/0x85f5fa77adf3c015 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x85f5fa77adf3c01c expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440103.333136:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787440103.333138:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787440103.333139:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787440103.333148:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787440103.333160:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000025152a1f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:168176ea-29d1-49de-a254-317e90d54802:3311:1874266701172480:0@lo:103: 00000100:00100000:0.0:1787440103.333196:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440103.333252:0:6327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000030f04382 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6327:1874266701172352:0@lo:104: 00010000:00010000:0.0:1787440103.333271:0:6327:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000196b39d7/0x85f5fa77adf3c05b lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440103.333385:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701172480 00000100:00100000:1.0:1787440103.333395:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701172480 00010000:00010000:1.0:1787440103.333415:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000091030ef/0x85f5fa77adf3c01c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x85f5fa77adf3c015 expref: 12 pid: 5843 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440103.333445:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787440103.333451:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000996d2d71 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:168176ea-29d1-49de-a254-317e90d54802+12:3311:x1874266701172480:12345-0@lo:103: 00010000:00010000:1.0:1787440103.333463:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787440103.333467:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000091030ef/0x85f5fa77adf3c01c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x85f5fa77adf3c015 expref: 12 pid: 5843 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440103.333478:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000091030ef/0x85f5fa77adf3c01c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x85f5fa77adf3c015 expref: 12 pid: 5843 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440103.333516:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000091030ef/0x85f5fa77adf3c01c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x85f5fa77adf3c015 expref: 12 pid: 5843 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440103.333530:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000196b39d7/0x85f5fa77adf3c05b lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440103.333537:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000196b39d7/0x85f5fa77adf3c05b lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440103.333550:0:5834:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000196b39d7/0x85f5fa77adf3c05b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440103.333556:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000196b39d7/0x85f5fa77adf3c05b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440103.333562:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000196b39d7/0x85f5fa77adf3c05b lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440103.333568:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000196b39d7/0x85f5fa77adf3c05b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440103.333581:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000196b39d7 already unused, calling callback (000000000be79b10) 00010000:00010000:1.0:1787440103.333584:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000196b39d7/0x85f5fa77adf3c05b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440103.333591:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000196b39d7/0x85f5fa77adf3c05b lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440103.333605:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000196b39d7/0x85f5fa77adf3c05b lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440103.333614:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787440103.333644:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000996d2d71 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:168176ea-29d1-49de-a254-317e90d54802+11:3311:x1874266701172480:12345-0@lo:103: Request processed in 195us (449us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440103.333651:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:1.0:1787440103.333673:0:6327:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000196b39d7/0x85f5fa77adf3c05b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440103.333680:0:6327:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000196b39d7/0x85f5fa77adf3c05b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440103.333686:0:6327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000196b39d7/0x85f5fa77adf3c05b lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440103.334267:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000025152a1f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:168176ea-29d1-49de-a254-317e90d54802:3311:1874266701172480:0@lo:103: 00010000:00010000:3.0:1787440103.518805:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787440103.837142:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ecfd3eb9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874266701172736:0@lo:400: 00000100:00100000:0.0:1787440103.837237:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440103.837315:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787440103.837320:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005f769b53 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:168176ea-29d1-49de-a254-317e90d54802:3310:1874266701172608:0@lo:400: 00000100:00100000:0.0:1787440103.837374:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440103.837415:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701172608 00000100:00100000:0.0:1787440103.837423:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701172608 00000100:00100000:0.0:1787440103.837469:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787440103.837477:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000041ea6545 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:168176ea-29d1-49de-a254-317e90d54802+11:3310:x1874266701172608:12345-0@lo:400: 00000100:00100000:0.0:1787440103.837553:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000041ea6545 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:168176ea-29d1-49de-a254-317e90d54802+11:3310:x1874266701172608:12345-0@lo:400: Request processed in 78us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440103.837561:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787440103.837616:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005f769b53 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:168176ea-29d1-49de-a254-317e90d54802:3310:1874266701172608:0@lo:400: 00000100:00100000:3.0:1787440103.840534:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701172736 00000100:00100000:3.0:1787440103.840553:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701172736 00000100:00100000:3.0:1787440103.840620:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787440103.840628:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000025152a1f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874266701172736:12345-0@lo:400: 00000100:00100000:3.0:1787440103.840745:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000025152a1f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874266701172736:12345-0@lo:400: Request processed in 118us (3509us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440103.840753:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1787440103.840830:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000ecfd3eb9 x1874266701172736/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787440119 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787440103.840847:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ecfd3eb9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874266701172736:0@lo:400: 00010000:00010000:1.0:1787440104.541402:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787440105.565739:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787440106.588740:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787440107.612616:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1787440107.932627:0:5847:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787440107.932635:0:5847:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8ee045f41000 from 1 10000000:01000000:1.0:1787440107.932640:0:5847:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787440107.932685:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.158@tcp lock: 00000000c90bb342/0x85f5fa77adf3c062 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440107.932709:0:5847:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.158@tcp lock: 00000000c90bb342/0x85f5fa77adf3c062 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440107.932720:0:5847:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.158@tcp lock: 00000000c90bb342/0x85f5fa77adf3c062 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440107.932743:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a164c1ff pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:168176ea-29d1-49de-a254-317e90d54802:5847:1874266701172864:0@lo:101: 00000100:00100000:1.0:1787440107.932820:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440107.932908:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a8bb5f5a going to sleep for 11 seconds 00000100:00100000:3.0:1787440107.935182:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701172864 00000100:00100000:3.0:1787440107.935195:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701172864 00000100:00100000:3.0:1787440107.935254:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787440107.935262:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cf346576 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:168176ea-29d1-49de-a254-317e90d54802+11:5847:x1874266701172864:12345-0@lo:101: 00010000:00010000:3.0:1787440107.935280:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440107.935297:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000005a6a8f48/0x85f5fa77adf3c069 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x85f5fa77adf3c062 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440107.935323:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005a6a8f48/0x85f5fa77adf3c069 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x85f5fa77adf3c062 expref: 12 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440107.935334:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000005a6a8f48/0x85f5fa77adf3c069 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f5fa77adf3c062 expref: 12 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440107.935354:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000005a6a8f48, rc 0) 00000100:00100000:3.0:1787440107.935415:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cf346576 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:168176ea-29d1-49de-a254-317e90d54802+12:5847:x1874266701172864:12345-0@lo:101: Request processed in 153us (2594us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440107.935422:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787440107.935553:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a164c1ff pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:168176ea-29d1-49de-a254-317e90d54802:5847:1874266701172864:0@lo:101: 00010000:00010000:1.0:1787440107.935569:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.158@tcp lock: 00000000c90bb342/0x85f5fa77adf3c062 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3c069 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440107.935578:0:5847:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.158@tcp lock: 00000000c90bb342/0x85f5fa77adf3c062 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x85f5fa77adf3c069 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440107.935641:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a164c1ff pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:168176ea-29d1-49de-a254-317e90d54802:5847:1874266701172992:0@lo:501: 00000100:00100000:1.0:1787440107.935673:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440107.935701:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a8bb5f5a going to sleep for 11 seconds 00000100:00100000:3.0:1787440107.935871:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701172992 00000100:00100000:3.0:1787440107.935875:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701172992 00000100:00100000:3.0:1787440107.935907:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787440107.935914:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fed0c58e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:168176ea-29d1-49de-a254-317e90d54802+12:5847:x1874266701172992:12345-0@lo:501: 00000100:00100000:3.0:1787440107.936143:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fed0c58e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:168176ea-29d1-49de-a254-317e90d54802+12:5847:x1874266701172992:12345-0@lo:501: Request processed in 229us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440107.936150:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787440107.936282:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a164c1ff pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:168176ea-29d1-49de-a254-317e90d54802:5847:1874266701172992:0@lo:501: 00000100:00100000:1.0:1787440107.936309:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a164c1ff pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:168176ea-29d1-49de-a254-317e90d54802:5847:1874266701173120:0@lo:503: 00000100:00100000:1.0:1787440107.936346:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440107.936369:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a8bb5f5a going to sleep for 11 seconds 00000100:00100000:3.0:1787440107.936429:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701173120 00000100:00100000:3.0:1787440107.936433:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701173120 00000100:00100000:3.0:1787440107.936462:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787440107.936468:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000010980a1c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:168176ea-29d1-49de-a254-317e90d54802+12:5847:x1874266701173120:12345-0@lo:503: 00000100:00100000:3.0:1787440107.936631:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000010980a1c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:168176ea-29d1-49de-a254-317e90d54802+12:5847:x1874266701173120:12345-0@lo:503: Request processed in 164us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440107.936638:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787440107.936827:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a164c1ff pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:168176ea-29d1-49de-a254-317e90d54802:5847:1874266701173120:0@lo:503: 00000100:00100000:1.0:1787440107.937274:0:6635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a164c1ff pname:cluuid:pid:xid:nid:opc:job llog_process_th:168176ea-29d1-49de-a254-317e90d54802:6635:1874266701173248:0@lo:502: 00000100:00100000:1.0:1787440107.937314:0:6635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440107.937346:0:6635:0:(client.c:2715:ptlrpc_set_wait()) set 00000000fa49a367 going to sleep for 11 seconds 00000100:00100000:3.0:1787440107.937386:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701173248 00000100:00100000:3.0:1787440107.937391:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701173248 00000100:00100000:3.0:1787440107.937423:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787440107.937429:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000494ff687 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:168176ea-29d1-49de-a254-317e90d54802+12:6635:x1874266701173248:12345-0@lo:502: 00000100:00100000:3.0:1787440107.937602:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000494ff687 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:168176ea-29d1-49de-a254-317e90d54802+12:6635:x1874266701173248:12345-0@lo:502: Request processed in 173us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440107.937609:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787440107.937688:0:6635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a164c1ff pname:cluuid:pid:xid:nid:opc:job llog_process_th:168176ea-29d1-49de-a254-317e90d54802:6635:1874266701173248:0@lo:502: 00000020:01000000:1.0:1787440107.937712:0:6635:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787440107.937721:0:6635:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787440107.937723:0:6635:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1787440107.937729:0:6635:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8ee045f41000 00000020:00000080:1.0:1787440107.937732:0:6635:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787440107.937779:0:6635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee0806b7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:168176ea-29d1-49de-a254-317e90d54802:6635:1874266701173376:0@lo:502: 00000100:00100000:1.0:1787440107.937811:0:6635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440107.937835:0:6635:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee04cab70c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787440107.937982:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701173376 00000100:00100000:3.0:1787440107.937991:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701173376 00000100:00100000:3.0:1787440107.938019:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787440107.938025:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04a69a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:168176ea-29d1-49de-a254-317e90d54802+12:6635:x1874266701173376:12345-0@lo:502: 00000100:00100000:3.0:1787440107.938151:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04a69a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:168176ea-29d1-49de-a254-317e90d54802+12:6635:x1874266701173376:12345-0@lo:502: Request processed in 125us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440107.938158:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787440107.938283:0:6635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee0806b7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:168176ea-29d1-49de-a254-317e90d54802:6635:1874266701173376:0@lo:502: 00000020:01000000:1.0:1787440107.938301:0:6635:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787440107.938305:0:6635:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787440107.938307:0:6635:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1787440107.938311:0:6635:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:3.0:1787440107.938442:0:5847:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1787440107.938461:0:5847:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.158@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787440107.938471:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.158@tcp lock: ffff8ee059185c00/0x85f5fa77adf3c062 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3c069 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440107.938481:0:5847:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.158@tcp lock: ffff8ee059185c00/0x85f5fa77adf3c062 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3c069 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440108.636904:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787440108.966395:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee050482d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874266701173632:0@lo:400: 00000100:00100000:0.0:1787440108.966461:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440108.966538:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787440108.966545:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee050480000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:168176ea-29d1-49de-a254-317e90d54802:3312:1874266701173504:0@lo:400: 00000100:00100000:0.0:1787440108.966573:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440108.966607:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701173632 00000100:00100000:0.0:1787440108.966614:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701173632 00000100:00100000:0.0:1787440108.966660:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787440108.966669:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee050481c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874266701173632:12345-0@lo:400: 00000100:00100000:0.0:1787440108.966718:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee050481c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874266701173632:12345-0@lo:400: Request processed in 50us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440108.966725:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787440108.966747:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701173504 00000100:00100000:0.0:1787440108.966751:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701173504 00000100:00100000:0.0:1787440108.966776:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787440108.966782:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04a69ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:168176ea-29d1-49de-a254-317e90d54802+12:3312:x1874266701173504:12345-0@lo:400: 00000100:00100000:0.0:1787440108.966812:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04a69ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:168176ea-29d1-49de-a254-317e90d54802+12:3312:x1874266701173504:12345-0@lo:400: Request processed in 30us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440108.966819:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787440108.966863:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee050480000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:168176ea-29d1-49de-a254-317e90d54802:3312:1874266701173504:0@lo:400: 00010000:00080000:0.0:1787440108.966878:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8ee050482d80 x1874266701173632/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787440124 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787440108.966890:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee050482d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874266701173632:0@lo:400: 00000020:01000004:1.0:1787440109.324178:0:6692:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1787440109.324181:0:6692:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:1.0:1787440109.324309:0:6692:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8ee045e4e000 00000020:01000004:1.0:1787440109.324321:0:6692:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:1.0:1787440109.324332:0:6692:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1787440109.324343:0:6692:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8ee04a7e19b8) 00000020:00000080:1.0:1787440109.324355:0:6692:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1787440109.354938:0:6692:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1787440109.355316:0:6692:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1787440109.393704:0:6692:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:0.0:1787440109.402099:0:6692:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1787440109.402140:0:6692:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:0.0:1787440109.402730:0:6692:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1787440109.402861:0:6692:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:0.0:1787440109.403630:0:6692:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:0.0:1787440109.403642:0:6692:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:0.0:1787440109.403658:0:6692:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x85f5fa77adf3c077 00000020:01000004:0.0:1787440109.403666:0:6692:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:0.0:1787440109.403687:0:6692:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.158@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1787440109.403690:0:6692:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.158@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1787440109.403695:0:6692:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:0.0:1787440109.403699:0:6692:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:0.0:1787440109.403718:0:6692:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8ee080063370) 00000020:00000080:0.0:1787440109.403730:0:6692:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:0.0:1787440109.408684:0:6692:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787440109.408880:0:6692:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:0.0:1787440109.408886:0:6692:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1787440109.415890:0:6692:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1787440109.415901:0:6692:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1787440109.418138:0:6692:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1787440109.418167:0:6692:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1787440109.420139:0:6692:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787440109.420307:0:6692:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1787440109.420314:0:6692:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1787440109.426431:0:6692:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1787440109.426442:0:6692:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1787440109.460585:0:6692:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787440109.460823:0:6692:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1787440109.460831:0:6692:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1787440109.463574:0:6692:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1787440109.463589:0:6692:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1787440109.479000:0:6692:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1787440109.479026:0:6692:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1787440109.482682:0:6692:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787440109.482948:0:6692:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1787440109.482954:0:6692:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1787440109.483788:0:6692:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1787440109.483795:0:6692:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1787440109.567988:0:6692:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787440109.569409:0:6692:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1787440109.569421:0:6692:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:1.0:1787440109.581069:0:6692:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:1.0:1787440109.581087:0:6692:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1787440109.583815:0:6692:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1787440109.583842:0:6692:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:3.0:1787440109.583848:0:6692:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.158@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1787440109.625213:0:6692:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.158@tcp ctxt 0 is initialized 00000020:01000004:3.0:1787440109.625253:0:6692:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.206.158@tcp, index=0000, flags=0x20062 00000020:01000004:3.0:1787440109.625257:0:6692:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1787440109.625259:0:6692:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787440109.625261:0:6692:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787440109.625266:0:6692:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787440109.625267:0:6692:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787440109.625269:0:6692:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787440109.625270:0:6692:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787440109.625272:0:6692:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787440109.625273:0:6692:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787440109.625274:0:6692:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787440109.625276:0:6692:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787440109.625279:0:6692:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:3.0:1787440109.625281:0:6692:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787440109.625282:0:6692:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787440109.625283:0:6692:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787440109.625284:0:6692:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787440109.625285:0:6692:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787440109.625286:0:6692:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787440109.625287:0:6692:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787440109.625288:0:6692:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787440109.625289:0:6692:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787440109.625290:0:6692:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787440109.625291:0:6692:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787440109.625434:0:6692:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1787440109.625452:0:6692:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee05fb63480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:168176ea-29d1-49de-a254-317e90d54802:6692:1874266701173760:0@lo:253: 00000100:00100000:3.0:1787440109.625611:0:6692:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440109.625719:0:6692:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee045ed56c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787440109.626042:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701173760 00000100:00100000:1.0:1787440109.626050:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701173760 00000100:00100000:1.0:1787440109.626219:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787440109.626230:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04a69bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:168176ea-29d1-49de-a254-317e90d54802+12:6692:x1874266701173760:12345-0@lo:253: 20000000:01000000:1.0:1787440109.626260:0:5842:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1787440109.626264:0:5842:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:1.0:1787440109.626270:0:5842:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:1.0:1787440109.626273:0:5842:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:1.0:1787440109.629841:0:5842:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787440109.630035:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:1.0:1787440109.630048:0:5842:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:1.0:1787440109.630100:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:1.0:1787440109.630109:0:5842:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:1.0:1787440109.630140:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:0.0:1787440109.633961:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:0.0:1787440109.635004:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:0.0:1787440109.635032:0:5842:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.206.158@tcp 20000000:01000000:0.0:1787440109.635035:0:5842:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.158@tcp (null) (null) (null) 00000040:00080000:0.0:1787440109.635086:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:0.0:1787440109.635095:0:5842:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1787440109.635145:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:0.0:1787440109.635402:0:5842:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.206.158@tcp (null) (null) 00000040:00080000:0.0:1787440109.635442:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:0.0:1787440109.635451:0:5842:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1787440109.635483:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:0.0:1787440109.636231:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:0.0:1787440109.639932:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:0.0:1787440109.639963:0:5842:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.206.158@tcp 20000000:01000000:0.0:1787440109.639978:0:5842:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.158@tcp (null) (null) (null) 00000040:00080000:0.0:1787440109.640030:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:0.0:1787440109.640040:0:5842:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1787440109.640086:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:0.0:1787440109.640094:0:5842:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.206.158@tcp (null) (null) 00000040:00080000:0.0:1787440109.640141:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:0.0:1787440109.641906:0:5842:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1787440109.642683:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:2.0:1787440109.642735:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:2.0:1787440109.642872:0:5842:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:2.0:1787440109.642876:0:5842:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1787440109.642880:0:5842:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1787440109.642893:0:5842:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1787440109.642896:0:5842:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1787440109.642940:0:5842:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1787440109.642943:0:5842:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1787440109.647654:0:6708:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 8 1->4: lustre sys.timeout 20000000:01000000:2.0:1787440109.647771:0:6708:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 8 2->4: lustre sys.timeout 00000040:00080000:2.0:1787440109.649282:0:6708:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:3.0:1787440109.649603:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:3.0:1787440109.649659:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:3.0:1787440109.649694:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:3.0:1787440109.649708:0:5842:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1787440109.649711:0:5842:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00010000:00010000:3.0:1787440109.661057:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 20000000:01000000:2.0:1787440109.661301:0:6709:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 9 1->4: lustre sys.timeout 20000000:01000000:2.0:1787440109.662273:0:6709:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 9 2->4: lustre sys.timeout 00000040:00080000:2.0:1787440109.662350:0:6709:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:3.0:1787440109.674010:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:3.0:1787440109.674073:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:3.0:1787440109.674160:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:3.0:1787440109.674177:0:5842:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1787440109.674180:0:5842:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1787440109.676274:0:6710:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:3.0:1787440109.679212:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:3.0:1787440109.679270:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:3.0:1787440109.679371:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:3.0:1787440109.679392:0:5842:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:3.0:1787440109.679394:0:5842:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:3.0:1787440109.679402:0:5842:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1787440109.679421:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8ee041664e00/0x85f5fa77adf3c085 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440109.679441:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ee082163000/0x85f5fa77adf3bf9e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f5fa77adf3bf97 expref: 12 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440109.679449:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ee041665c00/0x85f5fa77adf3bfba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f5fa77adf3bfb3 expref: 12 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440109.679469:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ee041664400/0x85f5fa77adf3c02a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f5fa77adf3c023 expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440109.679476:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8ee041664e00/0x85f5fa77adf3c085 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440109.679535:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ee041664400/0x85f5fa77adf3c02a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x85f5fa77adf3c023 expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440109.679548:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ee041664400/0x85f5fa77adf3c02a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x85f5fa77adf3c023 expref: 12 pid: 5844 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440109.679561:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee05fb61180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5842:1874266701173888:0@lo:104: 00000100:00100000:3.0:1787440109.679617:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787440109.679681:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ee041665c00/0x85f5fa77adf3bfba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x85f5fa77adf3bfb3 expref: 12 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440109.679690:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ee041665c00/0x85f5fa77adf3bfba lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x85f5fa77adf3bfb3 expref: 12 pid: 5843 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440109.679712:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee05fb63100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5842:1874266701174016:0@lo:104: 00000100:00100000:3.0:1787440109.679736:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787440109.679764:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ee082163000/0x85f5fa77adf3bf9e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x85f5fa77adf3bf97 expref: 12 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440109.679773:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ee082163000/0x85f5fa77adf3bf9e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x85f5fa77adf3bf97 expref: 12 pid: 5843 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440109.679782:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee05fb62300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5842:1874266701174144:0@lo:104: 00000100:00100000:3.0:1787440109.679802:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440109.679811:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee050d65180 going to sleep for 11 seconds 00000100:00100000:1.0:1787440109.679831:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701173888 00000100:00100000:1.0:1787440109.679839:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701173888 00000100:00100000:1.0:1787440109.679873:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701174016 00000100:00100000:1.0:1787440109.679876:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701174016 00000100:00100000:1.0:1787440109.679888:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701174144 00000100:00100000:1.0:1787440109.679891:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701174144 00000100:00100000:2.0:1787440109.679909:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787440109.679971:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee05fb60e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:168176ea-29d1-49de-a254-317e90d54802+5:5842:x1874266701173888:12345-0@lo:104: 00010000:00010000:2.0:1787440109.679986:0:5833:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.158@tcp lock: ffff8ee040031000/0x85f5fa77adf3c023 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x85f5fa77adf3c02a expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440109.680057:0:5833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787440109.680072:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee05fb60e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:168176ea-29d1-49de-a254-317e90d54802+5:5842:x1874266701173888:12345-0@lo:104: Request processed in 107us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440109.680126:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee05fb61180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5842:1874266701173888:0@lo:104: 00010000:00010000:0.0:1787440109.680240:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787440109.680248:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.158@tcp lock: ffff8ee040031000/0x85f5fa77adf3c023 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x85f5fa77adf3c02a expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440109.680257:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee040031000 already unused, calling callback (ffffffffc1bd2c20) 10000000:00010000:0.0:1787440109.680261:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.158@tcp lock: ffff8ee040031000/0x85f5fa77adf3c023 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x85f5fa77adf3c02a expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440109.680271:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.158@tcp lock: ffff8ee040031000/0x85f5fa77adf3c023 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x85f5fa77adf3c02a expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787440109.680278:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.158@tcp lock: ffff8ee040031000/0x85f5fa77adf3c023 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x85f5fa77adf3c02a expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787440109.680284:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787440109.680321:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.158@tcp lock: ffff8ee040031000/0x85f5fa77adf3c023 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x85f5fa77adf3c02a expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440109.680328:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787440109.680350:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.158@tcp lock: ffff8ee040031000/0x85f5fa77adf3c023 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x85f5fa77adf3c02a expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440109.680357:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.158@tcp lock: ffff8ee040031000/0x85f5fa77adf3c023 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x85f5fa77adf3c02a expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440109.680381:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787440109.680383:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787440109.680385:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787440109.680398:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee050482d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:168176ea-29d1-49de-a254-317e90d54802:3309:1874266701174272:0@lo:103: 00000100:00100000:0.0:1787440109.680430:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440109.680473:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701174272 00000100:00100000:0.0:1787440109.680477:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701174272 00010000:00010000:0.0:1787440109.680526:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ee041664400/0x85f5fa77adf3c02a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x85f5fa77adf3c023 expref: 13 pid: 5844 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440109.680550:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787440109.680558:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee050480000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:168176ea-29d1-49de-a254-317e90d54802+13:3309:x1874266701174272:12345-0@lo:103: 00010000:00010000:0.0:1787440109.680568:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787440109.680574:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ee041664400/0x85f5fa77adf3c02a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x85f5fa77adf3c023 expref: 13 pid: 5844 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440109.680584:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ee041664400/0x85f5fa77adf3c02a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x85f5fa77adf3c023 expref: 13 pid: 5844 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440109.680598:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ee041664400/0x85f5fa77adf3c02a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x85f5fa77adf3c023 expref: 13 pid: 5844 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440109.680610:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787440109.680639:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee050480000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:168176ea-29d1-49de-a254-317e90d54802+12:3309:x1874266701174272:12345-0@lo:103: Request processed in 83us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440109.680646:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787440109.680678:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee050482d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:168176ea-29d1-49de-a254-317e90d54802:3309:1874266701174272:0@lo:103: 00000100:00100000:2.0:1787440109.684988:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787440109.685087:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787440109.685107:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee05fb61500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:168176ea-29d1-49de-a254-317e90d54802+4:5842:x1874266701174016:12345-0@lo:104: 00010000:00010000:1.0:1787440109.685126:0:5833:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.158@tcp lock: ffff8ee082162400/0x85f5fa77adf3bfb3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x85f5fa77adf3bfba expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440109.685231:0:5833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787440109.685237:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee05fb61500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:168176ea-29d1-49de-a254-317e90d54802+4:5842:x1874266701174016:12345-0@lo:104: Request processed in 141us (5500us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440109.685257:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787440109.685272:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787440109.685278:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee05fb63b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:168176ea-29d1-49de-a254-317e90d54802+3:5842:x1874266701174144:12345-0@lo:104: 00010000:00010000:1.0:1787440109.685286:0:5833:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.158@tcp lock: ffff8ee040030800/0x85f5fa77adf3bf97 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x85f5fa77adf3bf9e expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440109.685319:0:5833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787440109.685324:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee05fb63b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:168176ea-29d1-49de-a254-317e90d54802+3:5842:x1874266701174144:12345-0@lo:104: Request processed in 47us (5521us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440109.685329:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:0.0:1787440109.685478:0:5837:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787440109.685520:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.158@tcp lock: ffff8ee082162400/0x85f5fa77adf3bfb3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x85f5fa77adf3bfba expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440109.685532:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee082162400 already unused, calling callback (ffffffffc1bd2c20) 10000000:00010000:0.0:1787440109.685537:0:5837:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.158@tcp lock: ffff8ee082162400/0x85f5fa77adf3bfb3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x85f5fa77adf3bfba expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440109.685548:0:5837:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.158@tcp lock: ffff8ee082162400/0x85f5fa77adf3bfb3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x85f5fa77adf3bfba expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787440109.685556:0:5837:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.158@tcp lock: ffff8ee082162400/0x85f5fa77adf3bfb3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x85f5fa77adf3bfba expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787440109.685563:0:5837:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787440109.685609:0:5837:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.158@tcp lock: ffff8ee082162400/0x85f5fa77adf3bfb3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x85f5fa77adf3bfba expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440109.685616:0:5837:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787440109.685634:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.158@tcp lock: ffff8ee082162400/0x85f5fa77adf3bfb3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x85f5fa77adf3bfba expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440109.685641:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.158@tcp lock: ffff8ee082162400/0x85f5fa77adf3bfb3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x85f5fa77adf3bfba expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440109.685654:0:5837:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787440109.685658:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.158@tcp lock: ffff8ee040030800/0x85f5fa77adf3bf97 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x85f5fa77adf3bf9e expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440109.685664:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee040030800 already unused, calling callback (ffffffffc1bd2c20) 10000000:00010000:0.0:1787440109.685674:0:5837:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.158@tcp lock: ffff8ee040030800/0x85f5fa77adf3bf97 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x85f5fa77adf3bf9e expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440109.685681:0:5837:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.158@tcp lock: ffff8ee040030800/0x85f5fa77adf3bf97 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x85f5fa77adf3bf9e expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787440109.685688:0:5837:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.158@tcp lock: ffff8ee040030800/0x85f5fa77adf3bf97 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x85f5fa77adf3bf9e expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787440109.685693:0:5837:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787440109.685705:0:5837:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.158@tcp lock: ffff8ee040030800/0x85f5fa77adf3bf97 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x85f5fa77adf3bf9e expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440109.685710:0:5837:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787440109.685724:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.158@tcp lock: ffff8ee040030800/0x85f5fa77adf3bf97 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x85f5fa77adf3bf9e expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440109.685731:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.158@tcp lock: ffff8ee040030800/0x85f5fa77adf3bf97 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x85f5fa77adf3bf9e expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440109.685746:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787440109.685748:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787440109.685750:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787440109.685789:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee050481880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:168176ea-29d1-49de-a254-317e90d54802:3311:1874266701174528:0@lo:103: 00000100:00100000:0.0:1787440109.685832:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440109.685879:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701174528 00000100:00100000:1.0:1787440109.685886:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701174528 00000100:00100000:0.0:1787440109.685903:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee050482d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:168176ea-29d1-49de-a254-317e90d54802:3310:1874266701174400:0@lo:103: 00010000:00010000:1.0:1787440109.685909:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ee082163000/0x85f5fa77adf3bf9e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x85f5fa77adf3bf97 expref: 12 pid: 5843 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440109.685934:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440109.685938:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787440109.685945:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee050480a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:168176ea-29d1-49de-a254-317e90d54802+12:3311:x1874266701174528:12345-0@lo:103: 00010000:00010000:1.0:1787440109.685968:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1787440109.685971:0:5835:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00010000:00010000:1.0:1787440109.685975:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ee082163000/0x85f5fa77adf3bf9e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x85f5fa77adf3bf97 expref: 12 pid: 5843 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440109.685982:0:5835:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:1.0:1787440109.685991:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ee082163000/0x85f5fa77adf3bf9e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x85f5fa77adf3bf97 expref: 12 pid: 5843 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440109.686002:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787440109.686007:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787440109.686022:0:5834:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1787440109.686030:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701174400 00000100:00100000:0.0:1787440109.686035:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701174400 00000100:00100000:1.0:1787440109.686040:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee050480a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:168176ea-29d1-49de-a254-317e90d54802+12:3311:x1874266701174528:12345-0@lo:103: Request processed in 93us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440109.686048:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:0.0:1787440109.686056:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ee041665c00/0x85f5fa77adf3bfba lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x85f5fa77adf3bfb3 expref: 13 pid: 5843 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440109.686097:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787440109.686165:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee05fb63100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5842:1874266701174016:0@lo:104: 00010000:00010000:3.0:1787440109.686177:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ee082163000/0x85f5fa77adf3bf9e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x85f5fa77adf3bf97 expref: 12 pid: 5843 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440109.686187:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee05fb62300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5842:1874266701174144:0@lo:104: 00010000:00010000:3.0:1787440109.686209:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8ee041664e00/0x85f5fa77adf3c085 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440109.686244:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee050483480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:168176ea-29d1-49de-a254-317e90d54802+11:3310:x1874266701174400:12345-0@lo:103: 00010000:00010000:0.0:1787440109.686253:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787440109.686258:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ee041665c00/0x85f5fa77adf3bfba lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x85f5fa77adf3bfb3 expref: 11 pid: 5843 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440109.686267:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ee041665c00/0x85f5fa77adf3bfba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x85f5fa77adf3bfb3 expref: 11 pid: 5843 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440109.686278:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ee041665c00/0x85f5fa77adf3bfba lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x85f5fa77adf3bfb3 expref: 11 pid: 5843 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440109.686290:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8ee041664e00/0x85f5fa77adf3c085 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440109.686297:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ee041664e00/0x85f5fa77adf3c085 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440109.686309:0:5834:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ee041664e00/0x85f5fa77adf3c085 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440109.686316:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ee041664e00/0x85f5fa77adf3c085 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440109.686323:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8ee041664e00/0x85f5fa77adf3c085 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440109.686339:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8ee041664e00/0x85f5fa77adf3c085 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440109.686345:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee041664e00 already unused, calling callback (ffffffffc15b52a0) 00010000:00010000:0.0:1787440109.686349:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8ee041664e00/0x85f5fa77adf3c085 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440109.686355:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8ee041664e00/0x85f5fa77adf3c085 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440109.686374:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8ee041664e00/0x85f5fa77adf3c085 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440109.686382:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787440109.686410:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee050483480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:168176ea-29d1-49de-a254-317e90d54802+10:3310:x1874266701174400:12345-0@lo:103: Request processed in 308us (479us total) trans 0 rc 0/0 00010000:00010000:3.0:1787440109.686791:0:5842:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8ee041664e00/0x85f5fa77adf3c085 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440109.686799:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8ee041664e00/0x85f5fa77adf3c085 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440109.686807:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ee041664e00/0x85f5fa77adf3c085 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787440109.686828:0:5842:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1787440109.691218:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee050481880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:168176ea-29d1-49de-a254-317e90d54802:3311:1874266701174528:0@lo:103: 00000100:00100000:1.0:1787440109.693820:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee050482d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:168176ea-29d1-49de-a254-317e90d54802:3310:1874266701174400:0@lo:103: 00000100:00100000:0.0:1787440109.694260:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787440109.769868:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04a69bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:168176ea-29d1-49de-a254-317e90d54802+9:6692:x1874266701173760:12345-0@lo:253: Request processed in 143630us (144247us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440109.769882:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787440109.769989:0:6692:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee05fb63480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:168176ea-29d1-49de-a254-317e90d54802:6692:1874266701173760:0@lo:253: 10000000:01000000:1.0:1787440109.770005:0:6692:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1787440109.770009:0:6692:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787440109.770010:0:6692:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787440109.770012:0:6692:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787440109.770013:0:6692:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:1.0:1787440109.770014:0:6692:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787440109.770016:0:6692:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787440109.770017:0:6692:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787440109.770019:0:6692:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1787440109.770021:0:6692:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787440109.770022:0:6692:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1787440109.770040:0:6692:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8ee045e4e000 from lustre-OST0000 10000000:01000000:1.0:1787440109.770073:0:6692:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1787440109.770077:0:6692:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1787440109.770082:0:6692:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8ee04a7e3370 local copy 10000000:01000000:1.0:1787440109.770086:0:6692:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1787440109.770119:0:6692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.158@tcp lock: ffff8ee059184800/0x85f5fa77adf3c08c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440109.770130:0:6692:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.206.158@tcp lock: ffff8ee059184800/0x85f5fa77adf3c08c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440109.770139:0:6692:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.158@tcp lock: ffff8ee059184800/0x85f5fa77adf3c08c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440109.770156:0:6692:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee0806b7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:168176ea-29d1-49de-a254-317e90d54802:6692:1874266701174656:0@lo:101: 00000100:00100000:1.0:1787440109.770191:0:6692:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440109.770242:0:6692:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee042d78cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787440109.770861:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701174656 00000100:00100000:0.0:1787440109.770869:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701174656 00000100:00100000:0.0:1787440109.770915:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787440109.770924:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04a699c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:168176ea-29d1-49de-a254-317e90d54802+9:6692:x1874266701174656:12345-0@lo:101: 00010000:00010000:0.0:1787440109.770936:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440109.770951:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ee040030800/0x85f5fa77adf3c093 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x85f5fa77adf3c08c expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440109.770975:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ee040030800/0x85f5fa77adf3c093 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x85f5fa77adf3c08c expref: 10 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440109.770985:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ee040030800/0x85f5fa77adf3c093 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f5fa77adf3c08c expref: 10 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440109.771016:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee040030800, rc 0) 00000100:00100000:2.0:1787440109.771171:0:6692:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee0806b7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:168176ea-29d1-49de-a254-317e90d54802:6692:1874266701174656:0@lo:101: 00010000:00010000:2.0:1787440109.771185:0:6692:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.158@tcp lock: ffff8ee059184800/0x85f5fa77adf3c08c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x85f5fa77adf3c093 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440109.771194:0:6692:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.158@tcp lock: ffff8ee059184800/0x85f5fa77adf3c08c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x85f5fa77adf3c093 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440109.771313:0:6692:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee049046a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:168176ea-29d1-49de-a254-317e90d54802:6692:1874266701174784:0@lo:501: 00000100:00100000:2.0:1787440109.771617:0:6692:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440109.771653:0:6692:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee0486aaf00 going to sleep for 11 seconds 00000100:00100000:3.0:1787440109.771846:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701174784 00000100:00100000:3.0:1787440109.771852:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701174784 00000100:00100000:3.0:1787440109.771925:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787440109.771932:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04a698450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:168176ea-29d1-49de-a254-317e90d54802+11:6692:x1874266701174784:12345-0@lo:501: 00000100:00100000:3.0:1787440109.772353:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04a698450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:168176ea-29d1-49de-a254-317e90d54802+11:6692:x1874266701174784:12345-0@lo:501: Request processed in 420us (735us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787440109.772361:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787440109.772438:0:6692:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee049046a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:168176ea-29d1-49de-a254-317e90d54802:6692:1874266701174784:0@lo:501: 10000000:01000000:2.0:1787440109.772454:0:6692:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.158@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1787440109.772485:0:6692:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.158@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1787440109.772512:0:6692:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.158@tcp lock: ffff8ee059184800/0x85f5fa77adf3c08c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x85f5fa77adf3c093 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440109.772523:0:6692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.158@tcp lock: ffff8ee059184800/0x85f5fa77adf3c08c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x85f5fa77adf3c093 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440109.772537:0:6692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.158@tcp lock: ffff8ee059184800/0x85f5fa77adf3c08c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x85f5fa77adf3c093 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440109.772557:0:6692:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1787440109.772576:0:6692:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8ee045e4e000 10000000:01000000:2.0:1787440109.772582:0:6692:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1787440109.772586:0:6692:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8ee04a7e3370 10000000:01000000:2.0:1787440109.772589:0:6692:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1787440109.772592:0:6692:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8ee04a7e3370 from 1 10000000:01000000:2.0:1787440109.772594:0:6692:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1787440109.772618:0:6692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.158@tcp lock: ffff8ee082163c00/0x85f5fa77adf3c09a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440109.772626:0:6692:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.158@tcp lock: ffff8ee082163c00/0x85f5fa77adf3c09a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440109.772634:0:6692:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.158@tcp lock: ffff8ee082163c00/0x85f5fa77adf3c09a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440109.772647:0:6692:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee049046a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:168176ea-29d1-49de-a254-317e90d54802:6692:1874266701174912:0@lo:101: 00000100:00100000:2.0:1787440109.772686:0:6692:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440109.772779:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04a699c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:168176ea-29d1-49de-a254-317e90d54802+10:6692:x1874266701174656:12345-0@lo:101: Request processed in 1855us (2586us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440109.772786:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787440109.772984:0:6692:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee0486aa3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787440109.773042:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701174912 00000100:00100000:1.0:1787440109.773048:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701174912 00000100:00100000:1.0:1787440109.773101:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787440109.773107:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04a698850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:168176ea-29d1-49de-a254-317e90d54802+10:6692:x1874266701174912:12345-0@lo:101: 00010000:00010000:1.0:1787440109.773117:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440109.773130:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ee059184c00/0x85f5fa77adf3c0a1 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x85f5fa77adf3c09a expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440109.773149:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ee059184c00/0x85f5fa77adf3c0a1 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x85f5fa77adf3c09a expref: 11 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440109.773158:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ee059184c00/0x85f5fa77adf3c0a1 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f5fa77adf3c09a expref: 11 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440109.773166:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee059184c00, rc 0) 00000100:00100000:1.0:1787440109.773206:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04a698850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:168176ea-29d1-49de-a254-317e90d54802+11:6692:x1874266701174912:12345-0@lo:101: Request processed in 99us (519us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440109.773211:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787440109.776014:0:6692:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee049046a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:168176ea-29d1-49de-a254-317e90d54802:6692:1874266701174912:0@lo:101: 00010000:00010000:2.0:1787440109.776046:0:6692:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.158@tcp lock: ffff8ee082163c00/0x85f5fa77adf3c09a lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3c0a1 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440109.776071:0:6692:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.158@tcp lock: ffff8ee082163c00/0x85f5fa77adf3c09a lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x85f5fa77adf3c0a1 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787440109.776114:0:6692:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.158@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1787440109.776134:0:6692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.158@tcp lock: ffff8ee082163c00/0x85f5fa77adf3c09a lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3c0a1 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440109.776141:0:6692:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.158@tcp lock: ffff8ee082163c00/0x85f5fa77adf3c09a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3c0a1 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787440109.776158:0:6692:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1787440109.776164:0:6692:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787440109.776171:0:6692:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1787440109.776174:0:6692:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1787440109.776202:0:6692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.158@tcp lock: ffff8ee082162400/0x85f5fa77adf3c0a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440109.776209:0:6692:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.158@tcp lock: ffff8ee082162400/0x85f5fa77adf3c0a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440109.776218:0:6692:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.158@tcp lock: ffff8ee082162400/0x85f5fa77adf3c0a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440109.776235:0:6692:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee049046a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:168176ea-29d1-49de-a254-317e90d54802:6692:1874266701175040:0@lo:101: 00000100:00100000:2.0:1787440109.776300:0:6692:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440109.776334:0:6692:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee0486aa3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787440109.776717:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701175040 00000100:00100000:1.0:1787440109.776725:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701175040 00010000:00010000:2.0:1787440109.776884:0:5837:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787440109.776890:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.158@tcp lock: ffff8ee059184800/0x85f5fa77adf3c08c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x85f5fa77adf3c093 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440109.776898:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee059184800 already unused, calling callback (ffffffffc1bd2c20) 10000000:00010000:2.0:1787440109.776909:0:5837:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.158@tcp lock: ffff8ee059184800/0x85f5fa77adf3c08c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x85f5fa77adf3c093 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440109.776917:0:5837:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.158@tcp lock: ffff8ee059184800/0x85f5fa77adf3c08c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x85f5fa77adf3c093 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787440109.776924:0:5837:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.158@tcp lock: ffff8ee059184800/0x85f5fa77adf3c08c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x85f5fa77adf3c093 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787440109.776930:0:5837:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787440109.776949:0:5837:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.158@tcp lock: ffff8ee059184800/0x85f5fa77adf3c08c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x85f5fa77adf3c093 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440109.776955:0:5837:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787440109.776972:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.158@tcp lock: ffff8ee059184800/0x85f5fa77adf3c08c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x85f5fa77adf3c093 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440109.776979:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.158@tcp lock: ffff8ee059184800/0x85f5fa77adf3c08c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x85f5fa77adf3c093 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440109.776994:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787440109.776996:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787440109.776998:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787440109.777008:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee049044700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:168176ea-29d1-49de-a254-317e90d54802:3312:1874266701175168:0@lo:103: 00000100:00100000:2.0:1787440109.777039:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440109.777099:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701175168 00000100:00100000:2.0:1787440109.777103:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701175168 00000100:00100000:2.0:1787440109.777137:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787440109.777144:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee049046680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:168176ea-29d1-49de-a254-317e90d54802+12:3312:x1874266701175168:12345-0@lo:103: 00010000:00010000:2.0:1787440109.777154:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787440109.777171:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ee040030800/0x85f5fa77adf3c093 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x85f5fa77adf3c08c expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440109.777185:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787440109.777214:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee049046680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:168176ea-29d1-49de-a254-317e90d54802+11:3312:x1874266701175168:12345-0@lo:103: Request processed in 70us (173us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440109.777220:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787440109.777251:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee049044700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:168176ea-29d1-49de-a254-317e90d54802:3312:1874266701175168:0@lo:103: 00000100:00100000:1.0:1787440109.777312:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787440109.777320:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee043b4b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:168176ea-29d1-49de-a254-317e90d54802+10:6692:x1874266701175040:12345-0@lo:101: 00010000:00010000:1.0:1787440109.777331:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440109.777343:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ee059185000/0x85f5fa77adf3c0af lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x85f5fa77adf3c0a8 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440109.777359:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ee059185000/0x85f5fa77adf3c0af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x85f5fa77adf3c0a8 expref: 11 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440109.777369:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ee059185000/0x85f5fa77adf3c0af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f5fa77adf3c0a8 expref: 11 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440109.777387:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee059185000, rc 0) 00000100:00100000:1.0:1787440109.777425:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee043b4b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:168176ea-29d1-49de-a254-317e90d54802+11:6692:x1874266701175040:12345-0@lo:101: Request processed in 106us (1139us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440109.777431:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787440109.777628:0:6692:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee049046a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:168176ea-29d1-49de-a254-317e90d54802:6692:1874266701175040:0@lo:101: 00010000:00010000:2.0:1787440109.777639:0:6692:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.158@tcp lock: ffff8ee082162400/0x85f5fa77adf3c0a8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3c0af expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440109.777647:0:6692:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.158@tcp lock: ffff8ee082162400/0x85f5fa77adf3c0a8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x85f5fa77adf3c0af expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440109.777749:0:6692:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee049046a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:168176ea-29d1-49de-a254-317e90d54802:6692:1874266701175296:0@lo:501: 00000100:00100000:2.0:1787440109.777775:0:6692:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440109.777792:0:6692:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee0486aa3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787440109.777943:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701175296 00000100:00100000:1.0:1787440109.777948:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701175296 00000100:00100000:1.0:1787440109.777967:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787440109.777973:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee043b48450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:168176ea-29d1-49de-a254-317e90d54802+11:6692:x1874266701175296:12345-0@lo:501: 00000100:00100000:1.0:1787440109.778188:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee043b48450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:168176ea-29d1-49de-a254-317e90d54802+11:6692:x1874266701175296:12345-0@lo:501: Request processed in 214us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440109.778194:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787440109.778268:0:6692:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee049046a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:168176ea-29d1-49de-a254-317e90d54802:6692:1874266701175296:0@lo:501: 00000100:00100000:2.0:1787440109.778351:0:6692:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee049046a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:168176ea-29d1-49de-a254-317e90d54802:6692:1874266701175424:0@lo:503: 00000100:00100000:2.0:1787440109.778387:0:6692:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440109.778409:0:6692:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee0486aa3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787440109.778456:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701175424 00000100:00100000:1.0:1787440109.778460:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701175424 00000100:00100000:1.0:1787440109.778477:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787440109.778483:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee06d270050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:168176ea-29d1-49de-a254-317e90d54802+11:6692:x1874266701175424:12345-0@lo:503: 00000100:00100000:1.0:1787440109.778650:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee06d270050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:168176ea-29d1-49de-a254-317e90d54802+11:6692:x1874266701175424:12345-0@lo:503: Request processed in 167us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440109.778657:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787440109.778883:0:6692:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee049046a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:168176ea-29d1-49de-a254-317e90d54802:6692:1874266701175424:0@lo:503: 00000040:00080000:2.0:1787440109.779128:0:6692:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787440109.779179:0:6692:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee049046a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:168176ea-29d1-49de-a254-317e90d54802:6692:1874266701175552:0@lo:502: 00000100:00100000:2.0:1787440109.779213:0:6692:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440109.779239:0:6692:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee0486aa3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787440109.779348:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701175552 00000100:00100000:1.0:1787440109.779353:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701175552 00000100:00100000:1.0:1787440109.779372:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787440109.779377:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee06d273850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:168176ea-29d1-49de-a254-317e90d54802+11:6692:x1874266701175552:12345-0@lo:502: 00000100:00100000:1.0:1787440109.779531:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee06d273850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:168176ea-29d1-49de-a254-317e90d54802+11:6692:x1874266701175552:12345-0@lo:502: Request processed in 153us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440109.779538:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787440109.779683:0:6692:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee049046a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:168176ea-29d1-49de-a254-317e90d54802:6692:1874266701175552:0@lo:502: 00000040:00080000:2.0:1787440109.780032:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1787440109.780139:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:2.0:1787440109.780176:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:2.0:1787440109.780223:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:2.0:1787440109.780261:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:2.0:1787440109.780308:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:2.0:1787440109.780335:0:6692:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee049046a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:168176ea-29d1-49de-a254-317e90d54802:6692:1874266701175680:0@lo:502: 00000100:00100000:2.0:1787440109.780375:0:6692:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440109.780399:0:6692:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee0486aa3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787440109.780571:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701175680 00000100:00100000:0.0:1787440109.780578:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701175680 00000100:00100000:0.0:1787440109.780602:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787440109.780610:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee06d273450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:168176ea-29d1-49de-a254-317e90d54802+11:6692:x1874266701175680:12345-0@lo:502: 00000100:00100000:0.0:1787440109.780893:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee06d273450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:168176ea-29d1-49de-a254-317e90d54802+11:6692:x1874266701175680:12345-0@lo:502: Request processed in 283us (517us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440109.780900:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787440109.781020:0:6692:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee049046a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:168176ea-29d1-49de-a254-317e90d54802:6692:1874266701175680:0@lo:502: 00000040:00080000:2.0:1787440109.781121:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1787440109.781130:0:6692:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:2.0:1787440109.781969:0:6714:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787440109.781978:0:6714:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:2.0:1787440109.781985:0:6714:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787440109.781987:0:6714:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1787440109.781993:0:6714:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787440109.782008:0:6714:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8ee07c2c19b8) 00000020:00000080:2.0:1787440109.782027:0:6714:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:2.0:1787440109.782032:0:6714:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1787440109.782116:0:6714:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8ee045e4e000 from lustre-OST0000, refs=2 00080000:01000000:2.0:1787440109.782123:0:6714:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:2.0:1787440109.782129:0:6714:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x85f5fa77adf3c0bd 00010000:00010000:0.0:1787440109.788152:0:6714:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:0.0:1787440109.788713:0:6714:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:0.0:1787440109.794200:0:6714:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:0.0:1787440109.794481:0:6714:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:1.0:1787440109.813836:0:6714:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:1.0:1787440109.814288:0:6714:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:1.0:1787440109.817643:0:6714:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1787440109.817656:0:6714:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787440109.817662:0:6714:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787440109.817664:0:6714:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1787440109.817667:0:6714:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787440109.817671:0:6714:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787440109.817672:0:6714:0:(obd_config.c:1563:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787440109.817676:0:6714:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787440109.817678:0:6714:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1787440109.817733:0:6714:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787440109.817737:0:6714:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787440109.817738:0:6714:0:(obd_config.c:1563:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:1.0:1787440109.819675:0:6714:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:0.0:1787440109.819893:0:6692:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:0.0:1787440109.819918:0:6692:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.158@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1787440109.819940:0:6692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.158@tcp lock: ffff8ee082162400/0x85f5fa77adf3c0a8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3c0af expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440109.819953:0:6692:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.158@tcp lock: ffff8ee082162400/0x85f5fa77adf3c0a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3c0af expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787440109.819961:0:6692:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8ee045e4e000 from 1 10000000:01000000:0.0:1787440109.819964:0:6692:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787440109.820013:0:6692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.158@tcp lock: ffff8ee040031000/0x85f5fa77adf3c0c4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440109.820033:0:6692:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.158@tcp lock: ffff8ee040031000/0x85f5fa77adf3c0c4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440109.820044:0:6692:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.158@tcp lock: ffff8ee040031000/0x85f5fa77adf3c0c4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440109.820076:0:6692:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee050481180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:168176ea-29d1-49de-a254-317e90d54802:6692:1874266701175808:0@lo:101: 00000100:00100000:0.0:1787440109.820140:0:6692:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440109.820181:0:6692:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee04cab7f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787440109.820205:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701175808 00000100:00100000:0.0:1787440109.820211:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701175808 00000100:00100000:0.0:1787440109.820713:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787440109.820722:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee06d270c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:168176ea-29d1-49de-a254-317e90d54802+11:6692:x1874266701175808:12345-0@lo:101: 00010000:00010000:0.0:1787440109.820735:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440109.820986:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ee040030a00/0x85f5fa77adf3c0cb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x85f5fa77adf3c0c4 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440109.821011:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ee040030a00/0x85f5fa77adf3c0cb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x85f5fa77adf3c0c4 expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440109.821021:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ee040030a00/0x85f5fa77adf3c0cb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f5fa77adf3c0c4 expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440109.821029:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee040030a00, rc 0) 00000100:00100000:0.0:1787440109.821088:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee06d270c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:168176ea-29d1-49de-a254-317e90d54802+12:6692:x1874266701175808:12345-0@lo:101: Request processed in 368us (949us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440109.821094:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787440109.821141:0:6692:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee050481180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:168176ea-29d1-49de-a254-317e90d54802:6692:1874266701175808:0@lo:101: 00010000:00010000:0.0:1787440109.821165:0:6692:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.158@tcp lock: ffff8ee040031000/0x85f5fa77adf3c0c4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3c0cb expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440109.821174:0:6692:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.158@tcp lock: ffff8ee040031000/0x85f5fa77adf3c0c4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x85f5fa77adf3c0cb expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440109.821294:0:6692:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee050481180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:168176ea-29d1-49de-a254-317e90d54802:6692:1874266701175936:0@lo:501: 00000100:00100000:0.0:1787440109.821321:0:6692:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440109.821352:0:6692:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee04cab7f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787440109.822084:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701175936 00000100:00100000:1.0:1787440109.822092:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701175936 00000100:00100000:1.0:1787440109.822130:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787440109.822138:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee06d271c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:168176ea-29d1-49de-a254-317e90d54802+12:6692:x1874266701175936:12345-0@lo:501: 00000100:00100000:1.0:1787440109.822378:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee06d271c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:168176ea-29d1-49de-a254-317e90d54802+12:6692:x1874266701175936:12345-0@lo:501: Request processed in 241us (1055us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440109.822386:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787440109.822631:0:6692:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee050481180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:168176ea-29d1-49de-a254-317e90d54802:6692:1874266701175936:0@lo:501: 00000100:00100000:0.0:1787440109.822667:0:6692:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee050481180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:168176ea-29d1-49de-a254-317e90d54802:6692:1874266701176064:0@lo:503: 00000100:00100000:0.0:1787440109.822707:0:6692:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440109.822780:0:6692:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee04cab7f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787440109.825021:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701176064 00000100:00100000:1.0:1787440109.825036:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701176064 00000100:00100000:1.0:1787440109.825099:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787440109.825109:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee06d273c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:168176ea-29d1-49de-a254-317e90d54802+12:6692:x1874266701176064:12345-0@lo:503: 00000100:00100000:1.0:1787440109.825642:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee06d273c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:168176ea-29d1-49de-a254-317e90d54802+12:6692:x1874266701176064:12345-0@lo:503: Request processed in 534us (2933us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440109.825650:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787440109.830572:0:6692:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee050481180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:168176ea-29d1-49de-a254-317e90d54802:6692:1874266701176064:0@lo:503: 00000040:00080000:1.0:1787440109.832197:0:6692:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787440109.832661:0:6692:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee0806b5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:168176ea-29d1-49de-a254-317e90d54802:6692:1874266701176192:0@lo:502: 00000100:00100000:1.0:1787440109.832812:0:6692:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440109.832892:0:6692:0:(client.c:2715:ptlrpc_set_wait()) set ffff8edf411529c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787440109.833933:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701176192 00000100:00100000:2.0:1787440109.833942:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701176192 00000100:00100000:2.0:1787440109.833985:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787440109.833994:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee06d271850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:168176ea-29d1-49de-a254-317e90d54802+12:6692:x1874266701176192:12345-0@lo:502: 00000100:00100000:2.0:1787440109.834535:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee06d271850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:168176ea-29d1-49de-a254-317e90d54802+12:6692:x1874266701176192:12345-0@lo:502: Request processed in 540us (1794us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440109.834551:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787440109.836442:0:6692:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee0806b5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:168176ea-29d1-49de-a254-317e90d54802:6692:1874266701176192:0@lo:502: 00000040:00080000:1.0:1787440109.837354:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1787440109.837422:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1787440109.837463:0:6692:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee0806b5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:168176ea-29d1-49de-a254-317e90d54802:6692:1874266701176320:0@lo:502: 00000100:00100000:1.0:1787440109.837576:0:6692:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440109.837628:0:6692:0:(client.c:2715:ptlrpc_set_wait()) set ffff8edf411529c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787440109.838011:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701176320 00000100:00100000:3.0:1787440109.838018:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701176320 00000100:00100000:3.0:1787440109.838070:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787440109.838078:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee06d270850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:168176ea-29d1-49de-a254-317e90d54802+12:6692:x1874266701176320:12345-0@lo:502: 00000100:00100000:3.0:1787440109.838270:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee06d270850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:168176ea-29d1-49de-a254-317e90d54802+12:6692:x1874266701176320:12345-0@lo:502: Request processed in 192us (693us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440109.838278:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787440109.838660:0:6692:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee0806b5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:168176ea-29d1-49de-a254-317e90d54802:6692:1874266701176320:0@lo:502: 00000040:00080000:1.0:1787440109.838949:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1787440109.838961:0:6692:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1787440109.840159:0:6718:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787440109.840169:0:6718:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787440109.840171:0:6718:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787440109.840177:0:6718:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8ee045e4e000 00000020:00000080:3.0:1787440109.840180:0:6718:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787440109.840197:0:6718:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787440109.840200:0:6718:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787440109.840201:0:6718:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1787440109.840204:0:6718:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1787440109.840479:0:6692:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1787440109.840613:0:6692:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.158@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787440109.840668:0:6692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.158@tcp lock: ffff8ee040031000/0x85f5fa77adf3c0c4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3c0cb expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440109.840680:0:6692:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.158@tcp lock: ffff8ee040031000/0x85f5fa77adf3c0c4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3c0cb expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787440109.840719:0:6692:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1787440109.840722:0:6692:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8ee045e4e000 10000000:01000000:1.0:1787440109.840725:0:6692:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8ee045e4e000 10000000:01000000:1.0:1787440109.840729:0:6692:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787440109.840735:0:6692:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8ee045e4e000 from 1 10000000:01000000:1.0:1787440109.840738:0:6692:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787440109.840843:0:6692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.158@tcp lock: ffff8ee059185600/0x85f5fa77adf3c0d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440109.840851:0:6692:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.158@tcp lock: ffff8ee059185600/0x85f5fa77adf3c0d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440109.840876:0:6692:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.158@tcp lock: ffff8ee059185600/0x85f5fa77adf3c0d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440109.840897:0:6692:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee0806b5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:168176ea-29d1-49de-a254-317e90d54802:6692:1874266701176448:0@lo:101: 00000100:00100000:1.0:1787440109.840958:0:6692:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440109.841002:0:6692:0:(client.c:2715:ptlrpc_set_wait()) set ffff8edf41152b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787440109.841085:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701176448 00000100:00100000:2.0:1787440109.841092:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701176448 00000100:00100000:2.0:1787440109.841140:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787440109.841149:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee06d271050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:168176ea-29d1-49de-a254-317e90d54802+12:6692:x1874266701176448:12345-0@lo:101: 00010000:00010000:2.0:1787440109.841161:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440109.841174:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ee082163000/0x85f5fa77adf3c0d9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x85f5fa77adf3c0d2 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440109.841195:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ee082163000/0x85f5fa77adf3c0d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x85f5fa77adf3c0d2 expref: 13 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440109.841205:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ee082163000/0x85f5fa77adf3c0d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f5fa77adf3c0d2 expref: 13 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440109.841214:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee082163000, rc 0) 00000100:00100000:2.0:1787440109.841275:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee06d271050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:168176ea-29d1-49de-a254-317e90d54802+13:6692:x1874266701176448:12345-0@lo:101: Request processed in 127us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440109.841281:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787440109.841523:0:6692:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee0806b5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:168176ea-29d1-49de-a254-317e90d54802:6692:1874266701176448:0@lo:101: 00010000:00010000:0.0:1787440109.841537:0:6692:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.158@tcp lock: ffff8ee059185600/0x85f5fa77adf3c0d2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3c0d9 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440109.841545:0:6692:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.158@tcp lock: ffff8ee059185600/0x85f5fa77adf3c0d2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x85f5fa77adf3c0d9 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440109.841631:0:6692:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee050481180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:168176ea-29d1-49de-a254-317e90d54802:6692:1874266701176576:0@lo:501: 00000100:00100000:0.0:1787440109.841657:0:6692:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440109.841681:0:6692:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee04cab7f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787440109.841818:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701176576 00000100:00100000:1.0:1787440109.841823:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701176576 00000100:00100000:1.0:1787440109.841861:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787440109.841868:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee06d271450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:168176ea-29d1-49de-a254-317e90d54802+13:6692:x1874266701176576:12345-0@lo:501: 00000100:00100000:1.0:1787440109.842094:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee06d271450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:168176ea-29d1-49de-a254-317e90d54802+13:6692:x1874266701176576:12345-0@lo:501: Request processed in 226us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440109.842101:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787440109.842180:0:6692:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee050481180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:168176ea-29d1-49de-a254-317e90d54802:6692:1874266701176576:0@lo:501: 00000100:00100000:0.0:1787440109.842206:0:6692:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee050481180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:168176ea-29d1-49de-a254-317e90d54802:6692:1874266701176704:0@lo:503: 00000100:00100000:0.0:1787440109.842263:0:6692:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440109.842288:0:6692:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee04cab7f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787440109.842569:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701176704 00000100:00100000:1.0:1787440109.842573:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701176704 00000100:00100000:1.0:1787440109.842596:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787440109.842602:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee06d272450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:168176ea-29d1-49de-a254-317e90d54802+13:6692:x1874266701176704:12345-0@lo:503: 00000100:00100000:1.0:1787440109.842735:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee06d272450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:168176ea-29d1-49de-a254-317e90d54802+13:6692:x1874266701176704:12345-0@lo:503: Request processed in 133us (471us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440109.842814:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787440109.842944:0:6692:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee050481180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:168176ea-29d1-49de-a254-317e90d54802:6692:1874266701176704:0@lo:503: 00000040:00080000:0.0:1787440109.843335:0:6692:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787440109.843393:0:6692:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee050481180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:168176ea-29d1-49de-a254-317e90d54802:6692:1874266701176832:0@lo:502: 00000100:00100000:0.0:1787440109.843434:0:6692:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440109.843536:0:6692:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee04cab7f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787440109.843811:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701176832 00000100:00100000:1.0:1787440109.843817:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701176832 00000100:00100000:1.0:1787440109.843891:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787440109.843899:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee06d272850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:168176ea-29d1-49de-a254-317e90d54802+13:6692:x1874266701176832:12345-0@lo:502: 00000100:00100000:1.0:1787440109.844137:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee06d272850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:168176ea-29d1-49de-a254-317e90d54802+13:6692:x1874266701176832:12345-0@lo:502: Request processed in 238us (702us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440109.844153:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787440109.844362:0:6692:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee050481180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:168176ea-29d1-49de-a254-317e90d54802:6692:1874266701176832:0@lo:502: 00000040:00080000:0.0:1787440109.844712:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1787440109.844843:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1787440109.844879:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1787440109.844927:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1787440109.844978:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1787440109.845027:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1787440109.845077:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1787440109.845113:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1787440109.845162:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1787440109.845197:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1787440109.845683:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1787440109.845826:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1787440109.845870:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1787440109.845907:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1787440109.845956:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1787440109.845994:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1787440109.846029:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1787440109.846102:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1787440109.846142:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1787440109.846179:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1787440109.846368:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1787440109.846408:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1787440109.846440:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1787440109.846487:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1787440109.847426:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:2.0:1787440109.847464:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:2.0:1787440109.847706:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:2.0:1787440109.850467:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:2.0:1787440109.850634:0:6692:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee049046a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:168176ea-29d1-49de-a254-317e90d54802:6692:1874266701176960:0@lo:502: 00000100:00100000:2.0:1787440109.850737:0:6692:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440109.851400:0:6692:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee0486aad80 going to sleep for 11 seconds 00000100:00100000:0.0:1787440109.853032:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701176960 00000100:00100000:0.0:1787440109.853045:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701176960 00000100:00100000:0.0:1787440109.853155:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787440109.853165:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee06d270450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:168176ea-29d1-49de-a254-317e90d54802+13:6692:x1874266701176960:12345-0@lo:502: 00000100:00100000:0.0:1787440109.853451:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee06d270450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:168176ea-29d1-49de-a254-317e90d54802+13:6692:x1874266701176960:12345-0@lo:502: Request processed in 287us (2714us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440109.853459:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787440109.853600:0:6692:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee049046a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:168176ea-29d1-49de-a254-317e90d54802:6692:1874266701176960:0@lo:502: 00000040:00080000:3.0:1787440109.853705:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:3.0:1787440109.853720:0:6692:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:1.0:1787440109.854362:0:6719:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1787440109.854376:0:6719:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8ee04a7e4d28) 00000020:00000080:1.0:1787440109.854395:0:6719:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:1.0:1787440109.854459:0:6719:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8ee045e4e000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1787440109.854463:0:6719:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8ee045e4e000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1787440109.854465:0:6719:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8ee045e4e000 3 00010000:00080000:1.0:1787440109.854521:0:6719:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8ee079ae7800@lustre-MDT0000-lwp-OST0000: add connection 192.168.206.158@tcp at head 00010000:00010000:1.0:1787440109.856666:0:6719:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:1.0:1787440109.856873:0:6719:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1787440109.856907:0:6719:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787440109.856918:0:6719:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x85f5fa77adf3c0e7 00000100:00080000:1.0:1787440109.856928:0:6719:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787440109.856932:0:6719:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8ee079ae7800 using connection 192.168.206.158@tcp/0@lo 00000100:00100000:1.0:1787440109.856966:0:6719:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ee0806b4e00 x1874266701177088/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787440109.856994:0:6719:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1787440109.857071:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee0806b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874266701177216:0@lo:400: 00000100:00100000:2.0:1787440109.859029:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee0806b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3308:1874266701177088:0@lo:38: 00000100:00100000:2.0:1787440109.859107:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440109.865873:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701177088 00000100:00100000:3.0:1787440109.865886:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701177088 00000100:00100000:3.0:1787440109.865934:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787440109.865942:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee049044700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3308:x1874266701177088:12345-0@lo:38: 00010000:00080000:3.0:1787440109.865970:0:5851:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 208 last 0 00000020:00000080:3.0:1787440109.866004:0:5851:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x85f5fa77adf3c0ee 00000004:00100000:3.0:1787440109.866019:0:5851:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787440109.866046:0:5851:0:(import.c:65:import_set_state_nolock()) ffff8ee06e410800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787440109.866146:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee049044700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1874266701177088:12345-0@lo:38: Request processed in 203us (7038us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440109.866153:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787440109.867025:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440109.867445:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701177216 00000100:00100000:3.0:1787440109.867452:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701177216 00000100:00100000:3.0:1787440109.867520:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787440109.867529:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee0806b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874266701177216:12345-0@lo:400: 00000100:00100000:3.0:1787440109.867577:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee0806b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874266701177216:12345-0@lo:400: Request processed in 50us (555us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440109.867584:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1787440109.867702:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8ee0806b7100 x1874266701177216/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787440125 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787440109.867715:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee0806b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874266701177216:0@lo:400: 00000040:00080000:1.0:1787440109.867920:0:6719:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00010000:00080000:2.0:1787440109.868146:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8ee0806b4e00 x1874266701177088/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787440119 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787440109.868156:0:3308:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787440109.868165:0:3308:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:2.0:1787440109.868172:0:3308:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1787440109.868177:0:3308:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1787440109.868180:0:3308:0:(import.c:65:import_set_state_nolock()) ffff8ee079ae7800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787440109.868186:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee0806b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3308:1874266701177088:0@lo:38: 00000020:01000000:0.0:1787440109.875093:0:6692:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:0.0:1787440109.875131:0:6692:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.158@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787440109.875150:0:6692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.158@tcp lock: ffff8ee059185600/0x85f5fa77adf3c0d2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3c0d9 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440109.875172:0:6692:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.158@tcp lock: ffff8ee059185600/0x85f5fa77adf3c0d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3c0d9 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787440109.875214:0:6692:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1787440109.875854:0:6692:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787440109.875856:0:6692:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787440109.875857:0:6692:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787440109.875858:0:6692:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787440109.875860:0:6692:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787440109.875861:0:6692:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787440109.875863:0:6692:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787440109.875864:0:6692:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787440109.875866:0:6692:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787440109.875867:0:6692:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787440109.875871:0:6692:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:0.0:1787440109.875873:0:6692:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787440109.875874:0:6692:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787440109.875876:0:6692:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787440109.875877:0:6692:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787440109.875878:0:6692:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787440109.875879:0:6692:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787440109.875880:0:6692:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787440109.875881:0:6692:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787440109.875882:0:6692:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787440109.875883:0:6692:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787440109.875884:0:6692:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787440109.875910:0:6692:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1787440109.875925:0:6692:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee050481180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:168176ea-29d1-49de-a254-317e90d54802:6692:1874266701177344:0@lo:253: 00000100:00100000:0.0:1787440109.875983:0:6692:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440109.876027:0:6692:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee04cab7600 going to sleep for 11 seconds 00000100:00100000:1.0:1787440109.876097:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701177344 00000100:00100000:1.0:1787440109.876104:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701177344 00000100:00100000:1.0:1787440109.876145:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787440109.876153:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee06d273050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:168176ea-29d1-49de-a254-317e90d54802+13:6692:x1874266701177344:12345-0@lo:253: 20000000:01000000:1.0:1787440109.876183:0:5843:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1787440109.876193:0:5843:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1787440109.900976:0:5843:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1787440109.901016:0:5843:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1787440109.906645:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee06d273050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:168176ea-29d1-49de-a254-317e90d54802+13:6692:x1874266701177344:12345-0@lo:253: Request processed in 30479us (30648us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440109.906660:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787440109.906765:0:6692:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee050481180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:168176ea-29d1-49de-a254-317e90d54802:6692:1874266701177344:0@lo:253: 10000000:01000000:1.0:1787440109.906780:0:6692:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1787440109.906783:0:6692:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787440109.906785:0:6692:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787440109.906787:0:6692:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787440109.906788:0:6692:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787440109.906789:0:6692:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787440109.906791:0:6692:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787440109.906792:0:6692:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787440109.906794:0:6692:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787440109.906796:0:6692:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787440109.906798:0:6692:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787440109.906799:0:6692:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1787440109.906812:0:6692:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:2.0:1787440109.908977:0:5865:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1787440109.908987:0:5865:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1787440109.909011:0:5865:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8ee082162a00/0x85f5fa77adf3c0f5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440109.909029:0:5865:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ee040031800/0x85f5fa77adf3c054 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f5fa77adf3c04d expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440109.909055:0:5865:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8ee082162a00/0x85f5fa77adf3c0f5 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440109.909110:0:5865:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ee040031800/0x85f5fa77adf3c054 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x85f5fa77adf3c04d expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440109.909123:0:5865:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ee040031800/0x85f5fa77adf3c054 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x85f5fa77adf3c04d expref: 12 pid: 5844 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440109.909137:0:5865:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee049044380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5865:1874266701177472:0@lo:104: 00000100:00100000:2.0:1787440109.909194:0:5865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440109.909289:0:5865:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee044e69540 going to sleep for 11 seconds 00000100:00100000:0.0:1787440109.910840:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701177472 00000100:00100000:0.0:1787440109.910863:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701177472 00000100:00100000:0.0:1787440109.910955:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787440109.910965:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee049047800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:168176ea-29d1-49de-a254-317e90d54802+3:5865:x1874266701177472:12345-0@lo:104: 00010000:00010000:0.0:1787440109.910980:0:5832:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.158@tcp lock: ffff8ee082162200/0x85f5fa77adf3c04d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x85f5fa77adf3c054 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440109.911087:0:5832:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787440109.911094:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee049047800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:168176ea-29d1-49de-a254-317e90d54802+3:5865:x1874266701177472:12345-0@lo:104: Request processed in 131us (1900us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440109.911102:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:3.0:1787440109.911144:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787440109.911152:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.158@tcp lock: ffff8ee082162200/0x85f5fa77adf3c04d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x85f5fa77adf3c054 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440109.911159:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee082162200 already unused, calling callback (ffffffffc1bd2c20) 10000000:00010000:3.0:1787440109.911164:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.158@tcp lock: ffff8ee082162200/0x85f5fa77adf3c04d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x85f5fa77adf3c054 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440109.911172:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.158@tcp lock: ffff8ee082162200/0x85f5fa77adf3c04d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x85f5fa77adf3c054 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787440109.911187:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.158@tcp lock: ffff8ee082162200/0x85f5fa77adf3c04d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x85f5fa77adf3c054 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787440109.911192:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787440109.911226:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.158@tcp lock: ffff8ee082162200/0x85f5fa77adf3c04d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x85f5fa77adf3c054 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440109.911232:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787440109.911249:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.158@tcp lock: ffff8ee082162200/0x85f5fa77adf3c04d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x85f5fa77adf3c054 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440109.911256:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.158@tcp lock: ffff8ee082162200/0x85f5fa77adf3c04d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x85f5fa77adf3c054 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440109.911273:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787440109.911274:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787440109.911276:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787440109.911296:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee05fb62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:168176ea-29d1-49de-a254-317e90d54802:3310:1874266701177600:0@lo:103: 00000100:00100000:3.0:1787440109.911334:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440109.911383:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701177600 00000100:00100000:3.0:1787440109.911386:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701177600 00010000:00010000:3.0:1787440109.911403:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ee040031800/0x85f5fa77adf3c054 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x85f5fa77adf3c04d expref: 13 pid: 5844 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440109.911424:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787440109.911431:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee06e7e5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:168176ea-29d1-49de-a254-317e90d54802+13:3310:x1874266701177600:12345-0@lo:103: 00010000:00010000:3.0:1787440109.911440:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787440109.911445:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ee040031800/0x85f5fa77adf3c054 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x85f5fa77adf3c04d expref: 13 pid: 5844 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440109.911461:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ee040031800/0x85f5fa77adf3c054 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x85f5fa77adf3c04d expref: 13 pid: 5844 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440109.911477:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8ee082162a00/0x85f5fa77adf3c0f5 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440109.911485:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ee082162a00/0x85f5fa77adf3c0f5 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787440109.911524:0:5834:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004839126s 00010000:00010000:3.0:1787440109.911529:0:5834:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ee082162a00/0x85f5fa77adf3c0f5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440109.911536:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ee082162a00/0x85f5fa77adf3c0f5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440109.911543:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8ee082162a00/0x85f5fa77adf3c0f5 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440109.911550:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8ee082162a00/0x85f5fa77adf3c0f5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440109.911555:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee082162a00 already unused, calling callback (ffffffffc15b52a0) 00010000:00010000:3.0:1787440109.911559:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8ee082162a00/0x85f5fa77adf3c0f5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440109.911566:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8ee082162a00/0x85f5fa77adf3c0f5 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440109.911574:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8ee082162a00/0x85f5fa77adf3c0f5 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440109.911594:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787440109.911624:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee06e7e5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:168176ea-29d1-49de-a254-317e90d54802+13:3310:x1874266701177600:12345-0@lo:103: Request processed in 194us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440109.911631:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787440109.911685:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee05fb62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:168176ea-29d1-49de-a254-317e90d54802:3310:1874266701177600:0@lo:103: 00010000:00010000:2.0:1787440109.911774:0:5865:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ee040031800/0x85f5fa77adf3c054 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x85f5fa77adf3c04d expref: 12 pid: 5844 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440109.911786:0:5865:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee049044380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5865:1874266701177472:0@lo:104: 00010000:00010000:2.0:1787440109.911800:0:5865:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8ee082162a00/0x85f5fa77adf3c0f5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440109.911808:0:5865:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8ee082162a00/0x85f5fa77adf3c0f5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440109.911814:0:5865:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8ee082162a00/0x85f5fa77adf3c0f5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440109.911820:0:5865:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ee082162a00/0x85f5fa77adf3c0f5 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:0.0:1787440109.912804:0:6692:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1787440109.913006:0:6692:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1787440109.913222:0:6692:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1787440109.913408:0:6692:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1787440109.913636:0:6692:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1787440109.914252:0:6692:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1787440109.915322:0:6692:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:1.0:1787440110.181680:0:6692:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1787440110.181688:0:6692:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1787440110.181721:0:6692:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1787440110.182099:0:6692:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.158@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1787440110.182118:0:6692:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1787440110.182146:0:6692:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:2.0:1787440110.684732:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787440111.716537:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787440112.732755:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787440113.564658:0:5847:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787440113.564667:0:5847:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8ee045f41000 from 21 10000000:01000000:2.0:1787440113.564672:0:5847:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787440113.564718:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.158@tcp lock: ffff8ee082162200/0x85f5fa77adf3c0fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440113.564729:0:5847:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.158@tcp lock: ffff8ee082162200/0x85f5fa77adf3c0fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440113.564751:0:5847:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.158@tcp lock: ffff8ee082162200/0x85f5fa77adf3c0fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440113.564775:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee049044380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:168176ea-29d1-49de-a254-317e90d54802:5847:1874266701177728:0@lo:101: 00000100:00100000:2.0:1787440113.564839:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440113.564905:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee06d8f83c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787440113.564971:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701177728 00000100:00100000:1.0:1787440113.564979:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701177728 00000100:00100000:1.0:1787440113.565039:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787440113.565058:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee06d272c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:168176ea-29d1-49de-a254-317e90d54802+12:5847:x1874266701177728:12345-0@lo:101: 00010000:00010000:1.0:1787440113.565070:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440113.565083:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ee059184600/0x85f5fa77adf3c103 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x85f5fa77adf3c0fc expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440113.565110:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ee059184600/0x85f5fa77adf3c103 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x85f5fa77adf3c0fc expref: 13 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440113.565139:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ee059184600/0x85f5fa77adf3c103 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f5fa77adf3c0fc expref: 13 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440113.565148:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee059184600, rc 0) 00000100:00100000:1.0:1787440113.565190:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee06d272c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:168176ea-29d1-49de-a254-317e90d54802+13:5847:x1874266701177728:12345-0@lo:101: Request processed in 134us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440113.565197:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787440113.565297:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee049044380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:168176ea-29d1-49de-a254-317e90d54802:5847:1874266701177728:0@lo:101: 00010000:00010000:3.0:1787440113.565314:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.158@tcp lock: ffff8ee082162200/0x85f5fa77adf3c0fc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3c103 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440113.565325:0:5847:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.158@tcp lock: ffff8ee082162200/0x85f5fa77adf3c0fc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x85f5fa77adf3c103 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440113.565386:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee05fb62300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:168176ea-29d1-49de-a254-317e90d54802:5847:1874266701177856:0@lo:501: 00000100:00100000:3.0:1787440113.565416:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440113.565439:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee045ed5300 going to sleep for 11 seconds 00000100:00100000:0.0:1787440113.565446:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701177856 00000100:00100000:0.0:1787440113.565452:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701177856 00000100:00100000:0.0:1787440113.565484:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787440113.565514:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee06d272050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:168176ea-29d1-49de-a254-317e90d54802+13:5847:x1874266701177856:12345-0@lo:501: 00000100:00100000:0.0:1787440113.566148:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee06d272050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:168176ea-29d1-49de-a254-317e90d54802+13:5847:x1874266701177856:12345-0@lo:501: Request processed in 655us (729us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440113.566156:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787440113.566200:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee05fb62300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:168176ea-29d1-49de-a254-317e90d54802:5847:1874266701177856:0@lo:501: 00000100:00100000:2.0:1787440113.566234:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee049044000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:168176ea-29d1-49de-a254-317e90d54802:5847:1874266701177984:0@lo:503: 00000100:00100000:2.0:1787440113.566282:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440113.566304:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee06d8f83c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787440113.566317:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701177984 00000100:00100000:2.0:1787440113.566321:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701177984 00000100:00100000:2.0:1787440113.566345:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787440113.566352:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee05d265050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:168176ea-29d1-49de-a254-317e90d54802+13:5847:x1874266701177984:12345-0@lo:503: 00000100:00100000:2.0:1787440113.566666:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee05d265050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:168176ea-29d1-49de-a254-317e90d54802+13:5847:x1874266701177984:12345-0@lo:503: Request processed in 313us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440113.566673:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787440113.566981:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee049044000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:168176ea-29d1-49de-a254-317e90d54802:5847:1874266701177984:0@lo:503: 00000100:00100000:0.0:1787440113.567587:0:6888:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee050480e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:168176ea-29d1-49de-a254-317e90d54802:6888:1874266701178112:0@lo:502: 00000100:00100000:0.0:1787440113.567636:0:6888:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440113.567670:0:6888:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee07fb23240 going to sleep for 11 seconds 00000100:00100000:1.0:1787440113.567757:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701178112 00000100:00100000:1.0:1787440113.567763:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701178112 00000100:00100000:1.0:1787440113.567803:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787440113.567811:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee05d264850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:168176ea-29d1-49de-a254-317e90d54802+13:6888:x1874266701178112:12345-0@lo:502: 00000100:00100000:1.0:1787440113.568066:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee05d264850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:168176ea-29d1-49de-a254-317e90d54802+13:6888:x1874266701178112:12345-0@lo:502: Request processed in 255us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440113.568073:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787440113.568258:0:6888:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee050480e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:168176ea-29d1-49de-a254-317e90d54802:6888:1874266701178112:0@lo:502: 00000100:00100000:0.0:1787440113.568299:0:6888:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee050480e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:168176ea-29d1-49de-a254-317e90d54802:6888:1874266701178240:0@lo:502: 00000100:00100000:0.0:1787440113.568331:0:6888:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440113.568354:0:6888:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee07fb23240 going to sleep for 11 seconds 00000100:00100000:1.0:1787440113.568538:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701178240 00000100:00100000:1.0:1787440113.568543:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701178240 00000100:00100000:1.0:1787440113.568566:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787440113.568573:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee05d264450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:168176ea-29d1-49de-a254-317e90d54802+13:6888:x1874266701178240:12345-0@lo:502: 00000100:00100000:1.0:1787440113.568711:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee05d264450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:168176ea-29d1-49de-a254-317e90d54802+13:6888:x1874266701178240:12345-0@lo:502: Request processed in 139us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440113.568718:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787440113.568841:0:6888:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee050480e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:168176ea-29d1-49de-a254-317e90d54802:6888:1874266701178240:0@lo:502: 00000040:00080000:2.0:1787440113.568869:0:6888:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:0.0:1787440113.569018:0:5847:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:0.0:1787440113.569037:0:5847:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.158@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787440113.569057:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.158@tcp lock: ffff8ee082162200/0x85f5fa77adf3c0fc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3c103 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440113.569067:0:5847:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.158@tcp lock: ffff8ee082162200/0x85f5fa77adf3c0fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3c103 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787440113.569077:0:5847:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787440113.569079:0:5847:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8ee045f41000 from 4 10000000:01000000:0.0:1787440113.569082:0:5847:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787440113.569106:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.158@tcp lock: ffff8ee040031600/0x85f5fa77adf3c10a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440113.569113:0:5847:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.158@tcp lock: ffff8ee040031600/0x85f5fa77adf3c10a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440113.569122:0:5847:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.158@tcp lock: ffff8ee040031600/0x85f5fa77adf3c10a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440113.569134:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee050483100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:168176ea-29d1-49de-a254-317e90d54802:5847:1874266701178368:0@lo:101: 00000100:00100000:0.0:1787440113.569160:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440113.569189:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee07fb23840 going to sleep for 11 seconds 00000100:00100000:2.0:1787440113.569281:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701178368 00000100:00100000:2.0:1787440113.569286:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701178368 00000100:00100000:2.0:1787440113.569314:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787440113.569321:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee05d265c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:168176ea-29d1-49de-a254-317e90d54802+14:5847:x1874266701178368:12345-0@lo:101: 00010000:00010000:2.0:1787440113.569329:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440113.569342:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ee082162a00/0x85f5fa77adf3c111 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x85f5fa77adf3c10a expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440113.569362:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ee082162a00/0x85f5fa77adf3c111 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x85f5fa77adf3c10a expref: 15 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440113.569373:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ee082162a00/0x85f5fa77adf3c111 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f5fa77adf3c10a expref: 15 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440113.569382:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee082162a00, rc 0) 00000100:00100000:2.0:1787440113.569427:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee05d265c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:168176ea-29d1-49de-a254-317e90d54802+15:5847:x1874266701178368:12345-0@lo:101: Request processed in 106us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440113.569433:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787440113.569464:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee050483100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:168176ea-29d1-49de-a254-317e90d54802:5847:1874266701178368:0@lo:101: 00010000:00010000:2.0:1787440113.569475:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.158@tcp lock: ffff8ee040031600/0x85f5fa77adf3c10a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3c111 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440113.569484:0:5847:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.158@tcp lock: ffff8ee040031600/0x85f5fa77adf3c10a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x85f5fa77adf3c111 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440113.569560:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee049046d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:168176ea-29d1-49de-a254-317e90d54802:5847:1874266701178496:0@lo:256: 00000100:00100000:2.0:1787440113.569587:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440113.569608:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee0460ebcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787440113.569620:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701178496 00000100:00100000:2.0:1787440113.569624:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701178496 00000100:00100000:2.0:1787440113.569640:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787440113.569645:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee05d265850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:168176ea-29d1-49de-a254-317e90d54802+15:5847:x1874266701178496:12345-0@lo:256: 20000000:01000000:2.0:1787440113.569657:0:5842:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787440113.569672:0:5842:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787440113.569675:0:5842:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:2.0:1787440113.569866:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee05d265850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:168176ea-29d1-49de-a254-317e90d54802+15:5847:x1874266701178496:12345-0@lo:256: Request processed in 220us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440113.569872:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787440113.569900:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee049046d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:168176ea-29d1-49de-a254-317e90d54802:5847:1874266701178496:0@lo:256: 10000000:01000000:2.0:1787440113.569936:0:5847:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.158@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787440113.569941:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.158@tcp lock: ffff8ee040031600/0x85f5fa77adf3c10a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3c111 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440113.569949:0:5847:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.158@tcp lock: ffff8ee040031600/0x85f5fa77adf3c10a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3c111 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787440113.569955:0:5847:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1787440113.569957:0:5847:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:2.0:1787440113.569960:0:5847:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1787440113.569974:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.158@tcp lock: ffff8ee082163800/0x85f5fa77adf3c118 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440113.569981:0:5847:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.158@tcp lock: ffff8ee082163800/0x85f5fa77adf3c118 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440113.570090:0:5847:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.158@tcp lock: ffff8ee082163800/0x85f5fa77adf3c118 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440113.570112:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee049046d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:168176ea-29d1-49de-a254-317e90d54802:5847:1874266701178624:0@lo:101: 00000100:00100000:2.0:1787440113.570136:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440113.570149:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee0460ebcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787440113.570161:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701178624 00000100:00100000:2.0:1787440113.570165:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701178624 00000100:00100000:2.0:1787440113.570182:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787440113.570188:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee05d267050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:168176ea-29d1-49de-a254-317e90d54802+15:5847:x1874266701178624:12345-0@lo:101: 00010000:00010000:2.0:1787440113.570194:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440113.570202:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ee082163600/0x85f5fa77adf3c11f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x85f5fa77adf3c118 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440113.570216:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ee082163600/0x85f5fa77adf3c11f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x85f5fa77adf3c118 expref: 16 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440113.570224:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ee082163600/0x85f5fa77adf3c11f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f5fa77adf3c118 expref: 16 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440113.570231:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee082163600, rc 0) 00000100:00100000:2.0:1787440113.570258:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee05d267050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:168176ea-29d1-49de-a254-317e90d54802+16:5847:x1874266701178624:12345-0@lo:101: Request processed in 71us (121us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440113.570264:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787440113.570291:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee049046d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:168176ea-29d1-49de-a254-317e90d54802:5847:1874266701178624:0@lo:101: 00010000:00010000:2.0:1787440113.570301:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.158@tcp lock: ffff8ee082163800/0x85f5fa77adf3c118 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3c11f expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440113.570309:0:5847:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.158@tcp lock: ffff8ee082163800/0x85f5fa77adf3c118 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x85f5fa77adf3c11f expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440113.570359:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee049046d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:168176ea-29d1-49de-a254-317e90d54802:5847:1874266701178752:0@lo:501: 00000100:00100000:2.0:1787440113.570382:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440113.570525:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701178752 00000100:00100000:1.0:1787440113.570529:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701178752 00000100:00100000:1.0:1787440113.570545:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787440113.570551:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee05d267c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:168176ea-29d1-49de-a254-317e90d54802+15:5847:x1874266701178752:12345-0@lo:501: 00000100:00100000:1.0:1787440113.570832:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee05d267c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:168176ea-29d1-49de-a254-317e90d54802+15:5847:x1874266701178752:12345-0@lo:501: Request processed in 280us (447us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440113.570843:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787440113.570968:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee0460ebcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787440113.570981:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee049046d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:168176ea-29d1-49de-a254-317e90d54802:5847:1874266701178752:0@lo:501: 00000100:00100000:2.0:1787440113.571084:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee049046d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:168176ea-29d1-49de-a254-317e90d54802:5847:1874266701178880:0@lo:503: 00000100:00100000:2.0:1787440113.571117:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440113.571171:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee0460ebcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787440113.572174:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701178880 00000100:00100000:1.0:1787440113.572184:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701178880 00000100:00100000:1.0:1787440113.572218:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787440113.572226:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee05d266c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:168176ea-29d1-49de-a254-317e90d54802+15:5847:x1874266701178880:12345-0@lo:503: 00000100:00100000:1.0:1787440113.572852:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee05d266c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:168176ea-29d1-49de-a254-317e90d54802+15:5847:x1874266701178880:12345-0@lo:503: Request processed in 624us (1731us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440113.572861:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787440113.575250:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee049046d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:168176ea-29d1-49de-a254-317e90d54802:5847:1874266701178880:0@lo:503: 00000100:00100000:0.0:1787440113.575861:0:6889:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee050481500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:168176ea-29d1-49de-a254-317e90d54802:6889:1874266701179008:0@lo:502: 00000100:00100000:0.0:1787440113.575937:0:6889:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440113.576019:0:6889:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee07fb23cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787440113.576123:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701179008 00000100:00100000:1.0:1787440113.576130:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701179008 00000100:00100000:1.0:1787440113.576202:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787440113.576211:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee05d264050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:168176ea-29d1-49de-a254-317e90d54802+15:6889:x1874266701179008:12345-0@lo:502: 00000100:00100000:1.0:1787440113.576536:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee05d264050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:168176ea-29d1-49de-a254-317e90d54802+15:6889:x1874266701179008:12345-0@lo:502: Request processed in 325us (598us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440113.576543:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787440113.576644:0:6889:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee050481500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:168176ea-29d1-49de-a254-317e90d54802:6889:1874266701179008:0@lo:502: 00000020:01000000:0.0:1787440113.576671:0:6889:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787440113.576677:0:6889:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1787440113.576683:0:6889:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787440113.576685:0:6889:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1787440113.576691:0:6889:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1787440113.576695:0:6889:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.158@tcp to nid 0x20000c0a8ce9e (192.168.206.158@tcp) 00000020:01000000:0.0:1787440113.576715:0:6889:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1787440113.576718:0:6889:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787440113.576893:0:6889:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8ee0800619b8) 00000020:00000080:0.0:1787440113.576912:0:6889:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:0.0:1787440113.576918:0:6889:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1787440113.577009:0:6889:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1787440113.577016:0:6889:0:(osd_handler.c:1564:osd_obd_connect()) connect #5 00000020:00000080:0.0:1787440113.577023:0:6889:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x85f5fa77adf3c12d 00010000:00080000:0.0:1787440113.577060:0:6889:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8ee08001f000@lustre-OST0000-osc-MDT0000: add connection 192.168.206.158@tcp at head 00010000:00010000:0.0:1787440113.577278:0:6889:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:0.0:1787440113.614632:0:6889:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1787440113.614654:0:6889:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1787440113.615244:0:6889:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787440113.615614:0:6889:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787440113.615671:0:6889:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:0.0:1787440113.615852:0:6889:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:3.0:1787440113.617182:0:6890:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787440113.617188:0:6890:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1787440113.639200:0:6889:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787440113.639216:0:6889:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1787440113.639252:0:6889:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1787440113.639272:0:6889:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x85f5fa77adf3c134 00000100:00080000:0.0:1787440113.639283:0:6889:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787440113.639296:0:6889:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8ee08001f000 using connection 192.168.206.158@tcp/0@lo 00000100:00100000:0.0:1787440113.639330:0:6889:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ee050481500 x1874266701179136/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787440113.639356:0:6889:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1787440113.639416:0:6889:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787440113.639421:0:6889:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787440113.639423:0:6889:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1787440113.639426:0:6889:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787440113.639430:0:6889:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787440113.639431:0:6889:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787440113.639434:0:6889:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787440113.639436:0:6889:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1787440113.639477:0:6889:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee050482300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:168176ea-29d1-49de-a254-317e90d54802:6889:1874266701179264:0@lo:502: 00000100:00100000:0.0:1787440113.639580:0:6889:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440113.639624:0:6889:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee07fb23e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787440113.639786:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee050481500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1874266701179136:0@lo:8: 00000100:00100000:2.0:1787440113.639821:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440113.639858:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701179264 00000100:00100000:2.0:1787440113.639864:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701179264 00000100:00100000:2.0:1787440113.639896:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787440113.639904:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee05d266050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:168176ea-29d1-49de-a254-317e90d54802+15:6889:x1874266701179264:12345-0@lo:502: 00000100:00100000:2.0:1787440113.640133:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee05d266050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:168176ea-29d1-49de-a254-317e90d54802+15:6889:x1874266701179264:12345-0@lo:502: Request processed in 228us (553us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440113.640141:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787440113.640192:0:6889:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee050482300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:168176ea-29d1-49de-a254-317e90d54802:6889:1874266701179264:0@lo:502: 00000020:01000000:2.0:1787440113.640217:0:6889:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787440113.640222:0:6889:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787440113.640224:0:6889:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre sys.timeout 00000040:00080000:2.0:1787440113.640228:0:6889:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:2.0:1787440113.640330:0:5847:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:2.0:1787440113.640345:0:5847:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.158@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1787440113.640354:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.158@tcp lock: ffff8ee082163800/0x85f5fa77adf3c118 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3c11f expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440113.640375:0:5847:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.158@tcp lock: ffff8ee082163800/0x85f5fa77adf3c118 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3c11f expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787440113.640384:0:5847:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1787440113.640386:0:5847:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8ee04a7e3370 from 1 10000000:01000000:2.0:1787440113.640389:0:5847:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787440113.640419:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.158@tcp lock: ffff8ee07f86ec00/0x85f5fa77adf3c13b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440113.640427:0:5847:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.158@tcp lock: ffff8ee07f86ec00/0x85f5fa77adf3c13b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440113.640436:0:5847:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.158@tcp lock: ffff8ee07f86ec00/0x85f5fa77adf3c13b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440113.640463:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee049045880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:168176ea-29d1-49de-a254-317e90d54802:5847:1874266701179392:0@lo:101: 00000100:00100000:2.0:1787440113.640511:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440113.640533:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee0460eb180 going to sleep for 11 seconds 00000100:00100000:2.0:1787440113.640547:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701179392 00000100:00100000:2.0:1787440113.640550:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701179392 00000100:00100000:2.0:1787440113.640572:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787440113.640579:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee05d266450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:168176ea-29d1-49de-a254-317e90d54802+15:5847:x1874266701179392:12345-0@lo:101: 00010000:00010000:2.0:1787440113.640588:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440113.640601:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ee07f86f200/0x85f5fa77adf3c142 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x85f5fa77adf3c13b expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440113.640620:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ee07f86f200/0x85f5fa77adf3c142 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x85f5fa77adf3c13b expref: 16 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440113.640641:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ee07f86f200/0x85f5fa77adf3c142 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f5fa77adf3c13b expref: 16 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440113.640648:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee07f86f200, rc 0) 00000100:00100000:2.0:1787440113.640676:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee05d266450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:168176ea-29d1-49de-a254-317e90d54802+16:5847:x1874266701179392:12345-0@lo:101: Request processed in 98us (185us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440113.640682:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787440113.640710:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee049045880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:168176ea-29d1-49de-a254-317e90d54802:5847:1874266701179392:0@lo:101: 00010000:00010000:2.0:1787440113.640722:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.158@tcp lock: ffff8ee07f86ec00/0x85f5fa77adf3c13b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3c142 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440113.640730:0:5847:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.158@tcp lock: ffff8ee07f86ec00/0x85f5fa77adf3c13b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x85f5fa77adf3c142 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440113.640766:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee049045880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:168176ea-29d1-49de-a254-317e90d54802:5847:1874266701179520:0@lo:501: 00000100:00100000:2.0:1787440113.640788:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440113.640801:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee0460eb180 going to sleep for 11 seconds 00000100:00100000:2.0:1787440113.640814:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701179520 00000100:00100000:2.0:1787440113.640817:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701179520 00000100:00100000:2.0:1787440113.640836:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787440113.640843:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee047a42850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:168176ea-29d1-49de-a254-317e90d54802+16:5847:x1874266701179520:12345-0@lo:501: 00000100:00100000:2.0:1787440113.641020:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee047a42850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:168176ea-29d1-49de-a254-317e90d54802+16:5847:x1874266701179520:12345-0@lo:501: Request processed in 176us (230us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787440113.641026:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787440113.641064:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee049045880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:168176ea-29d1-49de-a254-317e90d54802:5847:1874266701179520:0@lo:501: 10000000:01000000:2.0:1787440113.641081:0:5847:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.158@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1787440113.641091:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.158@tcp lock: ffff8ee07f86ec00/0x85f5fa77adf3c13b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3c142 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440113.641098:0:5847:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.158@tcp lock: ffff8ee07f86ec00/0x85f5fa77adf3c13b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3c142 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440113.641600:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee05fb63100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874266701179648:0@lo:400: 00000100:00100000:2.0:1787440113.641637:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440113.641665:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787440113.641671:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee05fb61180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1874266701179776:0@lo:400: 00000100:00100000:2.0:1787440113.641692:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440113.642562:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701179648 00000100:00100000:3.0:1787440113.642571:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701179648 00000100:00100000:3.0:1787440113.642610:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701179776 00000100:00100000:3.0:1787440113.642613:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701179776 00000100:00100000:0.0:1787440113.642961:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701179136 00000100:00100000:0.0:1787440113.642965:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701179136 00000100:00100000:0.0:1787440113.642995:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787440113.643001:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee049045c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3308:x1874266701179136:12345-0@lo:8: 00010000:00080000:0.0:1787440113.643028:0:6695:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 212 last 0 00000020:00000080:0.0:1787440113.643067:0:6695:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x85f5fa77adf3c149 00002000:00100000:0.0:1787440113.643128:0:6695:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8ee08001e800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113940 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1787440113.643133:0:6695:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:0.0:1787440113.643136:0:6695:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:0.0:1787440113.643248:0:6695:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1787440113.643376:0:6695:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1787440113.643411:0:6695:0:(import.c:65:import_set_state_nolock()) ffff8ee08001c800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787440113.646115:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787440113.646139:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee049045880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874266701179648:12345-0@lo:400: 00000100:00100000:3.0:1787440113.646328:0:5849:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1787440113.646337:0:5849:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00080000:3.0:1787440113.646426:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787440113.651908:0:5850:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1787440113.651934:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787440113.651949:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee049044a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874266701179776:12345-0@lo:400: 00000100:00100000:0.0:1787440113.653960:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee049045c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3308:x1874266701179136:12345-0@lo:8: Request processed in 10950us (14129us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440113.653981:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787440113.655106:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee049045880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874266701179648:12345-0@lo:400: Request processed in 8974us (13463us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440113.655119:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787440113.656339:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee049044a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874266701179776:12345-0@lo:400: Request processed in 4389us (14638us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440113.656352:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1787440113.656713:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ee050481500 x1874266701179136/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787440123 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787440113.656724:0:3308:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787440113.656733:0:3308:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1787440113.656741:0:3308:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1787440113.656746:0:3308:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1787440113.656749:0:3308:0:(import.c:65:import_set_state_nolock()) ffff8ee08001f000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1787440113.656799:0:3308:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1787440113.656806:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee050481500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1874266701179136:0@lo:8: 00010000:00080000:2.0:1787440113.656863:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ee05fb61180 x1874266701179776/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787440129 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787440113.656889:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee05fb61180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1874266701179776:0@lo:400: 00010000:00080000:2.0:1787440113.656904:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ee05fb63100 x1874266701179648/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787440129 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787440113.656911:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee05fb63100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874266701179648:0@lo:400: 00000004:00080000:1.0:1787440113.660727:0:6890:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1787440113.660958:0:6890:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 212031464656ns, next at 0ns, rc = 0 00010000:00010000:3.0:1787440113.757935:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1787440113.759416:0:6891:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:0.0:1787440113.759458:0:6891:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee050481f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6891:1874266701180032:0@lo:7: 00000100:00100000:0.0:1787440113.759548:0:6891:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440113.759599:0:6891:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee07fb23480 going to sleep for 11 seconds 00000100:00100000:3.0:1787440113.760704:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee050483b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874266701179904:0@lo:13: 00000100:00100000:3.0:1787440113.760767:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440113.761106:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701179904 00000100:00100000:0.0:1787440113.761113:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701179904 00000100:00100000:0.0:1787440113.761276:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787440113.761286:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee05fb61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1874266701179904:12345-0@lo:13: 00002000:00000024:0.0:1787440113.761317:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:0.0:1787440113.761363:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee05fb61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1874266701179904:12345-0@lo:13: Request processed in 79us (595us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440113.761370:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1787440113.761434:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787440113.761464:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ee050483b80 x1874266701179904/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787440129 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787440113.761484:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee050483b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874266701179904:0@lo:13: 00000100:00100000:0.0:1787440113.762112:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701180032 00000100:00100000:0.0:1787440113.762119:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701180032 00000100:00100000:0.0:1787440113.762171:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787440113.762179:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee050482a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6891:x1874266701180032:12345-0@lo:7: 00002000:00080000:2.0:1787440113.783704:0:6698:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:2.0:1787440113.783714:0:6698:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:2.0:1787440113.783871:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee050482a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6891:x1874266701180032:12345-0@lo:7: Request processed in 21690us (24320us total) trans 0 rc 0/0 00010000:00080000:0.0:1787440113.783907:0:6891:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ee050481f80 x1874266701180032/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787440129 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787440113.783923:0:6891:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee050481f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6891:1874266701180032:0@lo:7: 00000004:00080000:0.0:1787440113.783936:0:6891:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:2.0:1787440113.783960:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787440113.783972:0:6891:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee050481f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6891:1874266701180160:0@lo:5: 00000100:00100000:0.0:1787440113.784005:0:6891:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440113.784054:0:6891:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee07fb23480 going to sleep for 11 seconds 00000100:00100000:2.0:1787440113.784067:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701180160 00000100:00100000:2.0:1787440113.784074:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701180160 00000100:00100000:2.0:1787440113.784128:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787440113.784143:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee050483b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:6891:x1874266701180160:12345-0@lo:5: 00002000:00080000:2.0:1787440113.784238:0:6695:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1787440113.784242:0:6695:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:2.0:1787440113.784821:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee050483b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:6891:x1874266701180160:12345-0@lo:5: Request processed in 685us (815us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1787440113.784830:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1787440113.784954:0:6891:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ee050481f80 x1874266701180160/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787440129 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787440113.784968:0:6891:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee050481f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6891:1874266701180160:0@lo:5: 00000004:00080000:2.0:1787440113.784977:0:6891:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:2.0:1787440113.785005:0:6891:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee049047480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6891:1874266701180288:0@lo:700: 00000100:00100000:2.0:1787440113.785033:0:6891:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440113.785071:0:6891:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee0460eb600 going to sleep for 11 seconds 00000100:00100000:2.0:1787440113.785092:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701180288 00000100:00100000:2.0:1787440113.785096:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701180288 00000100:00100000:2.0:1787440113.785122:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787440113.785128:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee049045180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6891:x1874266701180288:12345-0@lo:700: 00000100:00100000:2.0:1787440113.785156:0:6704:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee049044e00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6704:1874266701180416:0@lo:700: 00000100:00100000:2.0:1787440113.785260:0:6704:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440113.785279:0:6704:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee0460ebe40 going to sleep for 11 seconds 00000100:00100000:2.0:1787440113.785305:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701180416 00000100:00100000:2.0:1787440113.785310:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701180416 00000100:00100000:2.0:1787440113.785341:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787440113.785347:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee049046d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6704:x1874266701180416:12345-0@lo:700: 00000004:00080000:2.0:1787440113.814595:0:5871:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 40000000:02000000:0.0:1787440113.859617:0:5856:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:0.0:1787440113.864929:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee049046d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6704:x1874266701180416:12345-0@lo:700: Request processed in 79571us (79657us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440113.864951:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1787440113.866929:0:6704:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ee049044e00 x1874266701180416/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787440129 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787440113.866945:0:6704:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee049044e00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6704:1874266701180416:0@lo:700: 40000000:02000000:2.0:1787440113.866959:0:6704:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000100:00100000:3.0:1787440113.930380:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee049045180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6891:x1874266701180288:12345-0@lo:700: Request processed in 145244us (145337us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440113.930399:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000001:00100000:2.0:1787440113.930472:0:6723:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:2.0:1787440113.930488:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00010000:00080000:0.0:1787440113.930614:0:6891:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ee049047480 x1874266701180288/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787440129 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787440113.930630:0:6891:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee049047480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6891:1874266701180288:0@lo:700: 00000004:02000040:0.0:1787440113.952387:0:6891:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:0.0:1787440113.957643:0:6891:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee050481500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6891:1874266701180544:0@lo:5: 00000100:00100000:0.0:1787440113.957709:0:6891:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440113.957873:0:6891:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee07fb23a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787440113.961714:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701180544 00000100:00100000:2.0:1787440113.961738:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701180544 00000100:00100000:2.0:1787440113.961794:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787440113.961804:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee050482300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:6891:x1874266701180544:12345-0@lo:5: 00002000:00080000:2.0:1787440113.976226:0:6698:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:2.0:1787440113.976248:0:6698:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:2.0:1787440113.982635:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee050482300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6891:x1874266701180544:12345-0@lo:5: Request processed in 20826us (24919us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1787440113.982656:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1787440113.982860:0:6891:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ee050481500 x1874266701180544/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787440129 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787440113.982873:0:6891:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1787440113.982886:0:6891:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff8ee050481500 x1874266701180544/t4294967298(4294967298) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787440129 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787440113.982902:0:6891:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee050481500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6891:1874266701180544:0@lo:5: 00000004:00080000:1.0:1787440113.982917:0:6891:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:1.0:1787440114.780961:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787440115.804674:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787440116.701405:0:7067:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg658-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1787440116.835070:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787440117.852762:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787440118.684945:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee0806b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874266701180800:0@lo:400: 00000100:00100000:1.0:1787440118.685013:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440118.685085:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787440118.685092:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee0806b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1874266701180928:0@lo:400: 00000100:00100000:1.0:1787440118.685119:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440118.685212:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee0806b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874266701181056:0@lo:400: 00000100:00100000:2.0:1787440118.685245:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440118.685274:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787440118.685280:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee0806b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:168176ea-29d1-49de-a254-317e90d54802:3309:1874266701180672:0@lo:400: 00000100:00100000:2.0:1787440118.685306:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440118.685340:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701180672 00000100:00100000:2.0:1787440118.685347:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701180672 00000100:00100000:2.0:1787440118.685388:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787440118.685397:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee047a40c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:168176ea-29d1-49de-a254-317e90d54802+16:3309:x1874266701180672:12345-0@lo:400: 00000100:00100000:2.0:1787440118.685440:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee047a40c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:168176ea-29d1-49de-a254-317e90d54802+16:3309:x1874266701180672:12345-0@lo:400: Request processed in 44us (132us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440118.685446:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787440118.685488:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee0806b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:168176ea-29d1-49de-a254-317e90d54802:3309:1874266701180672:0@lo:400: 00000100:00100000:3.0:1787440118.685589:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701180800 00000100:00100000:3.0:1787440118.685593:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701180800 00000100:00100000:3.0:1787440118.685627:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701180928 00000100:00100000:3.0:1787440118.685630:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701180928 00000100:00100000:3.0:1787440118.685666:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787440118.685674:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee0806b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874266701180800:12345-0@lo:400: 00000100:00100000:3.0:1787440118.685714:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee0806b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874266701180800:12345-0@lo:400: Request processed in 41us (702us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440118.685720:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787440118.685734:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787440118.685751:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee0806b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874266701180928:12345-0@lo:400: 00000100:00100000:3.0:1787440118.685778:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee0806b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874266701180928:12345-0@lo:400: Request processed in 38us (658us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440118.685783:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:3.0:1787440118.685799:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787440118.685825:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ee0806b7b80 x1874266701180928/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787440134 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787440118.685854:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee0806b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1874266701180928:0@lo:400: 00010000:00080000:3.0:1787440118.685868:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ee0806b6300 x1874266701180800/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787440134 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787440118.685875:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee0806b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874266701180800:0@lo:400: 00000100:00100000:1.0:1787440118.686187:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701181056 00000100:00100000:1.0:1787440118.686192:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701181056 00000100:00100000:1.0:1787440118.686244:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787440118.686251:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee049044e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3309:x1874266701181056:12345-0@lo:400: 00000100:00100000:1.0:1787440118.686308:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee049044e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3309:x1874266701181056:12345-0@lo:400: Request processed in 58us (1063us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440118.686314:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1787440118.686464:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ee0806b5f80 x1874266701181056/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787440134 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787440118.686475:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee0806b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874266701181056:0@lo:400: 00000100:00080000:3.0:1787440118.686659:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787440118.876842:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787440119.197381:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee05fb62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1874266701181184:0@lo:13: 00000100:00100000:0.0:1787440119.197475:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440119.197723:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701181184 00000100:00100000:2.0:1787440119.197731:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701181184 00000100:00100000:2.0:1787440119.197784:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787440119.197794:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee050483100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1874266701181184:12345-0@lo:13: 00002000:00000024:2.0:1787440119.197839:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787440119.197886:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee050483100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1874266701181184:12345-0@lo:13: Request processed in 93us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440119.197894:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787440119.199659:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ee05fb62a00 x1874266701181184/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787440135 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787440119.199688:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee05fb62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1874266701181184:0@lo:13: 00000001:00080000:2.0:1787440119.283998:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:3.0:1787440119.901423:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787440120.924711:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787440121.948678:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787440122.974167:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787440123.806978:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee05fb60700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:168176ea-29d1-49de-a254-317e90d54802:3311:1874266701181312:0@lo:400: 00000100:00100000:1.0:1787440123.807060:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440123.807120:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787440123.807126:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee05fb62680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874266701181440:0@lo:400: 00000100:00100000:1.0:1787440123.807151:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440123.807188:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701181440 00000100:00100000:1.0:1787440123.807195:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701181440 00000100:00100000:1.0:1787440123.807238:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787440123.807247:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee0806b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874266701181440:12345-0@lo:400: 00000100:00100000:1.0:1787440123.807295:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee0806b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874266701181440:12345-0@lo:400: Request processed in 49us (143us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440123.807311:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1787440123.807349:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ee05fb62680 x1874266701181440/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787440139 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787440123.807362:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee05fb62680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874266701181440:0@lo:400: 00000100:00100000:0.0:1787440123.807435:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee05fb62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1874266701181568:0@lo:400: 00000100:00100000:0.0:1787440123.807468:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440123.807549:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787440123.807562:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee05fb63100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874266701181696:0@lo:400: 00000100:00100000:0.0:1787440123.807588:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440123.807619:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701181696 00000100:00100000:0.0:1787440123.807623:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701181696 00000100:00100000:0.0:1787440123.807658:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787440123.807665:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee050483800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1874266701181696:12345-0@lo:400: 00000100:00100000:0.0:1787440123.807701:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee050483800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1874266701181696:12345-0@lo:400: Request processed in 37us (111us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440123.807707:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1787440123.807724:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787440123.807742:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ee05fb63100 x1874266701181696/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787440139 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787440123.807751:0:3309:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1787440123.807761:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee05fb63100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874266701181696:0@lo:400: 00000100:00100000:3.0:1787440123.807990:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701181312 00000100:00100000:3.0:1787440123.808004:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701181312 00000100:00100000:3.0:1787440123.808061:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787440123.808070:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee047a43450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:168176ea-29d1-49de-a254-317e90d54802+16:3311:x1874266701181312:12345-0@lo:400: 00000100:00100000:3.0:1787440123.808107:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee047a43450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:168176ea-29d1-49de-a254-317e90d54802+16:3311:x1874266701181312:12345-0@lo:400: Request processed in 39us (1047us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440123.808113:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787440123.808173:0:6892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701181568 00000100:00100000:1.0:1787440123.808180:0:6892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701181568 00000100:00080000:3.0:1787440123.808222:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787440123.808232:0:6892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787440123.808241:0:6892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee050480e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1874266701181568:12345-0@lo:400: 00000100:00100000:1.0:1787440123.808294:0:6892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee050480e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1874266701181568:12345-0@lo:400: Request processed in 54us (825us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440123.808311:0:6892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787440123.808629:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee05fb60700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:168176ea-29d1-49de-a254-317e90d54802:3311:1874266701181312:0@lo:400: 00010000:00080000:3.0:1787440123.809002:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ee05fb62a00 x1874266701181568/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787440139 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787440123.809016:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee05fb62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1874266701181568:0@lo:400: 00010000:00010000:3.0:1787440123.997636:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787440124.318103:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee050481500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874266701181824:0@lo:13: 00000100:00100000:0.0:1787440124.318172:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440124.318262:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701181824 00000100:00100000:0.0:1787440124.318270:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701181824 00000100:00100000:0.0:1787440124.318312:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787440124.318321:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee050480000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874266701181824:12345-0@lo:13: 00002000:00000024:0.0:1787440124.318353:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787440124.318398:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee050480000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874266701181824:12345-0@lo:13: Request processed in 78us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440124.318405:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1787440124.318446:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ee050481500 x1874266701181824/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787440140 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787440124.318464:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee050481500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874266701181824:0@lo:13: 00010000:00010000:0.0:1787440125.025233:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787440126.045860:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787440127.072429:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787440128.012204:0:7623:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787440128.012215:0:7623:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:2.0:1787440128.012346:0:7623:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8ee06db91000 00000020:01000004:2.0:1787440128.012360:0:7623:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1787440128.012372:0:7623:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:2.0:1787440128.012384:0:7623:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8ee07c2c4d28) 00000020:00000080:2.0:1787440128.012399:0:7623:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1787440128.028334:0:7623:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1787440128.029135:0:7623:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1787440128.056227:0:7623:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1787440128.063020:0:7623:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1787440128.063056:0:7623:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1787440128.063110:0:7623:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1787440128.063133:0:7623:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1787440128.063606:0:7623:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1787440128.063619:0:7623:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787440128.063628:0:7623:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x85f5fa77adf3c157 00000020:01000004:2.0:1787440128.063636:0:7623:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1787440128.063727:0:7623:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.158@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1787440128.063731:0:7623:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.158@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1787440128.063737:0:7623:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1787440128.063891:0:7623:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1787440128.063896:0:7623:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.158@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00010000:00010000:0.0:1787440128.096573:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1787440128.107745:0:7623:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.158@tcp ctxt 0 is initialized 00000020:01000004:3.0:1787440128.108182:0:7623:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.206.158@tcp, index=0001, flags=0x20062 00000020:01000004:3.0:1787440128.108188:0:7623:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1787440128.108189:0:7623:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787440128.108190:0:7623:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787440128.108191:0:7623:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787440128.108199:0:7623:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787440128.108200:0:7623:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787440128.108201:0:7623:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787440128.108203:0:7623:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787440128.108204:0:7623:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787440128.108205:0:7623:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787440128.108206:0:7623:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787440128.108209:0:7623:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:3.0:1787440128.108211:0:7623:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787440128.108212:0:7623:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787440128.108213:0:7623:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787440128.108214:0:7623:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787440128.108215:0:7623:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787440128.108216:0:7623:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787440128.108217:0:7623:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787440128.108218:0:7623:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787440128.108219:0:7623:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787440128.108220:0:7623:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787440128.108221:0:7623:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787440128.108246:0:7623:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1787440128.108269:0:7623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee05fb62a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:168176ea-29d1-49de-a254-317e90d54802:7623:1874266701181952:0@lo:253: 00000100:00100000:3.0:1787440128.108355:0:7623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440128.108411:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701181952 00000100:00100000:3.0:1787440128.108415:0:7623:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee047ed23c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787440128.108420:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701181952 00000100:00100000:2.0:1787440128.108475:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787440128.108486:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04ca1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:168176ea-29d1-49de-a254-317e90d54802+16:7623:x1874266701181952:12345-0@lo:253: 20000000:01000000:2.0:1787440128.108539:0:5843:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1787440128.108544:0:5843:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:2.0:1787440128.108548:0:5843:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:2.0:1787440128.108559:0:5843:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:2.0:1787440128.110611:0:5843:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787440128.111163:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:2.0:1787440128.111178:0:5843:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:2.0:1787440128.111218:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:2.0:1787440128.111226:0:5843:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:2.0:1787440128.111255:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:2.0:1787440128.111320:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:2.0:1787440128.111829:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:2.0:1787440128.111850:0:5843:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.206.158@tcp 20000000:01000000:2.0:1787440128.111852:0:5843:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.158@tcp (null) (null) (null) 00000040:00080000:2.0:1787440128.111888:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:2.0:1787440128.111897:0:5843:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1787440128.111958:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:2.0:1787440128.111965:0:5843:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.206.158@tcp (null) (null) 00000040:00080000:2.0:1787440128.112012:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:2.0:1787440128.112020:0:5843:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1787440128.112052:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:2.0:1787440128.112111:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:2.0:1787440128.113319:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:2.0:1787440128.113343:0:5843:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.206.158@tcp 20000000:01000000:2.0:1787440128.113346:0:5843:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.158@tcp (null) (null) (null) 00000040:00080000:2.0:1787440128.113382:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:2.0:1787440128.113390:0:5843:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1787440128.113419:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:2.0:1787440128.113426:0:5843:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.206.158@tcp (null) (null) 00000040:00080000:2.0:1787440128.113454:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:2.0:1787440128.113463:0:5843:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1787440128.113626:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:2.0:1787440128.113681:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:2.0:1787440128.113698:0:5843:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:2.0:1787440128.113706:0:5843:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:2.0:1787440128.113712:0:5843:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:2.0:1787440128.113713:0:5843:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1787440128.113715:0:5843:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1787440128.113728:0:5843:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1787440128.113730:0:5843:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1787440128.113882:0:5843:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1787440128.113885:0:5843:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:3.0:1787440128.114830:0:7626:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:2.0:1787440128.115150:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:2.0:1787440128.115191:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:2.0:1787440128.115252:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:2.0:1787440128.115335:0:5843:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1787440128.115338:0:5843:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1787440128.116114:0:7627:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 14 1->4: lustre sys.timeout 20000000:01000000:0.0:1787440128.116173:0:7627:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 14 2->4: lustre sys.timeout 00000040:00080000:0.0:1787440128.116221:0:7627:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:2.0:1787440128.116819:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:2.0:1787440128.116866:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:2.0:1787440128.116901:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:2.0:1787440128.116915:0:5843:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1787440128.117594:0:5843:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1787440128.118402:0:7628:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 15 1->4: lustre sys.timeout 20000000:01000000:0.0:1787440128.118470:0:7628:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 15 2->4: lustre sys.timeout 00000040:00080000:2.0:1787440128.118868:0:7628:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:0.0:1787440128.119235:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:0.0:1787440128.119350:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:0.0:1787440128.119414:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:0.0:1787440128.119430:0:5843:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1787440128.119432:0:5843:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1787440128.120404:0:7629:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 16 1->4: lustre sys.timeout 20000000:01000000:2.0:1787440128.120480:0:7629:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 16 2->4: lustre sys.timeout 00000040:00080000:2.0:1787440128.120826:0:7629:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:0.0:1787440128.121163:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:0.0:1787440128.121212:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:0.0:1787440128.121337:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 10000000:01000000:0.0:1787440128.121358:0:5843:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1787440128.121376:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8ee040030800/0x85f5fa77adf3c15e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440128.121394:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ee059185000/0x85f5fa77adf3c0af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f5fa77adf3c0a8 expref: 16 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440128.121403:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ee082163000/0x85f5fa77adf3c0d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f5fa77adf3c0d2 expref: 16 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440128.121411:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ee059184600/0x85f5fa77adf3c103 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f5fa77adf3c0fc expref: 16 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440128.121418:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ee082163600/0x85f5fa77adf3c11f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f5fa77adf3c118 expref: 16 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440128.121437:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ee07f86f200/0x85f5fa77adf3c142 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f5fa77adf3c13b expref: 16 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440128.121445:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8ee040030800/0x85f5fa77adf3c15e lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440128.121481:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ee07f86f200/0x85f5fa77adf3c142 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x85f5fa77adf3c13b expref: 16 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440128.121617:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ee07f86f200/0x85f5fa77adf3c142 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x85f5fa77adf3c13b expref: 16 pid: 5843 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440128.121631:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee050481500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5843:1874266701182080:0@lo:104: 00000100:00100000:0.0:1787440128.121826:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787440128.121914:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ee082163600/0x85f5fa77adf3c11f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x85f5fa77adf3c118 expref: 16 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440128.121933:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ee082163600/0x85f5fa77adf3c11f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x85f5fa77adf3c118 expref: 16 pid: 5842 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440128.121941:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee050480a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5843:1874266701182208:0@lo:104: 00010000:00010000:0.0:1787440128.121966:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ee059184600/0x85f5fa77adf3c103 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x85f5fa77adf3c0fc expref: 16 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440128.121983:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ee059184600/0x85f5fa77adf3c103 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x85f5fa77adf3c0fc expref: 16 pid: 5842 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440128.121991:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee050483480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5843:1874266701182336:0@lo:104: 00010000:00010000:0.0:1787440128.122014:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ee082163000/0x85f5fa77adf3c0d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x85f5fa77adf3c0d2 expref: 16 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440128.122028:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ee082163000/0x85f5fa77adf3c0d9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x85f5fa77adf3c0d2 expref: 16 pid: 5842 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440128.122036:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee050481180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5843:1874266701182464:0@lo:104: 00010000:00010000:0.0:1787440128.122063:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ee059185000/0x85f5fa77adf3c0af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x85f5fa77adf3c0a8 expref: 16 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440128.122071:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ee059185000/0x85f5fa77adf3c0af lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x85f5fa77adf3c0a8 expref: 16 pid: 5843 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440128.122078:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee050482d80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5843:1874266701182592:0@lo:104: 00000100:00100000:0.0:1787440128.122096:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee0453e50c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787440128.122180:0:5832:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1787440128.122199:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440128.122256:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440128.122372:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440128.122395:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701182080 00000100:00100000:3.0:1787440128.122402:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701182080 00000100:00100000:3.0:1787440128.122435:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701182208 00000100:00100000:3.0:1787440128.122439:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701182208 00000100:00100000:3.0:1787440128.122450:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701182336 00000100:00100000:3.0:1787440128.122452:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701182336 00000100:00100000:3.0:1787440128.122465:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787440128.122473:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee0511c3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:168176ea-29d1-49de-a254-317e90d54802+5:5843:x1874266701182080:12345-0@lo:104: 00010000:00010000:3.0:1787440128.122486:0:5833:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.158@tcp lock: ffff8ee07f86ec00/0x85f5fa77adf3c13b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x85f5fa77adf3c142 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440128.122576:0:5833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787440128.122588:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee0511c3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:168176ea-29d1-49de-a254-317e90d54802+5:5843:x1874266701182080:12345-0@lo:104: Request processed in 116us (763us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440128.122595:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787440128.122637:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787440128.122643:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee0806b4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:168176ea-29d1-49de-a254-317e90d54802+4:5843:x1874266701182208:12345-0@lo:104: 00010000:00010000:3.0:1787440128.122651:0:5833:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.158@tcp lock: ffff8ee082163800/0x85f5fa77adf3c118 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x85f5fa77adf3c11f expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440128.122773:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee050481500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5843:1874266701182080:0@lo:104: 00010000:00010000:2.0:1787440128.122876:0:5837:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787440128.122883:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.158@tcp lock: ffff8ee07f86ec00/0x85f5fa77adf3c13b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x85f5fa77adf3c142 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440128.122891:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee07f86ec00 already unused, calling callback (ffffffffc1bd2c20) 10000000:00010000:2.0:1787440128.122895:0:5837:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.158@tcp lock: ffff8ee07f86ec00/0x85f5fa77adf3c13b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x85f5fa77adf3c142 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440128.122903:0:5837:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.158@tcp lock: ffff8ee07f86ec00/0x85f5fa77adf3c13b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x85f5fa77adf3c142 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787440128.122996:0:5837:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.158@tcp lock: ffff8ee07f86ec00/0x85f5fa77adf3c13b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x85f5fa77adf3c142 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787440128.123001:0:5837:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787440128.123037:0:5837:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.158@tcp lock: ffff8ee07f86ec00/0x85f5fa77adf3c13b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x85f5fa77adf3c142 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440128.123044:0:5837:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787440128.123063:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.158@tcp lock: ffff8ee07f86ec00/0x85f5fa77adf3c13b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x85f5fa77adf3c142 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440128.123069:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.158@tcp lock: ffff8ee07f86ec00/0x85f5fa77adf3c13b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x85f5fa77adf3c142 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440128.123083:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787440128.123085:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787440128.123086:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787440128.123098:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee049044000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:168176ea-29d1-49de-a254-317e90d54802:3312:1874266701182720:0@lo:103: 00000100:00100000:2.0:1787440128.123130:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440128.123171:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701182720 00000100:00100000:2.0:1787440128.123175:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701182720 00010000:00010000:2.0:1787440128.123194:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ee07f86f200/0x85f5fa77adf3c142 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x85f5fa77adf3c13b expref: 17 pid: 5843 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440128.123216:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787440128.123223:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee049044380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:168176ea-29d1-49de-a254-317e90d54802+17:3312:x1874266701182720:12345-0@lo:103: 00010000:00010000:2.0:1787440128.123232:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787440128.123238:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ee07f86f200/0x85f5fa77adf3c142 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x85f5fa77adf3c13b expref: 17 pid: 5843 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440128.123253:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ee07f86f200/0x85f5fa77adf3c142 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x85f5fa77adf3c13b expref: 17 pid: 5843 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440128.123387:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ee07f86f200/0x85f5fa77adf3c142 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x85f5fa77adf3c13b expref: 17 pid: 5843 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440128.123417:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787440128.123447:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee049044380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:168176ea-29d1-49de-a254-317e90d54802+16:3312:x1874266701182720:12345-0@lo:103: Request processed in 225us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440128.123454:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787440128.123485:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee049044000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:168176ea-29d1-49de-a254-317e90d54802:3312:1874266701182720:0@lo:103: 00010000:00010000:3.0:1787440128.123601:0:5833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787440128.123607:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee0806b4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:168176ea-29d1-49de-a254-317e90d54802+4:5843:x1874266701182208:12345-0@lo:104: Request processed in 965us (1408us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440128.123614:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787440128.123630:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787440128.123636:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee0806b7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:168176ea-29d1-49de-a254-317e90d54802+3:5843:x1874266701182336:12345-0@lo:104: 00010000:00010000:3.0:1787440128.123644:0:5833:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.158@tcp lock: ffff8ee082162200/0x85f5fa77adf3c0fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x85f5fa77adf3c103 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440128.123811:0:5833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787440128.123817:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee0806b7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:168176ea-29d1-49de-a254-317e90d54802+3:5843:x1874266701182336:12345-0@lo:104: Request processed in 181us (1561us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440128.123824:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:0.0:1787440128.127148:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787440128.127161:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.158@tcp lock: ffff8ee082163800/0x85f5fa77adf3c118 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x85f5fa77adf3c11f expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440128.127173:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee082163800 already unused, calling callback (ffffffffc1bd2c20) 10000000:00010000:0.0:1787440128.127178:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.158@tcp lock: ffff8ee082163800/0x85f5fa77adf3c118 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x85f5fa77adf3c11f expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440128.127188:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.158@tcp lock: ffff8ee082163800/0x85f5fa77adf3c118 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x85f5fa77adf3c11f expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787440128.127196:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.158@tcp lock: ffff8ee082163800/0x85f5fa77adf3c118 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x85f5fa77adf3c11f expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787440128.127202:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787440128.127362:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.158@tcp lock: ffff8ee082163800/0x85f5fa77adf3c118 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x85f5fa77adf3c11f expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440128.127369:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787440128.127397:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.158@tcp lock: ffff8ee082163800/0x85f5fa77adf3c118 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x85f5fa77adf3c11f expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440128.127404:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.158@tcp lock: ffff8ee082163800/0x85f5fa77adf3c118 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x85f5fa77adf3c11f expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440128.127421:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787440128.127425:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.158@tcp lock: ffff8ee082162200/0x85f5fa77adf3c0fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x85f5fa77adf3c103 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440128.127431:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee082162200 already unused, calling callback (ffffffffc1bd2c20) 10000000:00010000:0.0:1787440128.127434:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.158@tcp lock: ffff8ee082162200/0x85f5fa77adf3c0fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x85f5fa77adf3c103 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440128.127441:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.158@tcp lock: ffff8ee082162200/0x85f5fa77adf3c0fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x85f5fa77adf3c103 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787440128.127448:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.158@tcp lock: ffff8ee082162200/0x85f5fa77adf3c0fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x85f5fa77adf3c103 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787440128.127453:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787440128.127471:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.158@tcp lock: ffff8ee082162200/0x85f5fa77adf3c0fc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x85f5fa77adf3c103 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440128.127478:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787440128.127482:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.158@tcp lock: ffff8ee082162200/0x85f5fa77adf3c0fc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x85f5fa77adf3c103 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440128.127520:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.158@tcp lock: ffff8ee082162200/0x85f5fa77adf3c0fc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x85f5fa77adf3c103 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440128.127531:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787440128.127533:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787440128.127535:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787440128.127554:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee050482680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:168176ea-29d1-49de-a254-317e90d54802:3310:1874266701182976:0@lo:103: 00000100:00100000:0.0:1787440128.127616:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440128.127761:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee050481880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:168176ea-29d1-49de-a254-317e90d54802:3309:1874266701182848:0@lo:103: 00000100:00100000:3.0:1787440128.127790:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440128.127917:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701182976 00000100:00100000:0.0:1787440128.127924:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701182976 00010000:00010000:0.0:1787440128.127948:0:6711:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ee059184600/0x85f5fa77adf3c103 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x85f5fa77adf3c0fc expref: 16 pid: 5842 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440128.127986:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701182848 00000100:00100000:0.0:1787440128.127989:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701182848 00010000:00010000:0.0:1787440128.128001:0:6711:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ee082163600/0x85f5fa77adf3c11f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x85f5fa77adf3c118 expref: 17 pid: 5842 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440128.128018:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787440128.128026:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee050480700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:168176ea-29d1-49de-a254-317e90d54802+17:3310:x1874266701182976:12345-0@lo:103: 00010000:00010000:0.0:1787440128.128037:0:6711:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787440128.128042:0:6711:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ee059184600/0x85f5fa77adf3c103 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x85f5fa77adf3c0fc expref: 17 pid: 5842 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440128.128052:0:6711:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ee059184600/0x85f5fa77adf3c103 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x85f5fa77adf3c0fc expref: 17 pid: 5842 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440128.128067:0:6711:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787440128.128106:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee050480700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:168176ea-29d1-49de-a254-317e90d54802+17:3310:x1874266701182976:12345-0@lo:103: Request processed in 80us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440128.128113:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787440128.128131:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787440128.128137:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee05fb60e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:168176ea-29d1-49de-a254-317e90d54802+16:3309:x1874266701182848:12345-0@lo:103: 00010000:00010000:0.0:1787440128.128144:0:6711:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787440128.128148:0:6711:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ee082163600/0x85f5fa77adf3c11f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x85f5fa77adf3c118 expref: 16 pid: 5842 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440128.128157:0:6711:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ee082163600/0x85f5fa77adf3c11f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x85f5fa77adf3c118 expref: 16 pid: 5842 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440128.128166:0:6711:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787440128.128192:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee05fb60e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:168176ea-29d1-49de-a254-317e90d54802+16:3309:x1874266701182848:12345-0@lo:103: Request processed in 55us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440128.128198:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787440128.128228:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee050482680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:168176ea-29d1-49de-a254-317e90d54802:3310:1874266701182976:0@lo:103: 00000100:00100000:0.0:1787440128.128257:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee050481880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:168176ea-29d1-49de-a254-317e90d54802:3309:1874266701182848:0@lo:103: 00010000:00010000:2.0:1787440128.128404:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787440128.128425:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ee082163600/0x85f5fa77adf3c11f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x85f5fa77adf3c118 expref: 15 pid: 5842 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440128.128436:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee050480a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5843:1874266701182208:0@lo:104: 00010000:00010000:2.0:1787440128.128445:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ee059184600/0x85f5fa77adf3c103 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x85f5fa77adf3c0fc expref: 14 pid: 5842 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440128.128454:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee050483480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5843:1874266701182336:0@lo:104: 00000100:00100000:1.0:1787440128.128642:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440128.128652:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701182464 00000100:00100000:3.0:1787440128.128735:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701182592 00000100:00100000:3.0:1787440128.128739:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701182592 00000100:00100000:3.0:1787440128.128773:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787440128.128780:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee0806b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:168176ea-29d1-49de-a254-317e90d54802+3:5843:x1874266701182592:12345-0@lo:104: 00010000:00010000:3.0:1787440128.128802:0:5833:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.158@tcp lock: ffff8ee082162400/0x85f5fa77adf3c0a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x85f5fa77adf3c0af expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440128.128854:0:5833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787440128.128859:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee0806b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:168176ea-29d1-49de-a254-317e90d54802+3:5843:x1874266701182592:12345-0@lo:104: Request processed in 80us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440128.128865:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787440128.128984:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee050482d80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5843:1874266701182592:0@lo:104: 00010000:00010000:0.0:1787440128.129017:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787440128.129022:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.158@tcp lock: ffff8ee082162400/0x85f5fa77adf3c0a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x85f5fa77adf3c0af expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440128.129030:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee082162400 already unused, calling callback (ffffffffc1bd2c20) 10000000:00010000:0.0:1787440128.129033:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.158@tcp lock: ffff8ee082162400/0x85f5fa77adf3c0a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x85f5fa77adf3c0af expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440128.129041:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.158@tcp lock: ffff8ee082162400/0x85f5fa77adf3c0a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x85f5fa77adf3c0af expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787440128.129056:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.158@tcp lock: ffff8ee082162400/0x85f5fa77adf3c0a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x85f5fa77adf3c0af expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787440128.129062:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787440128.129091:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.158@tcp lock: ffff8ee082162400/0x85f5fa77adf3c0a8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x85f5fa77adf3c0af expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440128.129097:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787440128.129117:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.158@tcp lock: ffff8ee082162400/0x85f5fa77adf3c0a8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x85f5fa77adf3c0af expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440128.129124:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.158@tcp lock: ffff8ee082162400/0x85f5fa77adf3c0a8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x85f5fa77adf3c0af expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440128.129135:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787440128.129137:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787440128.129139:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787440128.129176:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee050481880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:168176ea-29d1-49de-a254-317e90d54802:3311:1874266701183104:0@lo:103: 00000100:00100000:2.0:1787440128.129203:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440128.129338:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701183104 00000100:00100000:0.0:1787440128.129343:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701183104 00010000:00010000:0.0:1787440128.129359:0:6711:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ee059185000/0x85f5fa77adf3c0af lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x85f5fa77adf3c0a8 expref: 14 pid: 5843 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440128.129385:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787440128.129392:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee049044000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:168176ea-29d1-49de-a254-317e90d54802+14:3311:x1874266701183104:12345-0@lo:103: 00010000:00010000:0.0:1787440128.129400:0:6711:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787440128.129405:0:6711:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ee059185000/0x85f5fa77adf3c0af lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x85f5fa77adf3c0a8 expref: 14 pid: 5843 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440128.129414:0:6711:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ee059185000/0x85f5fa77adf3c0af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x85f5fa77adf3c0a8 expref: 14 pid: 5843 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440128.129434:0:6711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ee059185000/0x85f5fa77adf3c0af lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x85f5fa77adf3c0a8 expref: 14 pid: 5843 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440128.129445:0:6711:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787440128.129472:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee049044000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:168176ea-29d1-49de-a254-317e90d54802+13:3311:x1874266701183104:12345-0@lo:103: Request processed in 81us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440128.129479:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787440128.129562:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee050481880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:168176ea-29d1-49de-a254-317e90d54802:3311:1874266701183104:0@lo:103: 00000100:00100000:1.0:1787440128.129611:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701182464 00000100:00100000:1.0:1787440128.129647:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787440128.129654:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee0806b4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:168176ea-29d1-49de-a254-317e90d54802+3:5843:x1874266701182464:12345-0@lo:104: 00010000:00010000:1.0:1787440128.129814:0:5832:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.158@tcp lock: ffff8ee059185600/0x85f5fa77adf3c0d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x85f5fa77adf3c0d9 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440128.129865:0:5832:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787440128.129871:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee0806b4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:168176ea-29d1-49de-a254-317e90d54802+3:5843:x1874266701182464:12345-0@lo:104: Request processed in 218us (7499us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440128.129886:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787440128.129953:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee050481180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5843:1874266701182464:0@lo:104: 00010000:00010000:2.0:1787440128.129989:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8ee040030800/0x85f5fa77adf3c15e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440128.130037:0:5837:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787440128.130042:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.158@tcp lock: ffff8ee059185600/0x85f5fa77adf3c0d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x85f5fa77adf3c0d9 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440128.130048:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee059185600 already unused, calling callback (ffffffffc1bd2c20) 10000000:00010000:0.0:1787440128.130051:0:5837:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.158@tcp lock: ffff8ee059185600/0x85f5fa77adf3c0d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x85f5fa77adf3c0d9 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440128.130059:0:5837:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.158@tcp lock: ffff8ee059185600/0x85f5fa77adf3c0d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x85f5fa77adf3c0d9 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787440128.130066:0:5837:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.158@tcp lock: ffff8ee059185600/0x85f5fa77adf3c0d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x85f5fa77adf3c0d9 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787440128.130071:0:5837:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787440128.130087:0:5837:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.158@tcp lock: ffff8ee059185600/0x85f5fa77adf3c0d2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x85f5fa77adf3c0d9 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440128.130094:0:5837:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787440128.130118:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.158@tcp lock: ffff8ee059185600/0x85f5fa77adf3c0d2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x85f5fa77adf3c0d9 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440128.130126:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.158@tcp lock: ffff8ee059185600/0x85f5fa77adf3c0d2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x85f5fa77adf3c0d9 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440128.130145:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787440128.130147:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787440128.130149:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787440128.130184:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee050482680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:168176ea-29d1-49de-a254-317e90d54802:3312:1874266701183232:0@lo:103: 00000100:00100000:2.0:1787440128.130213:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440128.130388:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701183232 00000100:00100000:0.0:1787440128.130394:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701183232 00010000:00010000:0.0:1787440128.130411:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ee082163000/0x85f5fa77adf3c0d9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x85f5fa77adf3c0d2 expref: 13 pid: 5842 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440128.130438:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787440128.130445:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee049046680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:168176ea-29d1-49de-a254-317e90d54802+13:3312:x1874266701183232:12345-0@lo:103: 00010000:00010000:0.0:1787440128.130453:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787440128.130458:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ee082163000/0x85f5fa77adf3c0d9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x85f5fa77adf3c0d2 expref: 13 pid: 5842 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440128.130467:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ee082163000/0x85f5fa77adf3c0d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x85f5fa77adf3c0d2 expref: 13 pid: 5842 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440128.130478:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ee082163000/0x85f5fa77adf3c0d9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x85f5fa77adf3c0d2 expref: 13 pid: 5842 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440128.130514:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8ee040030800/0x85f5fa77adf3c15e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440128.130523:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ee040030800/0x85f5fa77adf3c15e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440128.130537:0:5836:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ee040030800/0x85f5fa77adf3c15e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440128.130544:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ee040030800/0x85f5fa77adf3c15e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440128.130557:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8ee040030800/0x85f5fa77adf3c15e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440128.130563:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8ee040030800/0x85f5fa77adf3c15e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440128.130567:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee040030800 already unused, calling callback (ffffffffc15b52a0) 00010000:00010000:0.0:1787440128.130571:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8ee040030800/0x85f5fa77adf3c15e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440128.130578:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8ee040030800/0x85f5fa77adf3c15e lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440128.130593:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8ee040030800/0x85f5fa77adf3c15e lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440128.130601:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787440128.130629:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee049046680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:168176ea-29d1-49de-a254-317e90d54802+12:3312:x1874266701183232:12345-0@lo:103: Request processed in 185us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440128.130635:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787440128.130706:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee050482680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:168176ea-29d1-49de-a254-317e90d54802:3312:1874266701183232:0@lo:103: 00010000:00010000:3.0:1787440128.130856:0:5843:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8ee040030800/0x85f5fa77adf3c15e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440128.130864:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8ee040030800/0x85f5fa77adf3c15e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440128.130870:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ee040030800/0x85f5fa77adf3c15e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787440128.130883:0:5843:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1787440128.183052:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04ca1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:168176ea-29d1-49de-a254-317e90d54802+11:7623:x1874266701181952:12345-0@lo:253: Request processed in 74558us (74687us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440128.183068:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787440128.183183:0:7623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee05fb62a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:168176ea-29d1-49de-a254-317e90d54802:7623:1874266701181952:0@lo:253: 10000000:01000000:0.0:1787440128.183197:0:7623:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1787440128.183201:0:7623:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787440128.183203:0:7623:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787440128.183204:0:7623:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787440128.183205:0:7623:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:0.0:1787440128.183207:0:7623:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787440128.183208:0:7623:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787440128.183209:0:7623:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787440128.183211:0:7623:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1787440128.183212:0:7623:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787440128.183226:0:7623:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1787440128.183248:0:7623:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8ee06db91000 from lustre-OST0001 10000000:01000000:0.0:1787440128.183341:0:7623:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1787440128.183344:0:7623:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1787440128.183351:0:7623:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8ee04a7e3370 local copy 10000000:01000000:0.0:1787440128.183355:0:7623:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1787440128.183386:0:7623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.158@tcp lock: ffff8ee040031800/0x85f5fa77adf3c165 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440128.183397:0:7623:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.206.158@tcp lock: ffff8ee040031800/0x85f5fa77adf3c165 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440128.183406:0:7623:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.158@tcp lock: ffff8ee040031800/0x85f5fa77adf3c165 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440128.183422:0:7623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee050482680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:168176ea-29d1-49de-a254-317e90d54802:7623:1874266701183360:0@lo:101: 00000100:00100000:0.0:1787440128.183454:0:7623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440128.183539:0:7623:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee07c2edf00 going to sleep for 11 seconds 00000100:00100000:3.0:1787440128.183593:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701183360 00000100:00100000:3.0:1787440128.183598:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701183360 00000100:00100000:3.0:1787440128.183635:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787440128.183643:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04ca1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:168176ea-29d1-49de-a254-317e90d54802+11:7623:x1874266701183360:12345-0@lo:101: 00010000:00010000:3.0:1787440128.183653:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440128.183674:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ee041664e00/0x85f5fa77adf3c16c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x85f5fa77adf3c165 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440128.183695:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ee041664e00/0x85f5fa77adf3c16c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x85f5fa77adf3c165 expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440128.183712:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ee041664e00/0x85f5fa77adf3c16c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f5fa77adf3c165 expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440128.183721:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee041664e00, rc 0) 00000100:00100000:3.0:1787440128.183857:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04ca1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:168176ea-29d1-49de-a254-317e90d54802+12:7623:x1874266701183360:12345-0@lo:101: Request processed in 106us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440128.183863:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787440128.184069:0:7623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee050482680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:168176ea-29d1-49de-a254-317e90d54802:7623:1874266701183360:0@lo:101: 00010000:00010000:1.0:1787440128.184082:0:7623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.158@tcp lock: ffff8ee040031800/0x85f5fa77adf3c165 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x85f5fa77adf3c16c expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440128.184090:0:7623:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.158@tcp lock: ffff8ee040031800/0x85f5fa77adf3c165 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x85f5fa77adf3c16c expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440128.184176:0:7623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee0806b4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:168176ea-29d1-49de-a254-317e90d54802:7623:1874266701183488:0@lo:501: 00000100:00100000:1.0:1787440128.184203:0:7623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440128.184226:0:7623:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee06d88a0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787440128.184332:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701183488 00000100:00100000:3.0:1787440128.184336:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701183488 00000100:00100000:3.0:1787440128.184364:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787440128.184371:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04ca1dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:168176ea-29d1-49de-a254-317e90d54802+12:7623:x1874266701183488:12345-0@lo:501: 00000100:00100000:3.0:1787440128.184572:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04ca1dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:168176ea-29d1-49de-a254-317e90d54802+12:7623:x1874266701183488:12345-0@lo:501: Request processed in 200us (366us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787440128.184579:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787440128.184811:0:7623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee0806b4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:168176ea-29d1-49de-a254-317e90d54802:7623:1874266701183488:0@lo:501: 10000000:01000000:1.0:1787440128.184827:0:7623:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.158@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1787440128.184854:0:7623:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.158@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1787440128.184859:0:7623:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.158@tcp lock: ffff8ee040031800/0x85f5fa77adf3c165 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x85f5fa77adf3c16c expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440128.184867:0:7623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.158@tcp lock: ffff8ee040031800/0x85f5fa77adf3c165 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x85f5fa77adf3c16c expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440128.184874:0:7623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.158@tcp lock: ffff8ee040031800/0x85f5fa77adf3c165 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x85f5fa77adf3c16c expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440128.184895:0:7623:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1787440128.184916:0:7623:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8ee06db91000 10000000:01000000:1.0:1787440128.184920:0:7623:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1787440128.184926:0:7623:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1787440128.184935:0:7623:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787440128.184939:0:7623:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1787440128.184941:0:7623:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1787440128.184958:0:7623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.158@tcp lock: ffff8ee059185600/0x85f5fa77adf3c173 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440128.184965:0:7623:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.158@tcp lock: ffff8ee059185600/0x85f5fa77adf3c173 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440128.184982:0:7623:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.158@tcp lock: ffff8ee059185600/0x85f5fa77adf3c173 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440128.184994:0:7623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee0806b4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:168176ea-29d1-49de-a254-317e90d54802:7623:1874266701183616:0@lo:101: 00000100:00100000:1.0:1787440128.185021:0:7623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440128.185049:0:7623:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee06d88a780 going to sleep for 11 seconds 00010000:00010000:0.0:1787440128.185106:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787440128.185112:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.158@tcp lock: ffff8ee040031800/0x85f5fa77adf3c165 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x85f5fa77adf3c16c expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440128.185119:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee040031800 already unused, calling callback (ffffffffc1bd2c20) 10000000:00010000:0.0:1787440128.185123:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.158@tcp lock: ffff8ee040031800/0x85f5fa77adf3c165 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x85f5fa77adf3c16c expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440128.185130:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.158@tcp lock: ffff8ee040031800/0x85f5fa77adf3c165 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x85f5fa77adf3c16c expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787440128.185137:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.158@tcp lock: ffff8ee040031800/0x85f5fa77adf3c165 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x85f5fa77adf3c16c expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787440128.185152:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787440128.185169:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.158@tcp lock: ffff8ee040031800/0x85f5fa77adf3c165 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x85f5fa77adf3c16c expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440128.185174:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787440128.185198:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.158@tcp lock: ffff8ee040031800/0x85f5fa77adf3c165 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x85f5fa77adf3c16c expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440128.185205:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.158@tcp lock: ffff8ee040031800/0x85f5fa77adf3c165 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x85f5fa77adf3c16c expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440128.185218:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787440128.185219:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787440128.185221:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787440128.185229:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787440128.185239:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee050481180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:168176ea-29d1-49de-a254-317e90d54802:3310:1874266701183744:0@lo:103: 00000100:00100000:0.0:1787440128.185555:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440128.185595:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701183744 00000100:00100000:0.0:1787440128.185601:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701183744 00000100:00100000:0.0:1787440128.185637:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787440128.185644:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee050482d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:168176ea-29d1-49de-a254-317e90d54802+12:3310:x1874266701183744:12345-0@lo:103: 00010000:00010000:0.0:1787440128.185653:0:6711:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787440128.185732:0:6711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ee041664e00/0x85f5fa77adf3c16c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x85f5fa77adf3c165 expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440128.185807:0:6711:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787440128.185840:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee050482d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:168176ea-29d1-49de-a254-317e90d54802+11:3310:x1874266701183744:12345-0@lo:103: Request processed in 197us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440128.185858:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787440128.185887:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee050481180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:168176ea-29d1-49de-a254-317e90d54802:3310:1874266701183744:0@lo:103: 00000100:00100000:3.0:1787440128.185948:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701183616 00000100:00100000:3.0:1787440128.185952:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701183616 00000100:00100000:3.0:1787440128.185992:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787440128.186000:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04ca1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:168176ea-29d1-49de-a254-317e90d54802+11:7623:x1874266701183616:12345-0@lo:101: 00010000:00010000:3.0:1787440128.186008:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440128.186020:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ee041664a00/0x85f5fa77adf3c17a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x85f5fa77adf3c173 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440128.186036:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ee041664a00/0x85f5fa77adf3c17a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x85f5fa77adf3c173 expref: 12 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440128.186045:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ee041664a00/0x85f5fa77adf3c17a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f5fa77adf3c173 expref: 12 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440128.186062:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee041664a00, rc 0) 00000100:00100000:3.0:1787440128.186089:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04ca1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:168176ea-29d1-49de-a254-317e90d54802+12:7623:x1874266701183616:12345-0@lo:101: Request processed in 92us (1068us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440128.186095:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787440128.186211:0:7623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee0806b4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:168176ea-29d1-49de-a254-317e90d54802:7623:1874266701183616:0@lo:101: 00010000:00010000:1.0:1787440128.186222:0:7623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.158@tcp lock: ffff8ee059185600/0x85f5fa77adf3c173 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3c17a expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440128.186231:0:7623:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.158@tcp lock: ffff8ee059185600/0x85f5fa77adf3c173 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x85f5fa77adf3c17a expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440128.186377:0:7623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee0806b4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:168176ea-29d1-49de-a254-317e90d54802:7623:1874266701183872:0@lo:501: 00000100:00100000:1.0:1787440128.186414:0:7623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440128.186435:0:7623:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee06d88a780 going to sleep for 11 seconds 00000100:00100000:0.0:1787440128.186479:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701183872 00000100:00100000:0.0:1787440128.186483:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701183872 00000100:00100000:0.0:1787440128.186539:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787440128.186547:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04ca1c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:168176ea-29d1-49de-a254-317e90d54802+12:7623:x1874266701183872:12345-0@lo:501: 00000100:00100000:1.0:1787440128.187126:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04ca1c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:168176ea-29d1-49de-a254-317e90d54802+12:7623:x1874266701183872:12345-0@lo:501: Request processed in 580us (710us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440128.187134:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787440128.187189:0:7623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee0806b4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:168176ea-29d1-49de-a254-317e90d54802:7623:1874266701183872:0@lo:501: 00000100:00100000:2.0:1787440128.187221:0:7623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee049046a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:168176ea-29d1-49de-a254-317e90d54802:7623:1874266701184000:0@lo:503: 00000100:00100000:2.0:1787440128.187327:0:7623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440128.187385:0:7623:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee049041300 going to sleep for 11 seconds 00000100:00100000:0.0:1787440128.187424:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701184000 00000100:00100000:0.0:1787440128.187428:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701184000 00000100:00100000:0.0:1787440128.187522:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787440128.187530:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04ca1e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:168176ea-29d1-49de-a254-317e90d54802+12:7623:x1874266701184000:12345-0@lo:503: 00000100:00100000:0.0:1787440128.187681:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04ca1e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:168176ea-29d1-49de-a254-317e90d54802+12:7623:x1874266701184000:12345-0@lo:503: Request processed in 152us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440128.187688:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787440128.187877:0:7623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee049046a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:168176ea-29d1-49de-a254-317e90d54802:7623:1874266701184000:0@lo:503: 00000040:00080000:2.0:1787440128.188147:0:7623:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787440128.188197:0:7623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee049046a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:168176ea-29d1-49de-a254-317e90d54802:7623:1874266701184128:0@lo:502: 00000100:00100000:2.0:1787440128.188230:0:7623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440128.188442:0:7623:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee049041300 going to sleep for 11 seconds 00000100:00100000:3.0:1787440128.188534:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701184128 00000100:00100000:3.0:1787440128.188539:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701184128 00000100:00100000:3.0:1787440128.188563:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787440128.188570:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04ca1f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:168176ea-29d1-49de-a254-317e90d54802+12:7623:x1874266701184128:12345-0@lo:502: 00000100:00100000:3.0:1787440128.188823:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04ca1f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:168176ea-29d1-49de-a254-317e90d54802+12:7623:x1874266701184128:12345-0@lo:502: Request processed in 252us (591us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440128.188830:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787440128.189030:0:7623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee049046a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:168176ea-29d1-49de-a254-317e90d54802:7623:1874266701184128:0@lo:502: 00000040:00080000:3.0:1787440128.189420:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1787440128.189470:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1787440128.189540:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1787440128.189592:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1787440128.189631:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1787440128.189838:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1787440128.189872:0:7623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee05fb61500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:168176ea-29d1-49de-a254-317e90d54802:7623:1874266701184256:0@lo:502: 00000100:00100000:3.0:1787440128.189918:0:7623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440128.190143:0:7623:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee047ed2cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787440128.190207:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701184256 00000100:00100000:1.0:1787440128.190219:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701184256 00000100:00100000:1.0:1787440128.190357:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787440128.190366:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04ca1d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:168176ea-29d1-49de-a254-317e90d54802+12:7623:x1874266701184256:12345-0@lo:502: 00000100:00100000:1.0:1787440128.190558:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04ca1d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:168176ea-29d1-49de-a254-317e90d54802+12:7623:x1874266701184256:12345-0@lo:502: Request processed in 194us (640us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440128.190566:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787440128.190645:0:7623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee05fb61500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:168176ea-29d1-49de-a254-317e90d54802:7623:1874266701184256:0@lo:502: 00000040:00080000:2.0:1787440128.190763:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1787440128.190774:0:7623:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:2.0:1787440128.191283:0:7631:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787440128.191292:0:7631:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:2.0:1787440128.191299:0:7631:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787440128.191301:0:7631:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1787440128.191306:0:7631:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787440128.191326:0:7631:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8ee07745cd28) 00000020:00000080:2.0:1787440128.191346:0:7631:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:2.0:1787440128.191353:0:7631:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1787440128.191411:0:7631:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8ee06db91000 from lustre-OST0001, refs=2 00080000:01000000:2.0:1787440128.191417:0:7631:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:2.0:1787440128.191424:0:7631:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x85f5fa77adf3c188 00010000:00010000:3.0:1787440128.196089:0:7631:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:3.0:1787440128.196443:0:7631:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:3.0:1787440128.200526:0:7631:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1787440128.200910:0:7631:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:2.0:1787440128.204920:0:7631:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:2.0:1787440128.205871:0:7631:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:2.0:1787440128.210590:0:7631:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1787440128.210601:0:7631:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787440128.210607:0:7631:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787440128.210610:0:7631:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1787440128.210613:0:7631:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787440128.210617:0:7631:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787440128.210619:0:7631:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787440128.210621:0:7631:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787440128.210623:0:7631:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1787440128.210733:0:7631:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787440128.210737:0:7631:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787440128.210738:0:7631:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:2.0:1787440128.210742:0:7631:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:0.0:1787440128.210917:0:7623:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:0.0:1787440128.210943:0:7623:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.158@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1787440128.211073:0:7623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.158@tcp lock: ffff8ee059185600/0x85f5fa77adf3c173 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3c17a expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440128.211084:0:7623:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.158@tcp lock: ffff8ee059185600/0x85f5fa77adf3c173 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3c17a expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787440128.211092:0:7623:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8ee06db91000 from 1 10000000:01000000:0.0:1787440128.211095:0:7623:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787440128.211125:0:7623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.158@tcp lock: ffff8ee040031800/0x85f5fa77adf3c18f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440128.211132:0:7623:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.158@tcp lock: ffff8ee040031800/0x85f5fa77adf3c18f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440128.211150:0:7623:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.158@tcp lock: ffff8ee040031800/0x85f5fa77adf3c18f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440128.211171:0:7623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee050481180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:168176ea-29d1-49de-a254-317e90d54802:7623:1874266701184384:0@lo:101: 00000100:00100000:0.0:1787440128.211229:0:7623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440128.211271:0:7623:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee07c2ed6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787440128.212953:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701184384 00000100:00100000:2.0:1787440128.212963:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701184384 00000100:00100000:2.0:1787440128.213096:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787440128.213107:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04ca1e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:168176ea-29d1-49de-a254-317e90d54802+12:7623:x1874266701184384:12345-0@lo:101: 00010000:00010000:2.0:1787440128.213123:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440128.213138:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ee07f86f200/0x85f5fa77adf3c196 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x85f5fa77adf3c18f expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440128.213162:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ee07f86f200/0x85f5fa77adf3c196 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x85f5fa77adf3c18f expref: 13 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440128.213172:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ee07f86f200/0x85f5fa77adf3c196 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f5fa77adf3c18f expref: 13 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440128.213191:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee07f86f200, rc 0) 00000100:00100000:2.0:1787440128.213258:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04ca1e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:168176ea-29d1-49de-a254-317e90d54802+13:7623:x1874266701184384:12345-0@lo:101: Request processed in 153us (2028us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440128.213264:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787440128.213328:0:7623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee050481180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:168176ea-29d1-49de-a254-317e90d54802:7623:1874266701184384:0@lo:101: 00010000:00010000:2.0:1787440128.213343:0:7623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.158@tcp lock: ffff8ee040031800/0x85f5fa77adf3c18f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3c196 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440128.213351:0:7623:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.158@tcp lock: ffff8ee040031800/0x85f5fa77adf3c18f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x85f5fa77adf3c196 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440128.213445:0:7623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee049046a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:168176ea-29d1-49de-a254-317e90d54802:7623:1874266701184512:0@lo:501: 00000100:00100000:2.0:1787440128.213474:0:7623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440128.213583:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701184512 00000100:00100000:0.0:1787440128.213587:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701184512 00000100:00100000:0.0:1787440128.213612:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787440128.213618:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04ca1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:168176ea-29d1-49de-a254-317e90d54802+13:7623:x1874266701184512:12345-0@lo:501: 00000100:00100000:0.0:1787440128.213831:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04ca1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:168176ea-29d1-49de-a254-317e90d54802+13:7623:x1874266701184512:12345-0@lo:501: Request processed in 212us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440128.213838:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1787440128.214594:0:7623:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee049041540 going to sleep for 11 seconds 00000100:00100000:2.0:1787440128.214610:0:7623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee049046a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:168176ea-29d1-49de-a254-317e90d54802:7623:1874266701184512:0@lo:501: 00000100:00100000:2.0:1787440128.214641:0:7623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee049046a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:168176ea-29d1-49de-a254-317e90d54802:7623:1874266701184640:0@lo:503: 00000100:00100000:2.0:1787440128.214745:0:7623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440128.214760:0:7623:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee049041540 going to sleep for 11 seconds 00000100:00100000:2.0:1787440128.214782:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701184640 00000100:00100000:2.0:1787440128.214786:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701184640 00000100:00100000:2.0:1787440128.214816:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787440128.214823:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04ca1f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:168176ea-29d1-49de-a254-317e90d54802+13:7623:x1874266701184640:12345-0@lo:503: 00000100:00100000:2.0:1787440128.215215:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04ca1f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:168176ea-29d1-49de-a254-317e90d54802+13:7623:x1874266701184640:12345-0@lo:503: Request processed in 392us (470us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440128.215223:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787440128.215330:0:7623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee049046a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:168176ea-29d1-49de-a254-317e90d54802:7623:1874266701184640:0@lo:503: 00000040:00080000:2.0:1787440128.216874:0:7623:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787440128.216947:0:7623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee049046a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:168176ea-29d1-49de-a254-317e90d54802:7623:1874266701184768:0@lo:502: 00000100:00100000:2.0:1787440128.217732:0:7623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440128.217852:0:7623:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee049041540 going to sleep for 11 seconds 00000100:00100000:3.0:1787440128.220591:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701184768 00000100:00100000:3.0:1787440128.220607:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701184768 00000100:00100000:3.0:1787440128.220732:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1787440128.220749:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04ca1f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:168176ea-29d1-49de-a254-317e90d54802+13:7623:x1874266701184768:12345-0@lo:502: 00000100:00100000:3.0:1787440128.221144:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04ca1f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:168176ea-29d1-49de-a254-317e90d54802+13:7623:x1874266701184768:12345-0@lo:502: Request processed in 396us (3414us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440128.221152:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1787440128.222097:0:7623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee049046a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:168176ea-29d1-49de-a254-317e90d54802:7623:1874266701184768:0@lo:502: 00000040:00080000:2.0:1787440128.222402:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1787440128.222459:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1787440128.222629:0:7623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee049046a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:168176ea-29d1-49de-a254-317e90d54802:7623:1874266701184896:0@lo:502: 00000100:00100000:2.0:1787440128.222752:0:7623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440128.222824:0:7623:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee049041540 going to sleep for 11 seconds 00000100:00100000:3.0:1787440128.222860:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701184896 00000100:00100000:3.0:1787440128.222866:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701184896 00000100:00100000:3.0:1787440128.222933:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1787440128.222942:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04ca1d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:168176ea-29d1-49de-a254-317e90d54802+13:7623:x1874266701184896:12345-0@lo:502: 00000100:00100000:3.0:1787440128.223183:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04ca1d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:168176ea-29d1-49de-a254-317e90d54802+13:7623:x1874266701184896:12345-0@lo:502: Request processed in 241us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440128.223190:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1787440128.223262:0:7623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee049046a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:168176ea-29d1-49de-a254-317e90d54802:7623:1874266701184896:0@lo:502: 00000040:00080000:0.0:1787440128.223362:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1787440128.223373:0:7623:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1787440128.223990:0:7635:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787440128.224000:0:7635:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787440128.224002:0:7635:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1787440128.224014:0:7635:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8ee06db91000 00000020:00000080:0.0:1787440128.224017:0:7635:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787440128.224037:0:7635:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787440128.224040:0:7635:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787440128.224042:0:7635:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1787440128.224045:0:7635:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1787440128.224219:0:7623:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1787440128.224239:0:7623:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.158@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787440128.224260:0:7623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.158@tcp lock: ffff8ee040031800/0x85f5fa77adf3c18f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3c196 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440128.224272:0:7623:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.158@tcp lock: ffff8ee040031800/0x85f5fa77adf3c18f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3c196 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787440128.224311:0:7623:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787440128.224314:0:7623:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8ee06db91000 10000000:01000000:2.0:1787440128.224317:0:7623:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8ee06db91000 10000000:01000000:2.0:1787440128.224321:0:7623:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787440128.224326:0:7623:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8ee06db91000 from 1 10000000:01000000:2.0:1787440128.224328:0:7623:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787440128.224357:0:7623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.158@tcp lock: ffff8ee07f86ec00/0x85f5fa77adf3c19d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440128.224365:0:7623:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.158@tcp lock: ffff8ee07f86ec00/0x85f5fa77adf3c19d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440128.224385:0:7623:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.158@tcp lock: ffff8ee07f86ec00/0x85f5fa77adf3c19d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440128.224403:0:7623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee049045f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:168176ea-29d1-49de-a254-317e90d54802:7623:1874266701185024:0@lo:101: 00000100:00100000:2.0:1787440128.224449:0:7623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440128.224479:0:7623:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee049041540 going to sleep for 11 seconds 00000100:00100000:0.0:1787440128.224562:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701185024 00000100:00100000:0.0:1787440128.224567:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701185024 00000100:00100000:0.0:1787440128.224606:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1787440128.224620:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04ca1d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:168176ea-29d1-49de-a254-317e90d54802+13:7623:x1874266701185024:12345-0@lo:101: 00010000:00010000:0.0:1787440128.224631:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440128.224643:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ee040031200/0x85f5fa77adf3c1a4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x85f5fa77adf3c19d expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440128.224757:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ee040031200/0x85f5fa77adf3c1a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x85f5fa77adf3c19d expref: 14 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440128.224770:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ee040031200/0x85f5fa77adf3c1a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f5fa77adf3c19d expref: 14 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440128.224779:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee040031200, rc 0) 00000100:00100000:0.0:1787440128.224823:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04ca1d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:168176ea-29d1-49de-a254-317e90d54802+14:7623:x1874266701185024:12345-0@lo:101: Request processed in 204us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440128.224829:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1787440128.224896:0:7623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee049045f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:168176ea-29d1-49de-a254-317e90d54802:7623:1874266701185024:0@lo:101: 00010000:00010000:2.0:1787440128.224908:0:7623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.158@tcp lock: ffff8ee07f86ec00/0x85f5fa77adf3c19d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3c1a4 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440128.224916:0:7623:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.158@tcp lock: ffff8ee07f86ec00/0x85f5fa77adf3c19d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x85f5fa77adf3c1a4 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440128.225004:0:7623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee049045f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:168176ea-29d1-49de-a254-317e90d54802:7623:1874266701185152:0@lo:501: 00000100:00100000:2.0:1787440128.225028:0:7623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440128.225051:0:7623:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee049041540 going to sleep for 11 seconds 00000100:00100000:0.0:1787440128.225138:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701185152 00000100:00100000:0.0:1787440128.225142:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701185152 00000100:00100000:0.0:1787440128.225171:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1787440128.225177:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04ca1c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:168176ea-29d1-49de-a254-317e90d54802+14:7623:x1874266701185152:12345-0@lo:501: 00000100:00100000:0.0:1787440128.225364:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04ca1c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:168176ea-29d1-49de-a254-317e90d54802+14:7623:x1874266701185152:12345-0@lo:501: Request processed in 186us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440128.225371:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1787440128.225431:0:7623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee049045f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:168176ea-29d1-49de-a254-317e90d54802:7623:1874266701185152:0@lo:501: 00000100:00100000:2.0:1787440128.225456:0:7623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee049045f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:168176ea-29d1-49de-a254-317e90d54802:7623:1874266701185280:0@lo:503: 00000100:00100000:2.0:1787440128.225519:0:7623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440128.225534:0:7623:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee049041540 going to sleep for 11 seconds 00000100:00100000:0.0:1787440128.225581:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701185280 00000100:00100000:0.0:1787440128.225586:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701185280 00000100:00100000:0.0:1787440128.225614:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1787440128.225620:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04ca1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:168176ea-29d1-49de-a254-317e90d54802+14:7623:x1874266701185280:12345-0@lo:503: 00000100:00100000:0.0:1787440128.225762:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04ca1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:168176ea-29d1-49de-a254-317e90d54802+14:7623:x1874266701185280:12345-0@lo:503: Request processed in 141us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440128.225778:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1787440128.225955:0:7623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee049045f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:168176ea-29d1-49de-a254-317e90d54802:7623:1874266701185280:0@lo:503: 00000040:00080000:2.0:1787440128.226259:0:7623:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787440128.226311:0:7623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee049045f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:168176ea-29d1-49de-a254-317e90d54802:7623:1874266701185408:0@lo:502: 00000100:00100000:2.0:1787440128.226346:0:7623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440128.226370:0:7623:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee049041540 going to sleep for 11 seconds 00000100:00100000:0.0:1787440128.226420:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701185408 00000100:00100000:0.0:1787440128.226425:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701185408 00000100:00100000:0.0:1787440128.226452:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1787440128.226459:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04a69a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:168176ea-29d1-49de-a254-317e90d54802+14:7623:x1874266701185408:12345-0@lo:502: 00000100:00100000:0.0:1787440128.226781:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04a69a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:168176ea-29d1-49de-a254-317e90d54802+14:7623:x1874266701185408:12345-0@lo:502: Request processed in 322us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440128.226787:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1787440128.226946:0:7623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee049045f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:168176ea-29d1-49de-a254-317e90d54802:7623:1874266701185408:0@lo:502: 00000040:00080000:2.0:1787440128.227253:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1787440128.227295:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1787440128.227323:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1787440128.227359:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1787440128.227388:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1787440128.227440:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1787440128.227470:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1787440128.227764:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1787440128.227813:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1787440128.227844:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1787440128.227877:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1787440128.227935:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1787440128.228320:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1787440128.228360:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1787440128.228409:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1787440128.228441:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1787440128.228469:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1787440128.228759:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1787440128.228795:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1787440128.228827:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1787440128.229061:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1787440128.229120:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1787440128.229154:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1787440128.229200:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1787440128.229236:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:2.0:1787440128.229268:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:2.0:1787440128.229313:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:2.0:1787440128.229347:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:2.0:1787440128.229381:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:2.0:1787440128.229441:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:2.0:1787440128.229732:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:2.0:1787440128.229782:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:2.0:1787440128.229815:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:2.0:1787440128.229908:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:2.0:1787440128.229940:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:2.0:1787440128.230057:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:2.0:1787440128.230092:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:2.0:1787440128.230133:0:7623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee049045f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:168176ea-29d1-49de-a254-317e90d54802:7623:1874266701185536:0@lo:502: 00000100:00100000:2.0:1787440128.230198:0:7623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440128.230283:0:7623:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee049041540 going to sleep for 11 seconds 00000100:00100000:0.0:1787440128.230323:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701185536 00000100:00100000:0.0:1787440128.230328:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701185536 00000100:00100000:0.0:1787440128.230396:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1787440128.230404:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04a69b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:168176ea-29d1-49de-a254-317e90d54802+14:7623:x1874266701185536:12345-0@lo:502: 00000100:00100000:0.0:1787440128.230640:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04a69b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:168176ea-29d1-49de-a254-317e90d54802+14:7623:x1874266701185536:12345-0@lo:502: Request processed in 236us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440128.230647:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1787440128.230769:0:7623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee049045f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:168176ea-29d1-49de-a254-317e90d54802:7623:1874266701185536:0@lo:502: 00000040:00080000:3.0:1787440128.230854:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:3.0:1787440128.230864:0:7623:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:3.0:1787440128.231523:0:7636:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1787440128.231537:0:7636:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8ee045f78000) 00000020:00000080:3.0:1787440128.231556:0:7636:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:3.0:1787440128.231625:0:7636:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8ee06db91000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1787440128.231629:0:7636:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8ee06db91000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1787440128.231631:0:7636:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8ee06db91000 3 00010000:00080000:3.0:1787440128.231668:0:7636:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8edf411a0800@lustre-MDT0000-lwp-OST0001: add connection 192.168.206.158@tcp at head 00010000:00010000:3.0:1787440128.234097:0:7636:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:3.0:1787440128.234376:0:7636:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1787440128.234412:0:7636:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787440128.234424:0:7636:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x85f5fa77adf3c1b2 00000100:00080000:3.0:1787440128.234434:0:7636:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787440128.234439:0:7636:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8edf411a0800 using connection 192.168.206.158@tcp/0@lo 00000100:00100000:3.0:1787440128.234471:0:7636:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ee05fb63b80 x1874266701185664/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787440128.234604:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee05fb63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3308:1874266701185664:0@lo:38: 00000100:00100000:3.0:1787440128.234746:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440128.234805:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701185664 00000100:00100000:3.0:1787440128.234811:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701185664 00000100:00100000:3.0:1787440128.234840:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787440128.234846:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee05fb61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3308:x1874266701185664:12345-0@lo:38: 00010000:00080000:3.0:1787440128.234868:0:5849:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 226 last 0 00000020:00000080:3.0:1787440128.234903:0:5849:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x85f5fa77adf3c1b9 00000004:00100000:3.0:1787440128.234918:0:5849:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787440128.234946:0:5849:0:(import.c:65:import_set_state_nolock()) ffff8edf411a6800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787440128.235189:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee05fb61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1874266701185664:12345-0@lo:38: Request processed in 336us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440128.235196:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:3.0:1787440128.235288:0:7636:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000040:00080000:3.0:1787440128.235604:0:7636:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000100:00080000:3.0:1787440128.235745:0:7637:0:(client.c:1845:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@ffff8ee05fb62300 x1874266701185792/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787440128.235755:0:7637:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee04c935300 going to sleep for 0 seconds 00000100:00100000:0.0:1787440128.236021:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee050483480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874266701185920:0@lo:400: 00000100:00100000:0.0:1787440128.236060:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440128.236590:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee050480a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1874266701186048:0@lo:400: 00000100:00100000:0.0:1787440128.236621:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440128.236644:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787440128.236649:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee050481500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874266701186176:0@lo:400: 00000100:00100000:0.0:1787440128.236689:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:0.0:1787440128.236717:0:7623:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:0.0:1787440128.236745:0:7623:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.158@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787440128.236759:0:7623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.158@tcp lock: ffff8ee07f86ec00/0x85f5fa77adf3c19d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3c1a4 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440128.236781:0:7623:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.158@tcp lock: ffff8ee07f86ec00/0x85f5fa77adf3c19d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3c1a4 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787440128.236821:0:7623:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1787440128.236823:0:7623:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787440128.236824:0:7623:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787440128.236825:0:7623:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787440128.236827:0:7623:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787440128.236828:0:7623:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787440128.236829:0:7623:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787440128.236830:0:7623:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787440128.236832:0:7623:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787440128.236845:0:7623:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787440128.236847:0:7623:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787440128.236850:0:7623:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:0.0:1787440128.236853:0:7623:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787440128.236854:0:7623:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787440128.236855:0:7623:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787440128.236856:0:7623:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787440128.236857:0:7623:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787440128.236858:0:7623:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787440128.236859:0:7623:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787440128.236860:0:7623:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787440128.236860:0:7623:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787440128.236861:0:7623:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787440128.236862:0:7623:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787440128.236879:0:7623:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1787440128.236889:0:7623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee050482680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:168176ea-29d1-49de-a254-317e90d54802:7623:1874266701186304:0@lo:253: 00000100:00100000:0.0:1787440128.236933:0:7623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440128.236956:0:7623:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee0512c3180 going to sleep for 11 seconds 00000100:00100000:3.0:1787440128.237765:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701186304 00000100:00100000:3.0:1787440128.237772:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701186304 00000100:00100000:3.0:1787440128.237820:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1787440128.237829:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04a699850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:168176ea-29d1-49de-a254-317e90d54802+14:7623:x1874266701186304:12345-0@lo:253: 20000000:01000000:3.0:1787440128.237854:0:5842:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1787440128.237866:0:5842:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1787440128.238596:0:6892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701185920 00000100:00100000:0.0:1787440128.238603:0:6892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701185920 00000100:00100000:0.0:1787440128.238638:0:6892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701186048 00000100:00100000:0.0:1787440128.238641:0:6892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701186048 00000100:00100000:0.0:1787440128.238681:0:6892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787440128.238696:0:6892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee050481880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874266701185920:12345-0@lo:400: 00000100:00100000:0.0:1787440128.238766:0:6892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee050481880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874266701185920:12345-0@lo:400: Request processed in 72us (2705us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440128.238773:0:6892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787440128.238790:0:6892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787440128.238796:0:6892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee050481f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874266701186048:12345-0@lo:400: 00000100:00100000:0.0:1787440128.238829:0:6892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee050481f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874266701186048:12345-0@lo:400: Request processed in 34us (2207us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440128.238835:0:6892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:0.0:1787440128.238873:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ee050483480 x1874266701185920/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787440144 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787440128.238887:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee050483480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874266701185920:0@lo:400: 00010000:00080000:0.0:1787440128.238927:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ee050480a80 x1874266701186048/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787440144 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787440128.238936:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee050480a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1874266701186048:0@lo:400: 00000100:00080000:3.0:1787440128.239524:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1787440128.240909:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ee05fb63b80 x1874266701185664/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787440138 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787440128.240921:0:3308:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787440128.240929:0:3308:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:2.0:1787440128.240936:0:3308:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1787440128.240941:0:3308:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1787440128.240945:0:3308:0:(import.c:65:import_set_state_nolock()) ffff8edf411a0800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00080000:2.0:1787440128.240951:0:3308:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000009f2c4ee8): req@ffff8ee05fb62300 x1874266701185792/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787440128.240985:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee05fb63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3308:1874266701185664:0@lo:38: 00000100:00100000:2.0:1787440128.241025:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701186176 00000100:00100000:2.0:1787440128.241031:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701186176 00000100:00100000:2.0:1787440128.241075:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787440128.241084:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee050481180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1874266701186176:12345-0@lo:400: 00000100:00100000:2.0:1787440128.241169:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee050481180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1874266701186176:12345-0@lo:400: Request processed in 86us (4478us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440128.241177:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787440128.241726:0:7637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440128.243868:0:7637:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee04c935300 going to sleep for 11 seconds 00010000:00080000:1.0:1787440128.246765:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ee050481500 x1874266701186176/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787440144 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787440128.246784:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee050481500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874266701186176:0@lo:400: 00000100:00080000:1.0:1787440128.246824:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787440128.251474:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701185792 00000100:00100000:3.0:1787440128.251537:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701185792 00000100:00100000:3.0:1787440128.251594:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787440128.251604:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee0806b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7637:x1874266701185792:12345-0@lo:901: 00000100:00100000:3.0:1787440128.252035:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee0806b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7637:x1874266701185792:12345-0@lo:901: Request processed in 431us (10309us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440128.252043:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1787440128.252080:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787440128.252124:0:7637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ee05fb62300 x1874266701185792/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1787440144 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787440128.252139:0:7637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee05fb62300 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7637:1874266701185792:0@lo:901: 20000000:01000000:3.0:1787440128.277966:0:5842:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1787440128.278035:0:5842:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1787440128.278811:0:5865:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787440128.278818:0:5865:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1787440128.280060:0:5865:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8ee059185000/0x85f5fa77adf3c1c0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440128.280080:0:5865:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ee082162a00/0x85f5fa77adf3c111 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f5fa77adf3c10a expref: 14 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440128.280089:0:5865:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8ee059185000/0x85f5fa77adf3c1c0 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440128.280125:0:5865:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ee082162a00/0x85f5fa77adf3c111 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x85f5fa77adf3c10a expref: 14 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440128.280138:0:5865:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ee082162a00/0x85f5fa77adf3c111 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x85f5fa77adf3c10a expref: 14 pid: 5842 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440128.280151:0:5865:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee0806b6300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5865:1874266701186432:0@lo:104: 00000100:00100000:1.0:1787440128.280207:0:5865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440128.280308:0:5865:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee0512c3b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787440128.283136:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701186432 00000100:00100000:3.0:1787440128.283150:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701186432 00000100:00100000:3.0:1787440128.283265:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787440128.283277:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee0806b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:168176ea-29d1-49de-a254-317e90d54802+3:5865:x1874266701186432:12345-0@lo:104: 00010000:00010000:3.0:1787440128.283418:0:5833:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.158@tcp lock: ffff8ee040031600/0x85f5fa77adf3c10a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x85f5fa77adf3c111 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440128.283541:0:5833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787440128.283547:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee0806b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:168176ea-29d1-49de-a254-317e90d54802+3:5865:x1874266701186432:12345-0@lo:104: Request processed in 273us (3340us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440128.283555:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787440128.283672:0:5865:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee0806b6300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5865:1874266701186432:0@lo:104: 00010000:00010000:2.0:1787440128.283708:0:5865:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8ee059185000/0x85f5fa77adf3c1c0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440128.283813:0:5837:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787440128.283821:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.158@tcp lock: ffff8ee040031600/0x85f5fa77adf3c10a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x85f5fa77adf3c111 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440128.283828:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee040031600 already unused, calling callback (ffffffffc1bd2c20) 10000000:00010000:0.0:1787440128.283833:0:5837:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.158@tcp lock: ffff8ee040031600/0x85f5fa77adf3c10a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x85f5fa77adf3c111 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440128.283841:0:5837:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.158@tcp lock: ffff8ee040031600/0x85f5fa77adf3c10a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x85f5fa77adf3c111 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787440128.283855:0:5837:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.158@tcp lock: ffff8ee040031600/0x85f5fa77adf3c10a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x85f5fa77adf3c111 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787440128.283860:0:5837:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787440128.283902:0:5837:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.158@tcp lock: ffff8ee040031600/0x85f5fa77adf3c10a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x85f5fa77adf3c111 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440128.283909:0:5837:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787440128.283926:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.158@tcp lock: ffff8ee040031600/0x85f5fa77adf3c10a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x85f5fa77adf3c111 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440128.283933:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.158@tcp lock: ffff8ee040031600/0x85f5fa77adf3c10a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x85f5fa77adf3c111 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440128.283949:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787440128.283951:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787440128.283953:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787440128.283959:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787440128.283986:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee050480a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:168176ea-29d1-49de-a254-317e90d54802:3310:1874266701186560:0@lo:103: 00000100:00100000:0.0:1787440128.284026:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440128.284066:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701186560 00000100:00100000:0.0:1787440128.284070:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701186560 00010000:00010000:0.0:1787440128.284087:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ee082162a00/0x85f5fa77adf3c111 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x85f5fa77adf3c10a expref: 15 pid: 5842 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440128.284106:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787440128.284112:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee06e7e6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:168176ea-29d1-49de-a254-317e90d54802+15:3310:x1874266701186560:12345-0@lo:103: 00010000:00010000:0.0:1787440128.284122:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787440128.284126:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ee082162a00/0x85f5fa77adf3c111 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x85f5fa77adf3c10a expref: 15 pid: 5842 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440128.284141:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ee082162a00/0x85f5fa77adf3c111 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x85f5fa77adf3c10a expref: 15 pid: 5842 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440128.284155:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ee082162a00/0x85f5fa77adf3c111 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x85f5fa77adf3c10a expref: 15 pid: 5842 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440128.284167:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8ee059185000/0x85f5fa77adf3c1c0 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440128.284175:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ee059185000/0x85f5fa77adf3c1c0 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787440128.284189:0:5836:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005371580s 00010000:00010000:0.0:1787440128.284194:0:5836:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ee059185000/0x85f5fa77adf3c1c0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440128.284201:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ee059185000/0x85f5fa77adf3c1c0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440128.284208:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8ee059185000/0x85f5fa77adf3c1c0 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440128.284214:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8ee059185000/0x85f5fa77adf3c1c0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440128.284219:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee059185000 already unused, calling callback (ffffffffc15b52a0) 00010000:00010000:0.0:1787440128.284223:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8ee059185000/0x85f5fa77adf3c1c0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440128.284230:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8ee059185000/0x85f5fa77adf3c1c0 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440128.284250:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8ee059185000/0x85f5fa77adf3c1c0 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440128.284260:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787440128.284303:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee06e7e6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:168176ea-29d1-49de-a254-317e90d54802+14:3310:x1874266701186560:12345-0@lo:103: Request processed in 190us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440128.284310:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787440128.284363:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee050480a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:168176ea-29d1-49de-a254-317e90d54802:3310:1874266701186560:0@lo:103: 00010000:00010000:2.0:1787440128.284554:0:5865:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8ee059185000/0x85f5fa77adf3c1c0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440128.284562:0:5865:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8ee059185000/0x85f5fa77adf3c1c0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440128.284569:0:5865:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ee059185000/0x85f5fa77adf3c1c0 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440128.288313:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04a699850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:168176ea-29d1-49de-a254-317e90d54802+13:7623:x1874266701186304:12345-0@lo:253: Request processed in 50477us (51371us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440128.288326:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1787440128.288438:0:7623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee050482680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:168176ea-29d1-49de-a254-317e90d54802:7623:1874266701186304:0@lo:253: 10000000:01000000:0.0:1787440128.288451:0:7623:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1787440128.288454:0:7623:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787440128.288456:0:7623:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787440128.288458:0:7623:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787440128.288459:0:7623:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787440128.288460:0:7623:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787440128.288461:0:7623:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787440128.288463:0:7623:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787440128.288464:0:7623:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787440128.288465:0:7623:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787440128.288467:0:7623:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787440128.288468:0:7623:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1787440128.288482:0:7623:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1787440128.302606:0:7623:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1787440128.303336:0:7623:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1787440128.303594:0:7623:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1787440128.303842:0:7623:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1787440128.304119:0:7623:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1787440128.304368:0:7623:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1787440128.309661:0:7623:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:3.0:1787440128.547554:0:7623:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1787440128.547561:0:7623:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1787440128.547595:0:7623:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1787440128.547670:0:7623:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.158@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1787440128.547685:0:7623:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1787440128.547711:0:7623:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:0.0:1787440129.119022:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787440129.436703:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787440129.436737:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee050482680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874266701186688:0@lo:13: 00000100:00100000:0.0:1787440129.437244:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440129.437355:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701186688 00000100:00100000:2.0:1787440129.437363:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701186688 00000100:00100000:2.0:1787440129.437415:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787440129.437426:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee050480a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874266701186688:12345-0@lo:13: 00002000:00000024:2.0:1787440129.437461:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787440129.437535:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee050480a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874266701186688:12345-0@lo:13: Request processed in 110us (726us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440129.437552:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1787440129.437593:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ee050482680 x1874266701186688/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787440145 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787440129.437612:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee050482680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874266701186688:0@lo:13: 00010000:00010000:0.0:1787440130.147391:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787440131.164917:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787440132.190782:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787440133.213679:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787440133.542109:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee05fb62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:168176ea-29d1-49de-a254-317e90d54802:3311:1874266701186816:0@lo:400: 00000100:00100000:3.0:1787440133.542178:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440133.542217:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee05fb60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1874266701187328:0@lo:400: 00000100:00100000:3.0:1787440133.542241:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440133.542264:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787440133.542270:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee05fb63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874266701186944:0@lo:400: 00000100:00100000:3.0:1787440133.542289:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440133.542328:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701187328 00000100:00100000:3.0:1787440133.542334:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701187328 00000100:00100000:3.0:1787440133.542378:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701186944 00000100:00100000:3.0:1787440133.542381:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701186944 00000100:00100000:3.0:1787440133.542403:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787440133.542411:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee05fb61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874266701187328:12345-0@lo:400: 00000100:00100000:3.0:1787440133.542471:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee05fb61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874266701187328:12345-0@lo:400: Request processed in 60us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440133.542478:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787440133.542513:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787440133.542519:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee05fb62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874266701186944:12345-0@lo:400: 00000100:00100000:3.0:1787440133.542544:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee05fb62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874266701186944:12345-0@lo:400: Request processed in 26us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440133.542549:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:3.0:1787440133.542564:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787440133.542591:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ee05fb63480 x1874266701186944/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787440149 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787440133.542604:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee05fb63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874266701186944:0@lo:400: 00010000:00080000:3.0:1787440133.542615:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ee05fb60000 x1874266701187328/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787440149 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787440133.543790:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee05fb60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1874266701187072:0@lo:400: 00000100:00100000:2.0:1787440133.543841:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440133.544737:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787440133.544748:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee05fb61880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874266701187200:0@lo:400: 00000100:00100000:2.0:1787440133.544787:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440133.544827:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701187072 00000100:00100000:2.0:1787440133.544833:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701187072 00000100:00100000:2.0:1787440133.545026:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787440133.545035:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee049045500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1874266701187072:12345-0@lo:400: 00000100:00100000:2.0:1787440133.545091:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee049045500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1874266701187072:12345-0@lo:400: Request processed in 48us (1239us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440133.545098:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787440133.545139:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701187200 00000100:00100000:2.0:1787440133.545143:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701187200 00000100:00100000:2.0:1787440133.545169:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787440133.545174:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee049047100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1874266701187200:12345-0@lo:400: 00000100:00100000:2.0:1787440133.545203:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee049047100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1874266701187200:12345-0@lo:400: Request processed in 29us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440133.545208:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1787440133.545238:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ee05fb61880 x1874266701187200/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787440149 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787440133.545269:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee05fb61880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874266701187200:0@lo:400: 00010000:00080000:2.0:1787440133.545282:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ee05fb60a80 x1874266701187072/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787440149 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787440133.545290:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee05fb60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1874266701187072:0@lo:400: 00000100:00080000:2.0:1787440133.545316:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787440133.545321:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787440133.546565:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701186816 00000100:00100000:0.0:1787440133.546575:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701186816 00000100:00100000:0.0:1787440133.546615:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1787440133.546623:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04a69a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:168176ea-29d1-49de-a254-317e90d54802+13:3311:x1874266701186816:12345-0@lo:400: 00000100:00100000:0.0:1787440133.546695:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04a69a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:168176ea-29d1-49de-a254-317e90d54802+13:3311:x1874266701186816:12345-0@lo:400: Request processed in 73us (4517us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440133.546703:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1787440133.547558:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee05fb60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1874266701187328:0@lo:400: 00000100:00100000:3.0:1787440133.547593:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee05fb62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:168176ea-29d1-49de-a254-317e90d54802:3311:1874266701186816:0@lo:400: 00010000:00010000:0.0:1787440134.239064:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787440134.560926:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787440134.560962:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee0806b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874266701187456:0@lo:13: 00000100:00100000:0.0:1787440134.561027:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440134.561710:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701187456 00000100:00100000:1.0:1787440134.561718:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701187456 00000100:00100000:1.0:1787440134.561772:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787440134.561782:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee050480700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874266701187456:12345-0@lo:13: 00002000:00000024:1.0:1787440134.561816:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787440134.561870:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee050480700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874266701187456:12345-0@lo:13: Request processed in 89us (842us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440134.561876:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1787440134.561916:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ee0806b7100 x1874266701187456/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787440150 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787440134.561935:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee0806b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874266701187456:0@lo:13: 00000001:02000400:3.0:1787440135.186919:0:7980:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg658-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1787440135.260660:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787440135.584749:0:5847:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787440135.584757:0:5847:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8ee045e4e000 from 30 10000000:01000000:2.0:1787440135.584762:0:5847:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787440135.584806:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.158@tcp lock: ffff8ee07f86e600/0x85f5fa77adf3c1c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440135.584818:0:5847:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.158@tcp lock: ffff8ee07f86e600/0x85f5fa77adf3c1c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440135.584829:0:5847:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.158@tcp lock: ffff8ee07f86e600/0x85f5fa77adf3c1c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440135.584850:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee049044380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:168176ea-29d1-49de-a254-317e90d54802:5847:1874266701187584:0@lo:101: 00000100:00100000:2.0:1787440135.584915:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440135.584985:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee0807a9840 going to sleep for 11 seconds 00000100:00100000:0.0:1787440135.585065:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701187584 00000100:00100000:0.0:1787440135.585071:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701187584 00000100:00100000:0.0:1787440135.585120:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1787440135.585129:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04a698c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:168176ea-29d1-49de-a254-317e90d54802+13:5847:x1874266701187584:12345-0@lo:101: 00010000:00010000:0.0:1787440135.585141:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440135.585153:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ee040031600/0x85f5fa77adf3c1ce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x85f5fa77adf3c1c7 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440135.585173:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ee040031600/0x85f5fa77adf3c1ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x85f5fa77adf3c1c7 expref: 14 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440135.585183:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ee040031600/0x85f5fa77adf3c1ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f5fa77adf3c1c7 expref: 14 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440135.585192:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee040031600, rc 0) 00000100:00100000:0.0:1787440135.585235:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04a698c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:168176ea-29d1-49de-a254-317e90d54802+14:5847:x1874266701187584:12345-0@lo:101: Request processed in 107us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440135.585242:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1787440135.585786:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee049044380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:168176ea-29d1-49de-a254-317e90d54802:5847:1874266701187584:0@lo:101: 00010000:00010000:1.0:1787440135.585802:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.158@tcp lock: ffff8ee07f86e600/0x85f5fa77adf3c1c7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3c1ce expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440135.585811:0:5847:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.158@tcp lock: ffff8ee07f86e600/0x85f5fa77adf3c1c7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x85f5fa77adf3c1ce expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440135.585864:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee0806b7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:168176ea-29d1-49de-a254-317e90d54802:5847:1874266701187712:0@lo:501: 00000100:00100000:1.0:1787440135.585894:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440135.585913:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee079953300 going to sleep for 11 seconds 00000100:00100000:0.0:1787440135.586701:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701187712 00000100:00100000:0.0:1787440135.586709:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701187712 00000100:00100000:0.0:1787440135.586757:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1787440135.586766:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04a69b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:168176ea-29d1-49de-a254-317e90d54802+14:5847:x1874266701187712:12345-0@lo:501: 00000100:00100000:0.0:1787440135.587242:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04a69b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:168176ea-29d1-49de-a254-317e90d54802+14:5847:x1874266701187712:12345-0@lo:501: Request processed in 476us (1346us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440135.587250:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1787440135.587335:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee0806b7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:168176ea-29d1-49de-a254-317e90d54802:5847:1874266701187712:0@lo:501: 00000100:00100000:1.0:1787440135.587372:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee0806b7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:168176ea-29d1-49de-a254-317e90d54802:5847:1874266701187840:0@lo:503: 00000100:00100000:1.0:1787440135.587412:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440135.587448:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee079953300 going to sleep for 11 seconds 00000100:00100000:2.0:1787440135.587521:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701187840 00000100:00100000:2.0:1787440135.587526:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701187840 00000100:00100000:2.0:1787440135.587551:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1787440135.587571:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04a69b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:168176ea-29d1-49de-a254-317e90d54802+14:5847:x1874266701187840:12345-0@lo:503: 00000100:00100000:2.0:1787440135.587836:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04a69b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:168176ea-29d1-49de-a254-317e90d54802+14:5847:x1874266701187840:12345-0@lo:503: Request processed in 266us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440135.587852:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1787440135.588066:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee0806b7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:168176ea-29d1-49de-a254-317e90d54802:5847:1874266701187840:0@lo:503: 00000100:00100000:2.0:1787440135.589258:0:8002:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee049044000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:168176ea-29d1-49de-a254-317e90d54802:8002:1874266701187968:0@lo:502: 00000100:00100000:2.0:1787440135.589314:0:8002:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440135.589350:0:8002:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee0807a9300 going to sleep for 11 seconds 00000100:00100000:0.0:1787440135.589408:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701187968 00000100:00100000:0.0:1787440135.589414:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701187968 00000100:00100000:0.0:1787440135.589454:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1787440135.589462:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04a699450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:168176ea-29d1-49de-a254-317e90d54802+14:8002:x1874266701187968:12345-0@lo:502: 00000100:00100000:0.0:1787440135.590221:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04a699450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:168176ea-29d1-49de-a254-317e90d54802+14:8002:x1874266701187968:12345-0@lo:502: Request processed in 758us (906us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440135.590230:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1787440135.590396:0:8002:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee049044000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:168176ea-29d1-49de-a254-317e90d54802:8002:1874266701187968:0@lo:502: 00000100:00100000:3.0:1787440135.590453:0:8002:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee05fb62300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:168176ea-29d1-49de-a254-317e90d54802:8002:1874266701188096:0@lo:502: 00000100:00100000:3.0:1787440135.590489:0:8002:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440135.590547:0:8002:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee045ed4600 going to sleep for 11 seconds 00000100:00100000:2.0:1787440135.590704:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701188096 00000100:00100000:2.0:1787440135.590710:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701188096 00000100:00100000:2.0:1787440135.590913:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1787440135.590922:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04a699050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:168176ea-29d1-49de-a254-317e90d54802+14:8002:x1874266701188096:12345-0@lo:502: 00000100:00100000:2.0:1787440135.591105:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04a699050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:168176ea-29d1-49de-a254-317e90d54802+14:8002:x1874266701188096:12345-0@lo:502: Request processed in 184us (615us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440135.591112:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1787440135.595103:0:8002:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee05fb62300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:168176ea-29d1-49de-a254-317e90d54802:8002:1874266701188096:0@lo:502: 00000040:00080000:3.0:1787440135.595147:0:8002:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:3.0:1787440135.599158:0:5847:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:3.0:1787440135.599198:0:5847:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.158@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787440135.599210:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.158@tcp lock: ffff8ee07f86e600/0x85f5fa77adf3c1c7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3c1ce expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440135.599222:0:5847:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.158@tcp lock: ffff8ee07f86e600/0x85f5fa77adf3c1c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3c1ce expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787440135.599231:0:5847:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1787440135.599234:0:5847:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:3.0:1787440135.599237:0:5847:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1787440135.599271:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.158@tcp lock: ffff8ee041664200/0x85f5fa77adf3c1d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440135.599280:0:5847:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.158@tcp lock: ffff8ee041664200/0x85f5fa77adf3c1d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440135.599302:0:5847:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.158@tcp lock: ffff8ee041664200/0x85f5fa77adf3c1d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440135.599326:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee05fb62300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:168176ea-29d1-49de-a254-317e90d54802:5847:1874266701188224:0@lo:101: 00000100:00100000:3.0:1787440135.599386:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440135.599424:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee045ed4600 going to sleep for 11 seconds 00000100:00100000:3.0:1787440135.599444:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701188224 00000100:00100000:3.0:1787440135.599450:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701188224 00000100:00100000:3.0:1787440135.599486:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1787440135.599510:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04a698050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:168176ea-29d1-49de-a254-317e90d54802+14:5847:x1874266701188224:12345-0@lo:101: 00010000:00010000:3.0:1787440135.599522:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440135.599535:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ee041664e00/0x85f5fa77adf3c1dc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x85f5fa77adf3c1d5 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440135.600112:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ee041664e00/0x85f5fa77adf3c1dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x85f5fa77adf3c1d5 expref: 15 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440135.600127:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ee041664e00/0x85f5fa77adf3c1dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f5fa77adf3c1d5 expref: 15 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440135.600136:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee041664e00, rc 0) 00000100:00100000:3.0:1787440135.600182:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04a698050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:168176ea-29d1-49de-a254-317e90d54802+15:5847:x1874266701188224:12345-0@lo:101: Request processed in 688us (795us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440135.600189:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1787440135.600236:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee05fb62300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:168176ea-29d1-49de-a254-317e90d54802:5847:1874266701188224:0@lo:101: 00010000:00010000:3.0:1787440135.600249:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.158@tcp lock: ffff8ee041664200/0x85f5fa77adf3c1d5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3c1dc expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440135.600267:0:5847:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.158@tcp lock: ffff8ee041664200/0x85f5fa77adf3c1d5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x85f5fa77adf3c1dc expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440135.600313:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee05fb62300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:168176ea-29d1-49de-a254-317e90d54802:5847:1874266701188352:0@lo:501: 00000100:00100000:3.0:1787440135.600345:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440135.600367:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee045ed4600 going to sleep for 11 seconds 00000100:00100000:3.0:1787440135.600379:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701188352 00000100:00100000:3.0:1787440135.600383:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701188352 00000100:00100000:3.0:1787440135.600401:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1787440135.600407:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04a69a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:168176ea-29d1-49de-a254-317e90d54802+15:5847:x1874266701188352:12345-0@lo:501: 00000100:00100000:3.0:1787440135.600772:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04a69a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:168176ea-29d1-49de-a254-317e90d54802+15:5847:x1874266701188352:12345-0@lo:501: Request processed in 364us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440135.600779:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1787440135.600817:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee05fb62300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:168176ea-29d1-49de-a254-317e90d54802:5847:1874266701188352:0@lo:501: 00000100:00100000:3.0:1787440135.600842:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee05fb62300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:168176ea-29d1-49de-a254-317e90d54802:5847:1874266701188480:0@lo:503: 00000100:00100000:3.0:1787440135.600878:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440135.600895:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee045ed4600 going to sleep for 11 seconds 00000100:00100000:3.0:1787440135.600906:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701188480 00000100:00100000:3.0:1787440135.600909:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701188480 00000100:00100000:3.0:1787440135.600925:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1787440135.600931:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04a69ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:168176ea-29d1-49de-a254-317e90d54802+15:5847:x1874266701188480:12345-0@lo:503: 00000100:00100000:3.0:1787440135.601265:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04a69ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:168176ea-29d1-49de-a254-317e90d54802+15:5847:x1874266701188480:12345-0@lo:503: Request processed in 333us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440135.601272:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1787440135.601310:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee05fb62300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:168176ea-29d1-49de-a254-317e90d54802:5847:1874266701188480:0@lo:503: 00000100:00100000:3.0:1787440135.601463:0:8003:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee05fb62300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:168176ea-29d1-49de-a254-317e90d54802:8003:1874266701188608:0@lo:502: 00000100:00100000:3.0:1787440135.601516:0:8003:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440135.601535:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701188608 00000100:00100000:3.0:1787440135.601539:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701188608 00000100:00100000:0.0:1787440135.602400:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1787440135.602412:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04a69bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:168176ea-29d1-49de-a254-317e90d54802+15:8003:x1874266701188608:12345-0@lo:502: 00000100:00100000:3.0:1787440135.602703:0:8003:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee045ed4240 going to sleep for 11 seconds 00000100:00100000:0.0:1787440135.602897:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04a69bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:168176ea-29d1-49de-a254-317e90d54802+15:8003:x1874266701188608:12345-0@lo:502: Request processed in 488us (1380us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440135.602908:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1787440135.603194:0:8003:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee05fb62300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:168176ea-29d1-49de-a254-317e90d54802:8003:1874266701188608:0@lo:502: 00000020:01000000:3.0:1787440135.603222:0:8003:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787440135.603231:0:8003:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787440135.603233:0:8003:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787440135.603238:0:8003:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787440135.603239:0:8003:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1787440135.603262:0:8003:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee05fb62300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:168176ea-29d1-49de-a254-317e90d54802:8003:1874266701188736:0@lo:502: 00000100:00100000:3.0:1787440135.603300:0:8003:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440135.603326:0:8003:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee045ed4240 going to sleep for 11 seconds 00000100:00100000:2.0:1787440135.603383:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701188736 00000100:00100000:2.0:1787440135.603390:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701188736 00000100:00100000:2.0:1787440135.603432:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1787440135.603440:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04a698450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:168176ea-29d1-49de-a254-317e90d54802+15:8003:x1874266701188736:12345-0@lo:502: 00000100:00100000:2.0:1787440135.603605:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04a698450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:168176ea-29d1-49de-a254-317e90d54802+15:8003:x1874266701188736:12345-0@lo:502: Request processed in 166us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440135.603612:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1787440135.606933:0:8003:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee05fb62300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:168176ea-29d1-49de-a254-317e90d54802:8003:1874266701188736:0@lo:502: 00000020:01000000:1.0:1787440135.606986:0:8003:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787440135.606995:0:8003:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787440135.606997:0:8003:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:1.0:1787440135.607001:0:8003:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:1.0:1787440135.607610:0:5847:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:1.0:1787440135.607643:0:5847:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.158@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1787440135.607654:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.158@tcp lock: ffff8ee041664200/0x85f5fa77adf3c1d5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3c1dc expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440135.607666:0:5847:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.158@tcp lock: ffff8ee041664200/0x85f5fa77adf3c1d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3c1dc expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787440135.607676:0:5847:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1787440135.607678:0:5847:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8ee045f41000 from 30 10000000:01000000:1.0:1787440135.607682:0:5847:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787440135.607713:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.158@tcp lock: ffff8ee059185a00/0x85f5fa77adf3c1e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440135.607721:0:5847:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.158@tcp lock: ffff8ee059185a00/0x85f5fa77adf3c1e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440135.607729:0:5847:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.158@tcp lock: ffff8ee059185a00/0x85f5fa77adf3c1e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440135.607759:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee0806b7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:168176ea-29d1-49de-a254-317e90d54802:5847:1874266701188864:0@lo:101: 00000100:00100000:1.0:1787440135.608006:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440135.608048:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee079953300 going to sleep for 11 seconds 00000100:00100000:0.0:1787440135.608112:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701188864 00000100:00100000:0.0:1787440135.608118:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701188864 00000100:00100000:0.0:1787440135.608161:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1787440135.608168:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04a698850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:168176ea-29d1-49de-a254-317e90d54802+15:5847:x1874266701188864:12345-0@lo:101: 00010000:00010000:0.0:1787440135.608179:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440135.608199:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ee040030800/0x85f5fa77adf3c1ea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x85f5fa77adf3c1e3 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440135.608217:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ee040030800/0x85f5fa77adf3c1ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x85f5fa77adf3c1e3 expref: 16 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440135.608227:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ee040030800/0x85f5fa77adf3c1ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f5fa77adf3c1e3 expref: 16 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440135.608240:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee040030800, rc 0) 00000100:00100000:0.0:1787440135.608276:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04a698850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:168176ea-29d1-49de-a254-317e90d54802+16:5847:x1874266701188864:12345-0@lo:101: Request processed in 109us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440135.608282:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1787440135.608319:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee0806b7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:168176ea-29d1-49de-a254-317e90d54802:5847:1874266701188864:0@lo:101: 00010000:00010000:0.0:1787440135.608331:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.158@tcp lock: ffff8ee059185a00/0x85f5fa77adf3c1e3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3c1ea expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440135.608340:0:5847:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.158@tcp lock: ffff8ee059185a00/0x85f5fa77adf3c1e3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x85f5fa77adf3c1ea expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440135.608383:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee050482d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:168176ea-29d1-49de-a254-317e90d54802:5847:1874266701188992:0@lo:501: 00000100:00100000:0.0:1787440135.608406:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440135.608420:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee06e7c7b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787440135.608432:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701188992 00000100:00100000:0.0:1787440135.608435:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701188992 00000100:00100000:0.0:1787440135.608458:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1787440135.608463:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee043b4b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:168176ea-29d1-49de-a254-317e90d54802+16:5847:x1874266701188992:12345-0@lo:501: 00000100:00100000:0.0:1787440135.608720:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee043b4b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:168176ea-29d1-49de-a254-317e90d54802+16:5847:x1874266701188992:12345-0@lo:501: Request processed in 256us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440135.608727:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1787440135.608763:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee050482d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:168176ea-29d1-49de-a254-317e90d54802:5847:1874266701188992:0@lo:501: 00000100:00100000:0.0:1787440135.608785:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee050482d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:168176ea-29d1-49de-a254-317e90d54802:5847:1874266701189120:0@lo:503: 00000100:00100000:0.0:1787440135.609060:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440135.609074:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee06e7c7b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787440135.609091:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701189120 00000100:00100000:0.0:1787440135.609095:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701189120 00000100:00100000:0.0:1787440135.609112:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1787440135.609119:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee043b48450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:168176ea-29d1-49de-a254-317e90d54802+16:5847:x1874266701189120:12345-0@lo:503: 00000100:00100000:0.0:1787440135.609269:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee043b48450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:168176ea-29d1-49de-a254-317e90d54802+16:5847:x1874266701189120:12345-0@lo:503: Request processed in 150us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440135.609276:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1787440135.609298:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee050482d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:168176ea-29d1-49de-a254-317e90d54802:5847:1874266701189120:0@lo:503: 00000100:00100000:3.0:1787440135.622316:0:8004:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee05fb60000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:168176ea-29d1-49de-a254-317e90d54802:8004:1874266701189248:0@lo:502: 00000100:00100000:3.0:1787440135.622393:0:8004:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440135.622435:0:8004:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee045ed49c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787440135.622707:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701189248 00000100:00100000:0.0:1787440135.622713:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701189248 00000100:00100000:0.0:1787440135.622801:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1787440135.622810:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee06d270050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:168176ea-29d1-49de-a254-317e90d54802+16:8004:x1874266701189248:12345-0@lo:502: 00000100:00100000:1.0:1787440135.624090:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee06d270050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:168176ea-29d1-49de-a254-317e90d54802+16:8004:x1874266701189248:12345-0@lo:502: Request processed in 1277us (1692us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440135.624101:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1787440135.624114:0:8004:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee05fb60000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:168176ea-29d1-49de-a254-317e90d54802:8004:1874266701189248:0@lo:502: 00000100:00100000:3.0:1787440135.624172:0:8004:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee05fb60000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:168176ea-29d1-49de-a254-317e90d54802:8004:1874266701189376:0@lo:502: 00000100:00100000:3.0:1787440135.624210:0:8004:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440135.626221:0:8004:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee045ed49c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787440135.631119:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701189376 00000100:00100000:2.0:1787440135.631130:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701189376 00000100:00100000:3.0:1787440135.631251:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1787440135.631260:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee06d273850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:168176ea-29d1-49de-a254-317e90d54802+16:8004:x1874266701189376:12345-0@lo:502: 00000100:00100000:3.0:1787440135.631542:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee06d273850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:168176ea-29d1-49de-a254-317e90d54802+16:8004:x1874266701189376:12345-0@lo:502: Request processed in 282us (7330us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440135.631550:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1787440135.632004:0:8004:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee05fb60000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:168176ea-29d1-49de-a254-317e90d54802:8004:1874266701189376:0@lo:502: 00000040:00080000:2.0:1787440135.632111:0:8004:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1787440135.632171:0:5847:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1787440135.632187:0:5847:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.158@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787440135.632196:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.158@tcp lock: ffff8ee059185a00/0x85f5fa77adf3c1e3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3c1ea expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440135.632213:0:5847:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.158@tcp lock: ffff8ee059185a00/0x85f5fa77adf3c1e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3c1ea expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787440135.632224:0:5847:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787440135.632226:0:5847:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8ee045f41000 from 5 10000000:01000000:2.0:1787440135.632229:0:5847:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787440135.632258:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.158@tcp lock: ffff8ee07f86f800/0x85f5fa77adf3c1f1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440135.632267:0:5847:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.158@tcp lock: ffff8ee07f86f800/0x85f5fa77adf3c1f1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440135.632276:0:5847:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.158@tcp lock: ffff8ee07f86f800/0x85f5fa77adf3c1f1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440135.632293:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee049046680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:168176ea-29d1-49de-a254-317e90d54802:5847:1874266701189504:0@lo:101: 00000100:00100000:2.0:1787440135.632329:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440135.632362:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee0807a9480 going to sleep for 11 seconds 00000100:00100000:3.0:1787440135.632460:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701189504 00000100:00100000:3.0:1787440135.632466:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701189504 00000100:00100000:3.0:1787440135.632520:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1787440135.632529:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04a699c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:168176ea-29d1-49de-a254-317e90d54802+16:5847:x1874266701189504:12345-0@lo:101: 00010000:00010000:3.0:1787440135.632538:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440135.632549:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ee041665c00/0x85f5fa77adf3c1f8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x85f5fa77adf3c1f1 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440135.633096:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ee041665c00/0x85f5fa77adf3c1f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x85f5fa77adf3c1f1 expref: 17 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440135.633108:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ee041665c00/0x85f5fa77adf3c1f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f5fa77adf3c1f1 expref: 17 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440135.633117:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee041665c00, rc 0) 00000100:00100000:3.0:1787440135.633154:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04a699c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:168176ea-29d1-49de-a254-317e90d54802+17:5847:x1874266701189504:12345-0@lo:101: Request processed in 627us (824us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440135.633161:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1787440135.633805:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee049046680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:168176ea-29d1-49de-a254-317e90d54802:5847:1874266701189504:0@lo:101: 00010000:00010000:2.0:1787440135.633822:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.158@tcp lock: ffff8ee07f86f800/0x85f5fa77adf3c1f1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3c1f8 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440135.633831:0:5847:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.158@tcp lock: ffff8ee07f86f800/0x85f5fa77adf3c1f1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x85f5fa77adf3c1f8 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440135.633883:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee049046680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:168176ea-29d1-49de-a254-317e90d54802:5847:1874266701189632:0@lo:256: 00000100:00100000:2.0:1787440135.633996:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440135.634025:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee0807a9480 going to sleep for 11 seconds 00000100:00100000:2.0:1787440135.634110:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701189632 00000100:00100000:2.0:1787440135.634116:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701189632 00000100:00100000:2.0:1787440135.634141:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1787440135.634148:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee06d273450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:168176ea-29d1-49de-a254-317e90d54802+17:5847:x1874266701189632:12345-0@lo:256: 20000000:01000000:2.0:1787440135.634164:0:5844:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787440135.634180:0:5844:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787440135.634183:0:5844:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:2.0:1787440135.634255:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee06d273450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:168176ea-29d1-49de-a254-317e90d54802+17:5847:x1874266701189632:12345-0@lo:256: Request processed in 107us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440135.634263:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1787440135.634291:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee049046680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:168176ea-29d1-49de-a254-317e90d54802:5847:1874266701189632:0@lo:256: 10000000:01000000:2.0:1787440135.634325:0:5847:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.158@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787440135.634331:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.158@tcp lock: ffff8ee07f86f800/0x85f5fa77adf3c1f1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3c1f8 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440135.634339:0:5847:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.158@tcp lock: ffff8ee07f86f800/0x85f5fa77adf3c1f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3c1f8 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787440135.634347:0:5847:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1787440135.634349:0:5847:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:2.0:1787440135.634352:0:5847:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1787440135.634370:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.158@tcp lock: ffff8ee07f86f000/0x85f5fa77adf3c1ff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440135.634378:0:5847:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.158@tcp lock: ffff8ee07f86f000/0x85f5fa77adf3c1ff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440135.634386:0:5847:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.158@tcp lock: ffff8ee07f86f000/0x85f5fa77adf3c1ff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440135.634407:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee049046680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:168176ea-29d1-49de-a254-317e90d54802:5847:1874266701189760:0@lo:101: 00000100:00100000:2.0:1787440135.634431:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440135.634444:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee0807a9480 going to sleep for 11 seconds 00000100:00100000:2.0:1787440135.634455:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701189760 00000100:00100000:2.0:1787440135.634458:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701189760 00000100:00100000:2.0:1787440135.634474:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1787440135.634479:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee06d270c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:168176ea-29d1-49de-a254-317e90d54802+17:5847:x1874266701189760:12345-0@lo:101: 00010000:00010000:2.0:1787440135.634487:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440135.634519:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ee07f86e400/0x85f5fa77adf3c206 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x85f5fa77adf3c1ff expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440135.634536:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ee07f86e400/0x85f5fa77adf3c206 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x85f5fa77adf3c1ff expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440135.634544:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ee07f86e400/0x85f5fa77adf3c206 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f5fa77adf3c1ff expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440135.636981:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee07f86e400, rc 0) 00000100:00100000:2.0:1787440135.637819:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee06d270c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:168176ea-29d1-49de-a254-317e90d54802+18:5847:x1874266701189760:12345-0@lo:101: Request processed in 3334us (3382us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440135.637828:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1787440135.638098:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee049046680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:168176ea-29d1-49de-a254-317e90d54802:5847:1874266701189760:0@lo:101: 00010000:00010000:2.0:1787440135.638120:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.158@tcp lock: ffff8ee07f86f000/0x85f5fa77adf3c1ff lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3c206 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440135.638133:0:5847:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.158@tcp lock: ffff8ee07f86f000/0x85f5fa77adf3c1ff lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x85f5fa77adf3c206 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440135.638211:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee049046680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:168176ea-29d1-49de-a254-317e90d54802:5847:1874266701189888:0@lo:501: 00000100:00100000:2.0:1787440135.638245:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440135.638277:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee0807a9480 going to sleep for 11 seconds 00000100:00100000:0.0:1787440135.640991:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701189888 00000100:00100000:0.0:1787440135.641004:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701189888 00000100:00100000:0.0:1787440135.641064:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1787440135.641074:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee06d271c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:168176ea-29d1-49de-a254-317e90d54802+18:5847:x1874266701189888:12345-0@lo:501: 00000100:00100000:0.0:1787440135.641417:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee06d271c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:168176ea-29d1-49de-a254-317e90d54802+18:5847:x1874266701189888:12345-0@lo:501: Request processed in 344us (3170us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440135.641425:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1787440135.641466:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee049046680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:168176ea-29d1-49de-a254-317e90d54802:5847:1874266701189888:0@lo:501: 00000100:00100000:3.0:1787440135.641527:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee05fb63480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:168176ea-29d1-49de-a254-317e90d54802:5847:1874266701190016:0@lo:503: 00000100:00100000:3.0:1787440135.641582:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440135.641601:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee04a6e8780 going to sleep for 11 seconds 00000100:00100000:3.0:1787440135.641626:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701190016 00000100:00100000:3.0:1787440135.641630:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701190016 00000100:00100000:3.0:1787440135.641653:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1787440135.641659:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee06d273c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:168176ea-29d1-49de-a254-317e90d54802+18:5847:x1874266701190016:12345-0@lo:503: 00000100:00100000:3.0:1787440135.642132:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee06d273c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:168176ea-29d1-49de-a254-317e90d54802+18:5847:x1874266701190016:12345-0@lo:503: Request processed in 471us (548us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440135.642148:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1787440135.642270:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee05fb63480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:168176ea-29d1-49de-a254-317e90d54802:5847:1874266701190016:0@lo:503: 00000100:00100000:3.0:1787440135.643360:0:8005:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee05fb60380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:168176ea-29d1-49de-a254-317e90d54802:8005:1874266701190144:0@lo:502: 00000100:00100000:3.0:1787440135.643418:0:8005:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440135.643447:0:8005:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee04a60c840 going to sleep for 11 seconds 00000100:00100000:1.0:1787440135.650573:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701190144 00000100:00100000:1.0:1787440135.650588:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701190144 00000100:00100000:1.0:1787440135.650646:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1787440135.650658:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee06d271850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:168176ea-29d1-49de-a254-317e90d54802+18:8005:x1874266701190144:12345-0@lo:502: 00000100:00100000:1.0:1787440135.651216:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee06d271850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:168176ea-29d1-49de-a254-317e90d54802+18:8005:x1874266701190144:12345-0@lo:502: Request processed in 560us (7796us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440135.651224:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1787440135.654420:0:8005:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee05fb60380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:168176ea-29d1-49de-a254-317e90d54802:8005:1874266701190144:0@lo:502: 00000020:01000000:0.0:1787440135.654466:0:8005:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787440135.654474:0:8005:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1787440135.654482:0:8005:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787440135.654484:0:8005:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1787440135.654508:0:8005:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1787440135.654512:0:8005:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.158@tcp to nid 0x20000c0a8ce9e (192.168.206.158@tcp) 00000020:01000000:0.0:1787440135.654535:0:8005:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1787440135.654537:0:8005:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787440135.654569:0:8005:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8ee080064d28) 00000020:00000080:0.0:1787440135.654589:0:8005:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:0.0:1787440135.654594:0:8005:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1787440135.654668:0:8005:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1787440135.654673:0:8005:0:(osd_handler.c:1564:osd_obd_connect()) connect #6 00000020:00000080:0.0:1787440135.654679:0:8005:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x85f5fa77adf3c214 00010000:00080000:0.0:1787440135.654705:0:8005:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8ee04ca43000@lustre-OST0001-osc-MDT0000: add connection 192.168.206.158@tcp at head 00010000:00010000:0.0:1787440135.655395:0:8005:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:0.0:1787440135.655730:0:8005:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:0.0:1787440135.655743:0:8005:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1787440135.656242:0:8005:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787440135.656437:0:8005:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787440135.656486:0:8005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:0.0:1787440135.656570:0:8005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:1.0:1787440135.662979:0:8006:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787440135.662987:0:8006:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1787440135.665145:0:8005:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787440135.665164:0:8005:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1787440135.665201:0:8005:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1787440135.665232:0:8005:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x85f5fa77adf3c21b 00000100:00080000:1.0:1787440135.665242:0:8005:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787440135.665248:0:8005:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8ee04ca43000 using connection 192.168.206.158@tcp/0@lo 00000100:00100000:1.0:1787440135.665281:0:8005:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ee0806b5c00 x1874266701190272/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787440135.665307:0:8005:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1787440135.665404:0:8005:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787440135.665409:0:8005:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787440135.665410:0:8005:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1787440135.665413:0:8005:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787440135.665417:0:8005:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787440135.665418:0:8005:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787440135.665427:0:8005:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787440135.665429:0:8005:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1787440135.665454:0:8005:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee0806b4e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:168176ea-29d1-49de-a254-317e90d54802:8005:1874266701190400:0@lo:502: 00000100:00100000:2.0:1787440135.665538:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee0806b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1874266701190272:0@lo:8: 00000100:00100000:1.0:1787440135.665543:0:8005:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440135.665580:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440135.665588:0:8005:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee079953180 going to sleep for 11 seconds 00000100:00100000:2.0:1787440135.665611:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701190272 00000100:00100000:2.0:1787440135.665617:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701190272 00000100:00100000:2.0:1787440135.665657:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787440135.665664:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee049045f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3308:x1874266701190272:12345-0@lo:8: 00010000:00080000:2.0:1787440135.665685:0:6698:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 234 last 0 00000020:00000080:2.0:1787440135.665707:0:6698:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x85f5fa77adf3c222 00002000:00100000:2.0:1787440135.665719:0:6698:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8ee077fa3000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113940 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1787440135.665723:0:6698:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:2.0:1787440135.665727:0:6698:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:2.0:1787440135.666007:0:6698:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1787440135.666144:0:6698:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787440135.666166:0:6698:0:(import.c:65:import_set_state_nolock()) ffff8ee077fa0800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787440135.666232:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee049045f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3308:x1874266701190272:12345-0@lo:8: Request processed in 566us (650us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440135.666240:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1787440135.666275:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ee0806b5c00 x1874266701190272/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787440145 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787440135.666284:0:3308:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787440135.666290:0:3308:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1787440135.666296:0:3308:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1787440135.666307:0:3308:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1787440135.666309:0:3308:0:(import.c:65:import_set_state_nolock()) ffff8ee04ca43000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1787440135.666317:0:3308:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1787440135.666321:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee0806b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1874266701190272:0@lo:8: 00000004:00080000:1.0:1787440135.666813:0:8006:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1787440135.666998:0:8006:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 234037504393ns, next at 0ns, rc = 0 00000100:00100000:2.0:1787440135.674923:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701190400 00000100:00100000:2.0:1787440135.674937:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701190400 00000100:00100000:2.0:1787440135.675004:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1787440135.675014:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee06d270850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:168176ea-29d1-49de-a254-317e90d54802+18:8005:x1874266701190400:12345-0@lo:502: 00000100:00100000:0.0:1787440135.675082:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee050482680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874266701190784:0@lo:400: 00000100:00100000:0.0:1787440135.675138:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440135.675207:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787440135.675215:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee077838a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1874266701190912:0@lo:400: 00000100:00100000:0.0:1787440135.675253:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440135.676413:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee06d270850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:168176ea-29d1-49de-a254-317e90d54802+18:8005:x1874266701190400:12345-0@lo:502: Request processed in 1396us (10864us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440135.676424:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1787440135.676479:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee050483480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874266701190528:0@lo:400: 00000100:00100000:2.0:1787440135.676531:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440135.676566:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787440135.676572:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee050482d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1874266701190656:0@lo:400: 00000100:00100000:2.0:1787440135.676596:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440135.676774:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701190784 00000100:00100000:2.0:1787440135.676781:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701190784 00000100:00100000:2.0:1787440135.677134:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787440135.677144:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee050481500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1874266701190784:12345-0@lo:400: 00000100:00100000:2.0:1787440135.677326:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee050481500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1874266701190784:12345-0@lo:400: Request processed in 184us (2186us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440135.677332:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787440135.677355:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701190912 00000100:00100000:2.0:1787440135.677359:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701190912 00000100:00100000:2.0:1787440135.677386:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701190528 00000100:00100000:2.0:1787440135.677389:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701190528 00000100:00100000:2.0:1787440135.677417:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701190656 00000100:00100000:2.0:1787440135.677420:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701190656 00000100:00100000:2.0:1787440135.677435:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787440135.677442:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee07783b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874266701190912:12345-0@lo:400: 00000100:00100000:2.0:1787440135.677475:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee07783b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874266701190912:12345-0@lo:400: Request processed in 34us (2222us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440135.677482:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787440135.677518:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787440135.677524:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee049046a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874266701190528:12345-0@lo:400: 00000100:00100000:2.0:1787440135.677556:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee049046a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874266701190528:12345-0@lo:400: Request processed in 32us (1024us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440135.677869:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787440135.677883:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787440135.677891:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee049047b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1874266701190656:12345-0@lo:400: 00000100:00100000:2.0:1787440135.677923:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee049047b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1874266701190656:12345-0@lo:400: Request processed in 33us (1326us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440135.677928:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:2.0:1787440135.677963:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787440135.677968:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787440135.677999:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ee050482d80 x1874266701190656/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787440151 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787440135.678012:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee050482d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1874266701190656:0@lo:400: 00010000:00080000:2.0:1787440135.678023:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ee050483480 x1874266701190528/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787440151 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787440135.678030:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee050483480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874266701190528:0@lo:400: 00010000:00080000:2.0:1787440135.678062:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ee077838a80 x1874266701190912/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787440151 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787440135.678079:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee077838a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1874266701190912:0@lo:400: 00010000:00080000:2.0:1787440135.678092:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ee050482680 x1874266701190784/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787440151 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787440135.678099:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee050482680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874266701190784:0@lo:400: 00000100:00100000:0.0:1787440135.679448:0:8005:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee0806b4e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:168176ea-29d1-49de-a254-317e90d54802:8005:1874266701190400:0@lo:502: 00000020:01000000:0.0:1787440135.679511:0:8005:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787440135.679520:0:8005:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787440135.679522:0:8005:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:0.0:1787440135.679527:0:8005:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:2.0:1787440135.680068:0:5847:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:2.0:1787440135.680088:0:5847:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.158@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1787440135.680097:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.158@tcp lock: ffff8ee07f86f000/0x85f5fa77adf3c1ff lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3c206 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440135.680109:0:5847:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.158@tcp lock: ffff8ee07f86f000/0x85f5fa77adf3c1ff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3c206 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787440135.680119:0:5847:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1787440135.680122:0:5847:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8ee04a7e3370 from 1 10000000:01000000:2.0:1787440135.680124:0:5847:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787440135.680156:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.158@tcp lock: ffff8ee07f86f600/0x85f5fa77adf3c229 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440135.680164:0:5847:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.158@tcp lock: ffff8ee07f86f600/0x85f5fa77adf3c229 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440135.680173:0:5847:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.158@tcp lock: ffff8ee07f86f600/0x85f5fa77adf3c229 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440135.680261:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee049047800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:168176ea-29d1-49de-a254-317e90d54802:5847:1874266701191040:0@lo:101: 00000100:00100000:2.0:1787440135.680313:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440135.680351:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee04cab73c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787440135.680412:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701191040 00000100:00100000:0.0:1787440135.680418:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701191040 00000100:00100000:0.0:1787440135.680461:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1787440135.680469:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee06d271050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:168176ea-29d1-49de-a254-317e90d54802+18:5847:x1874266701191040:12345-0@lo:101: 00010000:00010000:0.0:1787440135.680479:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440135.680516:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ee040030400/0x85f5fa77adf3c230 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x85f5fa77adf3c229 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440135.680544:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ee040030400/0x85f5fa77adf3c230 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x85f5fa77adf3c229 expref: 19 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440135.680553:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ee040030400/0x85f5fa77adf3c230 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f5fa77adf3c229 expref: 19 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440135.680561:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee040030400, rc 0) 00000100:00100000:0.0:1787440135.680594:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee06d271050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:168176ea-29d1-49de-a254-317e90d54802+19:5847:x1874266701191040:12345-0@lo:101: Request processed in 127us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440135.680600:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1787440135.680736:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee049047800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:168176ea-29d1-49de-a254-317e90d54802:5847:1874266701191040:0@lo:101: 00010000:00010000:2.0:1787440135.680760:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.158@tcp lock: ffff8ee07f86f600/0x85f5fa77adf3c229 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3c230 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440135.680769:0:5847:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.158@tcp lock: ffff8ee07f86f600/0x85f5fa77adf3c229 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x85f5fa77adf3c230 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440135.681002:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee049047800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:168176ea-29d1-49de-a254-317e90d54802:5847:1874266701191168:0@lo:501: 00000100:00100000:2.0:1787440135.681029:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440135.681059:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee04cab73c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787440135.681075:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701191168 00000100:00100000:2.0:1787440135.681079:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701191168 00000100:00100000:2.0:1787440135.681105:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1787440135.681112:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee06d271450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:168176ea-29d1-49de-a254-317e90d54802+19:5847:x1874266701191168:12345-0@lo:501: 00000100:00100000:2.0:1787440135.681391:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee06d271450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:168176ea-29d1-49de-a254-317e90d54802+19:5847:x1874266701191168:12345-0@lo:501: Request processed in 279us (360us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787440135.681399:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1787440135.681434:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee049047800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:168176ea-29d1-49de-a254-317e90d54802:5847:1874266701191168:0@lo:501: 10000000:01000000:2.0:1787440135.681457:0:5847:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.158@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1787440135.681464:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.158@tcp lock: ffff8ee07f86f600/0x85f5fa77adf3c229 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3c230 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440135.681474:0:5847:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.158@tcp lock: ffff8ee07f86f600/0x85f5fa77adf3c229 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3c230 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787440135.763953:0:8008:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:0.0:1787440135.763985:0:8008:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee077838e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8008:1874266701191424:0@lo:7: 00000100:00100000:1.0:1787440135.763997:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787440135.764011:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee077839180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1874266701191296:0@lo:13: 00000100:00100000:1.0:1787440135.764051:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440135.764051:0:8008:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1787440135.765565:0:5871:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:0.0:1787440135.766357:0:8008:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee080569900 going to sleep for 11 seconds 00000100:00100000:0.0:1787440135.766384:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701191424 00000100:00100000:0.0:1787440135.766391:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701191424 00000100:00100000:0.0:1787440135.766447:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787440135.766456:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee07783b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8008:x1874266701191424:12345-0@lo:7: 00000100:00100000:1.0:1787440135.768804:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701191296 00000100:00100000:1.0:1787440135.768817:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701191296 00000100:00100000:1.0:1787440135.768872:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787440135.768883:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee0806b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3310:x1874266701191296:12345-0@lo:13: 00002000:00000024:1.0:1787440135.768926:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:1.0:1787440135.769004:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee0806b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3310:x1874266701191296:12345-0@lo:13: Request processed in 124us (4953us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440135.769011:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1787440135.769059:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ee077839180 x1874266701191296/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787440151 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787440135.769078:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee077839180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1874266701191296:0@lo:13: 00000100:00080000:1.0:1787440135.770050:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00080000:1.0:1787440135.782596:0:6697:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:1.0:1787440135.782603:0:6697:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:1.0:1787440135.782812:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee07783b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8008:x1874266701191424:12345-0@lo:7: Request processed in 16352us (18756us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440135.782823:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1787440135.787961:0:8008:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ee077838e00 x1874266701191424/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787440151 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787440135.787979:0:8008:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee077838e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8008:1874266701191424:0@lo:7: 00000004:00080000:0.0:1787440135.787993:0:8008:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:0.0:1787440135.788037:0:8008:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee077838e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8008:1874266701191552:0@lo:5: 00000100:00100000:0.0:1787440135.788097:0:8008:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440135.788200:0:8008:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee080569900 going to sleep for 11 seconds 00000100:00100000:2.0:1787440135.788393:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701191552 00000100:00100000:2.0:1787440135.788400:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701191552 00000100:00100000:2.0:1787440135.788671:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787440135.788687:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee077839500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8008:x1874266701191552:12345-0@lo:5: 00002000:00080000:2.0:1787440135.788711:0:6698:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1787440135.788815:0:6698:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:2.0:1787440135.789164:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee077839500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:8008:x1874266701191552:12345-0@lo:5: Request processed in 477us (1065us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1787440135.789172:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1787440135.789236:0:8008:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ee077838e00 x1874266701191552/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787440151 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787440135.789257:0:8008:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee077838e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8008:1874266701191552:0@lo:5: 00000004:00080000:1.0:1787440135.789267:0:8008:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:1.0:1787440135.789296:0:8008:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee0806b7480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8008:1874266701191680:0@lo:700: 00000100:00100000:1.0:1787440135.789327:0:8008:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440135.789346:0:8008:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee079953600 going to sleep for 11 seconds 00000100:00100000:1.0:1787440135.789363:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701191680 00000100:00100000:1.0:1787440135.789367:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701191680 00000100:00100000:1.0:1787440135.789402:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787440135.789409:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee0806b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:8008:x1874266701191680:12345-0@lo:700: 00000100:00100000:1.0:1787440135.789438:0:6704:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee0806b4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6704:1874266701191808:0@lo:700: 00000100:00100000:1.0:1787440135.789478:0:6704:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440135.789518:0:6704:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee0799539c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787440135.789771:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701191808 00000100:00100000:0.0:1787440135.789775:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701191808 00000100:00100000:0.0:1787440135.789811:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787440135.789819:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee0806b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6704:x1874266701191808:12345-0@lo:700: 40000000:02000000:0.0:1787440135.862392:0:5856:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:0.0:1787440135.869712:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee0806b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6704:x1874266701191808:12345-0@lo:700: Request processed in 79889us (80228us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440135.869725:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1787440135.869825:0:6704:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ee0806b4e00 x1874266701191808/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787440151 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787440135.869841:0:6704:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee0806b4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6704:1874266701191808:0@lo:700: 40000000:02000000:3.0:1787440135.869853:0:6704:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000001:00080000:0.0:1787440135.971535:0:7640:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:0.0:1787440135.971557:0:7640:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1787440135.971838:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee0806b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8008:x1874266701191680:12345-0@lo:700: Request processed in 182424us (182505us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440135.971850:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787440135.971932:0:8008:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ee0806b7480 x1874266701191680/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787440151 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787440135.971952:0:8008:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1787440135.971968:0:8008:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee0806b7480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8008:1874266701191680:0@lo:700: 00000004:02000040:1.0:1787440136.017908:0:8008:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:1.0:1787440136.023183:0:8008:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee0806b7480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8008:1874266701191936:0@lo:5: 00000100:00100000:1.0:1787440136.023249:0:8008:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440136.023417:0:8008:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee0512c3e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787440136.023476:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701191936 00000100:00100000:0.0:1787440136.023483:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701191936 00000100:00100000:0.0:1787440136.024185:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787440136.024195:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee0806b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:8008:x1874266701191936:12345-0@lo:5: 00002000:00080000:0.0:1787440136.034693:0:6697:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:0.0:1787440136.034714:0:6697:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:0.0:1787440136.044811:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee0806b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8008:x1874266701191936:12345-0@lo:5: Request processed in 20610us (21555us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1787440136.044824:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1787440136.044874:0:8008:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ee0806b7480 x1874266701191936/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787440152 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787440136.044891:0:8008:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee0806b7480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8008:1874266701191936:0@lo:5: 00000004:00080000:0.0:1787440136.044904:0:8008:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:1.0:1787440136.287371:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787440137.308875:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787440138.332853:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787440139.356769:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787440139.682228:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787440139.682253:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee0806b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874266701192064:0@lo:13: 00000100:00100000:3.0:1787440139.682331:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440139.682538:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701192064 00000100:00100000:1.0:1787440139.682545:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701192064 00000100:00100000:0.0:1787440139.682698:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787440139.682709:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee05fb60380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874266701192064:12345-0@lo:13: 00002000:00000024:0.0:1787440139.682741:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787440139.682807:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee05fb60380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874266701192064:12345-0@lo:13: Request processed in 99us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440139.682813:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:2.0:1787440139.682939:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787440139.686590:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ee0806b6300 x1874266701192064/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787440155 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787440139.686629:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee0806b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874266701192064:0@lo:13: 00000001:00080000:0.0:1787440140.028526:0:7640:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:2.0:1787440140.383839:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787440140.589014:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:2.0:1787440140.589098:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681245824 00000100:00100000:2.0:1787440140.589108:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681245824 00000100:00100000:2.0:1787440140.589151:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 111 00000100:00100000:2.0:1787440140.589159:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee06d272450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2359:x1874266681245824:12345-192.168.206.58@tcp:250: 00010000:00080000:2.0:1787440140.589185:0:5843:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from bfab787b-d66b-4cc5-abe4-b3c0f89e30e7@192.168.206.58@tcp t0 exp 0000000000000000 cur 238 last 0 00000020:00000080:2.0:1787440140.589215:0:5843:0:(genops.c:1385:class_connect()) connect: client bfab787b-d66b-4cc5-abe4-b3c0f89e30e7, cookie 0x85f5fa77adf3c237 00000100:00080000:2.0:1787440140.589346:0:5843:0:(import.c:65:import_set_state_nolock()) ffff8ee077fa0000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787440140.589416:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee06d272450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+5:2359:x1874266681245824:12345-192.168.206.58@tcp:250: Request processed in 256us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440140.589424:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 111 00000100:00100000:1.0:1787440140.605061:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440140.605433:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681245952 00000100:00100000:0.0:1787440140.605443:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681245952 00000100:00100000:0.0:1787440140.605828:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 112 00000100:00100000:0.0:1787440140.605837:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee06d272850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+5:5589:x1874266681245952:12345-192.168.206.58@tcp:101: 00010000:00010000:0.0:1787440140.605853:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440140.605867:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ee04cbce000/0x85f5fa77adf3c23e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fab14535dc6201f expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440140.606104:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ee04cbce000/0x85f5fa77adf3c23e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6201f expref: 6 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440140.606115:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ee04cbce000/0x85f5fa77adf3c23e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6201f expref: 6 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440140.606124:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee04cbce000, rc 0) 00000100:00100000:0.0:1787440140.606411:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee06d272850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+6:5589:x1874266681245952:12345-192.168.206.58@tcp:101: Request processed in 573us (1357us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440140.606419:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 112 00000100:00100000:1.0:1787440140.608939:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440140.609019:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681246080 00000100:00100000:3.0:1787440140.609027:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681246080 00000100:00100000:3.0:1787440140.609076:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 113 00000100:00100000:3.0:1787440140.609087:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee06d270450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+6:5589:x1874266681246080:12345-192.168.206.58@tcp:501: 00000100:00100000:3.0:1787440140.609304:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee06d270450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+6:5589:x1874266681246080:12345-192.168.206.58@tcp:501: Request processed in 218us (370us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787440140.609311:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 113 00000100:00100000:3.0:1787440140.612884:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:2.0:1787440140.612971:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681246208 00000100:00100000:2.0:1787440140.612981:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681246208 00000100:00100000:2.0:1787440140.613064:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 114 00000100:00100000:2.0:1787440140.613074:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee06d273050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+6:5589:x1874266681246208:12345-192.168.206.58@tcp:101: 00010000:00010000:2.0:1787440140.613089:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440140.613106:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ee07f86ee00/0x85f5fa77adf3c245 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fab14535dc62026 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440140.613143:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ee07f86ee00/0x85f5fa77adf3c245 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62026 expref: 7 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440140.613155:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ee07f86ee00/0x85f5fa77adf3c245 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62026 expref: 7 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440140.613165:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee07f86ee00, rc 0) 00000100:00100000:2.0:1787440140.613210:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee06d273050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+7:5589:x1874266681246208:12345-192.168.206.58@tcp:101: Request processed in 138us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440140.613217:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 114 00000100:00100000:1.0:1787440140.614857:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:2.0:1787440140.614960:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681246336 00000100:00100000:2.0:1787440140.614967:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681246336 00000100:00100000:2.0:1787440140.615012:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 115 00000100:00100000:2.0:1787440140.615021:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee06d272c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+7:5589:x1874266681246336:12345-192.168.206.58@tcp:501: 00000100:00100000:2.0:1787440140.615227:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee06d272c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+8:5589:x1874266681246336:12345-192.168.206.58@tcp:501: Request processed in 207us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440140.615235:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 115 00000100:00100000:1.0:1787440140.619302:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:2.0:1787440140.619465:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681246464 00000100:00100000:2.0:1787440140.619475:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681246464 00000100:00100000:2.0:1787440140.619539:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 116 00000100:00100000:2.0:1787440140.619549:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee06d272050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+8:5589:x1874266681246464:12345-192.168.206.58@tcp:503: 00000100:00100000:2.0:1787440140.619808:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee06d272050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+8:5589:x1874266681246464:12345-192.168.206.58@tcp:503: Request processed in 259us (513us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440140.619816:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 116 00000100:00100000:2.0:1787440140.624172:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440140.625207:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681246592 00000100:00100000:3.0:1787440140.625224:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681246592 00000100:00100000:3.0:1787440140.625267:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 117 00000100:00100000:3.0:1787440140.625276:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee05d265050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+8:5607:x1874266681246592:12345-192.168.206.58@tcp:502: 00000100:00100000:3.0:1787440140.625576:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee05d265050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+8:5607:x1874266681246592:12345-192.168.206.58@tcp:502: Request processed in 299us (1410us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440140.625584:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 117 00000100:00100000:0.0:1787440140.674840:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:2.0:1787440140.674930:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681246720 00000100:00100000:2.0:1787440140.674939:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681246720 00000100:00100000:2.0:1787440140.674991:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 118 00000100:00100000:2.0:1787440140.675001:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee05d264850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+8:5607:x1874266681246720:12345-192.168.206.58@tcp:502: 00000100:00100000:2.0:1787440140.675257:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee05d264850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+8:5607:x1874266681246720:12345-192.168.206.58@tcp:502: Request processed in 256us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440140.675264:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 118 00000100:00100000:3.0:1787440140.680657:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:1.0:1787440140.680955:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681246848 00000100:00100000:1.0:1787440140.680964:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681246848 00000100:00100000:1.0:1787440140.681009:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 119 00000100:00100000:1.0:1787440140.681018:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee05d265c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+8:5589:x1874266681246848:12345-192.168.206.58@tcp:101: 00010000:00010000:1.0:1787440140.681033:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440140.681048:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ee059185000/0x85f5fa77adf3c24c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fab14535dc62050 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440140.681072:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ee059185000/0x85f5fa77adf3c24c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62050 expref: 9 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440140.681083:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ee059185000/0x85f5fa77adf3c24c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62050 expref: 9 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440140.681091:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee059185000, rc 0) 00000100:00100000:1.0:1787440140.681148:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee05d265c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+9:5589:x1874266681246848:12345-192.168.206.58@tcp:101: Request processed in 120us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440140.681156:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 119 00000100:00100000:0.0:1787440140.686179:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:1.0:1787440140.686289:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681246976 00000100:00100000:1.0:1787440140.686298:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681246976 00000100:00100000:1.0:1787440140.686350:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 120 00000100:00100000:1.0:1787440140.686359:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee05d265850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+9:5589:x1874266681246976:12345-192.168.206.58@tcp:256: 20000000:01000000:1.0:1787440140.686393:0:5842:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1787440140.686408:0:5842:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1787440140.686412:0:5842:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1787440140.686415:0:5842:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1787440140.686418:0:5842:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:2.0:1787440140.688992:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee05d265850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+9:5589:x1874266681246976:12345-192.168.206.58@tcp:256: Request processed in 2618us (2807us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440140.689005:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 120 00000100:00100000:2.0:1787440140.694573:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440140.694871:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681247104 00000100:00100000:3.0:1787440140.694883:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681247104 00000100:00100000:3.0:1787440140.694941:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 121 00000100:00100000:3.0:1787440140.694951:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee05d267050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+9:5589:x1874266681247104:12345-192.168.206.58@tcp:101: 00010000:00010000:3.0:1787440140.694968:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440140.694985:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ee041665a00/0x85f5fa77adf3c253 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fab14535dc62057 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440140.695011:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ee041665a00/0x85f5fa77adf3c253 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62057 expref: 10 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440140.695021:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ee041665a00/0x85f5fa77adf3c253 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62057 expref: 10 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440140.695030:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee041665a00, rc 0) 00000100:00100000:3.0:1787440140.695071:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee05d267050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+10:5589:x1874266681247104:12345-192.168.206.58@tcp:101: Request processed in 123us (507us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440140.695078:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 121 00000100:00100000:0.0:1787440140.698981:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:1.0:1787440140.699594:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681247232 00000100:00100000:1.0:1787440140.699608:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681247232 00000100:00100000:1.0:1787440140.699666:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 122 00000100:00100000:1.0:1787440140.699676:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee05d264450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+10:5589:x1874266681247232:12345-192.168.206.58@tcp:501: 00000100:00100000:1.0:1787440140.700000:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee05d264450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+10:5589:x1874266681247232:12345-192.168.206.58@tcp:501: Request processed in 323us (1024us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440140.700009:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 122 00000100:00100000:2.0:1787440140.700959:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee049047800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:168176ea-29d1-49de-a254-317e90d54802:3311:1874266701192192:0@lo:400: 00000100:00100000:2.0:1787440140.701012:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440140.701057:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee049044380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1874266701192704:0@lo:400: 00000100:00100000:2.0:1787440140.701085:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440140.701117:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1787440140.701123:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee049047480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874266701192320:0@lo:400: 00000100:00100000:2.0:1787440140.701144:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440140.701167:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee050482680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874266701192832:0@lo:400: 00000100:00100000:0.0:1787440140.701172:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701192704 00000100:00100000:0.0:1787440140.701178:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701192704 00000100:00100000:2.0:1787440140.701204:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440140.701229:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701192320 00000100:00100000:0.0:1787440140.701233:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701192320 00000100:00100000:2.0:1787440140.701234:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee049046680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1874266701192448:0@lo:400: 00000100:00100000:2.0:1787440140.701257:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440140.701261:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787440140.701269:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787440140.701269:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee050483480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874266701192704:12345-0@lo:400: 00000100:00100000:2.0:1787440140.701273:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee049044000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874266701192576:0@lo:400: 00000100:00100000:2.0:1787440140.701292:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440140.701309:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee050483480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874266701192704:12345-0@lo:400: Request processed in 41us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440140.701315:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:2.0:1787440140.701316:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787440140.701327:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701192448 00000100:00100000:0.0:1787440140.701330:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701192448 00000100:00100000:2.0:1787440140.701332:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701192832 00000100:00100000:2.0:1787440140.701335:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701192832 00000100:00100000:0.0:1787440140.701348:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787440140.701354:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee050482d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874266701192320:12345-0@lo:400: 00000100:00100000:2.0:1787440140.701356:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701192576 00000100:00100000:2.0:1787440140.701358:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701192576 00000100:00100000:2.0:1787440140.701371:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787440140.701376:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee05d27dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1874266701192832:12345-0@lo:400: 00000100:00100000:0.0:1787440140.701380:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee050482d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874266701192320:12345-0@lo:400: Request processed in 26us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440140.701385:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787440140.701396:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787440140.701401:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee05d27d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1874266701192448:12345-0@lo:400: 00000100:00100000:2.0:1787440140.701403:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee05d27dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1874266701192832:12345-0@lo:400: Request processed in 27us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440140.701408:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787440140.701419:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787440140.701425:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee05d27ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1874266701192576:12345-0@lo:400: 00000100:00100000:0.0:1787440140.701427:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee05d27d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1874266701192448:12345-0@lo:400: Request processed in 26us (170us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440140.701432:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787440140.701465:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee05d27ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1874266701192576:12345-0@lo:400: Request processed in 39us (171us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440140.701471:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:2.0:1787440140.701516:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787440140.701519:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1787440140.701542:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ee049044000 x1874266701192576/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787440156 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787440140.701556:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee049044000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874266701192576:0@lo:400: 00010000:00080000:2.0:1787440140.701567:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ee049046680 x1874266701192448/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787440156 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787440140.701575:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee049046680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1874266701192448:0@lo:400: 00010000:00080000:2.0:1787440140.701622:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ee049047480 x1874266701192320/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787440156 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787440140.701630:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee049047480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874266701192320:0@lo:400: 00010000:00080000:2.0:1787440140.701640:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ee050482680 x1874266701192832/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787440156 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787440140.701658:0:3311:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1787440140.701670:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee050482680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874266701192832:0@lo:400: 00010000:00080000:2.0:1787440140.701682:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ee049044380 x1874266701192704/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787440156 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787440140.701691:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee049044380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1874266701192704:0@lo:400: 00000100:00100000:2.0:1787440140.701712:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701192192 00000100:00100000:2.0:1787440140.701716:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701192192 00000100:00100000:2.0:1787440140.701748:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1787440140.701755:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee05d267c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:168176ea-29d1-49de-a254-317e90d54802+19:3311:x1874266701192192:12345-0@lo:400: 00000100:00100000:2.0:1787440140.701797:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee05d267c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:168176ea-29d1-49de-a254-317e90d54802+19:3311:x1874266701192192:12345-0@lo:400: Request processed in 43us (785us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440140.701804:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1787440140.701832:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee049047800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:168176ea-29d1-49de-a254-317e90d54802:3311:1874266701192192:0@lo:400: 00000100:00100000:2.0:1787440140.703744:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440140.703791:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681247360 00000100:00100000:3.0:1787440140.703810:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681247360 00000100:00100000:3.0:1787440140.703860:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 124 00000100:00100000:3.0:1787440140.703868:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee05d266c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+10:5589:x1874266681247360:12345-192.168.206.58@tcp:503: 00000100:00100000:3.0:1787440140.704194:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee05d266c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+10:5589:x1874266681247360:12345-192.168.206.58@tcp:503: Request processed in 325us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440140.704325:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 124 00000100:00100000:2.0:1787440140.707970:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440140.708036:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681247488 00000100:00100000:0.0:1787440140.708044:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681247488 00000100:00100000:0.0:1787440140.708083:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 125 00000100:00100000:0.0:1787440140.708091:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee05d264050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+10:5611:x1874266681247488:12345-192.168.206.58@tcp:502: 00000100:00100000:0.0:1787440140.709024:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee05d264050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+10:5611:x1874266681247488:12345-192.168.206.58@tcp:502: Request processed in 929us (1060us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440140.709034:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 125 00000100:00100000:3.0:1787440140.711541:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440140.711567:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681247616 00000100:00100000:3.0:1787440140.711575:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681247616 00000100:00100000:3.0:1787440140.711723:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 126 00000100:00100000:3.0:1787440140.711733:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee05d266050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+10:5611:x1874266681247616:12345-192.168.206.58@tcp:502: 00000100:00100000:3.0:1787440140.712131:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee05d266050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+10:5611:x1874266681247616:12345-192.168.206.58@tcp:502: Request processed in 399us (596us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440140.712139:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 126 00000100:00100000:2.0:1787440140.716544:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:2.0:1787440140.716581:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681247744 00000100:00100000:2.0:1787440140.716590:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681247744 00000100:00100000:2.0:1787440140.716856:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 4 00000100:00100000:2.0:1787440140.716864:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee05d27f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2359:x1874266681247744:12345-192.168.206.58@tcp:38: 00010000:00080000:2.0:1787440140.716892:0:5851:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 792563a7-4c22-4ac7-ac25-d49ef7fb41a8@192.168.206.58@tcp t0 exp 0000000000000000 cur 239 last 0 00000020:00000080:2.0:1787440140.716953:0:5851:0:(genops.c:1385:class_connect()) connect: client 792563a7-4c22-4ac7-ac25-d49ef7fb41a8, cookie 0x85f5fa77adf3c25a 00000004:00100000:2.0:1787440140.716981:0:5851:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:2.0:1787440140.716987:0:5851:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:0.0:1787440140.717750:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440140.717776:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681248128 00000100:00100000:0.0:1787440140.717782:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681248128 00000100:00100000:0.0:1787440140.717824:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 127 00000100:00100000:0.0:1787440140.717831:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee05d266450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+10:2362:x1874266681248128:12345-192.168.206.58@tcp:400: 00000100:00100000:0.0:1787440140.717888:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee05d266450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+10:2362:x1874266681248128:12345-192.168.206.58@tcp:400: Request processed in 57us (139us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440140.717895:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 127 00000100:00080000:2.0:1787440140.749582:0:5851:0:(import.c:65:import_set_state_nolock()) ffff8ee077fa2000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787440140.749864:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee05d27f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+6:2359:x1874266681247744:12345-192.168.206.58@tcp:38: Request processed in 32996us (33327us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440140.749876:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 4 00000100:00100000:1.0:1787440141.213413:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787440141.213439:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee07783a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1874266701192960:0@lo:13: 00000100:00100000:1.0:1787440141.213528:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440141.213809:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701192960 00000100:00100000:0.0:1787440141.213818:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701192960 00000100:00100000:0.0:1787440141.214182:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787440141.214193:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee0806b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874266701192960:12345-0@lo:13: 00002000:00000024:0.0:1787440141.214226:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787440141.214284:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee0806b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874266701192960:12345-0@lo:13: Request processed in 94us (756us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440141.214291:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1787440141.214359:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ee07783a300 x1874266701192960/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787440157 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787440141.214380:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee07783a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1874266701192960:0@lo:13: 00010000:00010000:1.0:1787440141.408054:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787440141.751940:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440141.751985:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:2.0:1787440141.752239:0:6892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681248000 00000100:00100000:2.0:1787440141.752250:0:6892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681248000 00000100:00080000:0.0:1787440141.752422:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787440141.752461:0:6892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681247872 00000100:00100000:2.0:1787440141.752465:0:6892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681247872 00000100:00100000:1.0:1787440141.756415:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 5 00000100:00100000:1.0:1787440141.756440:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee07783bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+7:5589:x1874266681248000:12345-192.168.206.58@tcp:41: 00000004:00000024:1.0:1787440141.756484:0:5849:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:1.0:1787440141.756583:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee07783bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+7:5589:x1874266681248000:12345-192.168.206.58@tcp:41: Request processed in 155us (4650us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440141.756590:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 5 00000100:00100000:1.0:1787440141.756617:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 6 00000100:00100000:1.0:1787440141.756624:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee077839f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+6:0:x1874266681247872:12345-192.168.206.58@tcp:41: 00000004:00000024:1.0:1787440141.756636:0:5849:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:1.0:1787440141.756657:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee077839f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+6:0:x1874266681247872:12345-192.168.206.58@tcp:41: Request processed in 33us (4671us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440141.756675:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 6 00000100:00100000:2.0:1787440141.763454:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:1.0:1787440141.763713:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681248256 00000100:00100000:1.0:1787440141.763722:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681248256 00000100:00100000:1.0:1787440141.763897:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 7 00000100:00100000:1.0:1787440141.763907:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee05d27d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+6:5589:x1874266681248256:12345-192.168.206.58@tcp:40: 00000100:00100000:1.0:1787440141.764000:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee05d27d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+6:5589:x1874266681248256:12345-192.168.206.58@tcp:40: Request processed in 95us (556us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440141.764008:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 7 00000100:00100000:0.0:1787440141.770042:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440141.770086:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:2.0:1787440141.770183:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681248384 00000100:00100000:2.0:1787440141.770192:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681248384 00000100:00100000:2.0:1787440141.770230:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681248512 00000100:00100000:2.0:1787440141.770233:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681248512 00000100:00100000:2.0:1787440141.770248:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 8 00000100:00100000:2.0:1787440141.770255:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee07783aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2359:x1874266681248384:12345-192.168.206.58@tcp:8: 00010000:00080000:2.0:1787440141.770282:0:6698:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 792563a7-4c22-4ac7-ac25-d49ef7fb41a8@192.168.206.58@tcp t0 exp 0000000000000000 cur 240 last 0 00000020:00000080:2.0:1787440141.770323:0:6698:0:(genops.c:1385:class_connect()) connect: client 792563a7-4c22-4ac7-ac25-d49ef7fb41a8, cookie 0x85f5fa77adf3c261 00002000:00100000:2.0:1787440141.770336:0:6698:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 792563a7-4c22-4ac7-ac25-d49ef7fb41a8/ffff8ee077fa5800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113940 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787440141.770365:0:6698:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:1.0:1787440141.770705:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:1.0:1787440141.770750:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:1.0:1787440141.770784:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681248768 00000100:00100000:1.0:1787440141.770789:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681248768 00000100:00100000:1.0:1787440141.770828:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 0 00002000:00080000:2.0:1787440141.770941:0:6698:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00100000:3.0:1787440141.770944:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681248640 00000100:00100000:3.0:1787440141.770952:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681248640 00000100:00080000:2.0:1787440141.770971:0:6698:0:(import.c:65:import_set_state_nolock()) ffff8ee077fa7800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787440141.770983:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 128 00000100:00100000:3.0:1787440141.770992:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee047a42850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+10:2363:x1874266681248640:12345-192.168.206.58@tcp:400: 00000100:00100000:2.0:1787440141.771032:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee07783aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+6:2359:x1874266681248384:12345-192.168.206.58@tcp:8: Request processed in 776us (999us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440141.771041:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 8 00000100:00100000:2.0:1787440141.771061:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 9 00000100:00100000:1.0:1787440141.771062:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee0806b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+6:5589:x1874266681248768:12345-192.168.206.58@tcp:33: 00000100:00100000:2.0:1787440141.771075:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee077838700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2359:x1874266681248512:12345-192.168.206.58@tcp:8: 00010000:00080000:2.0:1787440141.771092:0:6698:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 792563a7-4c22-4ac7-ac25-d49ef7fb41a8@192.168.206.58@tcp t0 exp 0000000000000000 cur 240 last 0 00000020:00000080:2.0:1787440141.771110:0:6698:0:(genops.c:1385:class_connect()) connect: client 792563a7-4c22-4ac7-ac25-d49ef7fb41a8, cookie 0x85f5fa77adf3c268 00002000:00100000:2.0:1787440141.771117:0:6698:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 792563a7-4c22-4ac7-ac25-d49ef7fb41a8/ffff8ee077fa2800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113940 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787440141.771125:0:6698:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787440141.771599:0:6698:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787440141.771619:0:6698:0:(import.c:65:import_set_state_nolock()) ffff8ee077fa5000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787440141.780474:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee047a42850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+10:2363:x1874266681248640:12345-192.168.206.58@tcp:400: Request processed in 9471us (9758us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440141.780489:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 128 00000100:00100000:2.0:1787440141.786592:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee077838700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+6:2359:x1874266681248512:12345-192.168.206.58@tcp:8: Request processed in 15505us (16494us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440141.786607:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 9 00000004:00080000:2.0:1787440141.806075:0:5852:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 34956us 00000004:00200000:3.0:1787440141.821957:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:3.0:1787440141.822152:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee0806b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+6:5589:x1874266681248768:12345-192.168.206.58@tcp:33: Request processed in 51312us (51398us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440141.822167:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 0 00000100:00100000:0.0:1787440142.094603:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:2.0:1787440142.094737:0:6892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681248896 00000100:00100000:2.0:1787440142.094748:0:6892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681248896 00000100:00100000:2.0:1787440142.094812:0:6892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 8 00000100:00100000:2.0:1787440142.094824:0:6892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee07783a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+6:5628:x1874266681248896:12345-192.168.206.58@tcp:101: 00010000:00010000:2.0:1787440142.094842:0:6892:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440142.094930:0:6892:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86fe00/0x85f5fa77adf3c26f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fab14535dc62081 expref: -99 pid: 6892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440142.094995:0:6892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86ea00/0x85f5fa77adf3c276 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440142.095019:0:6892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86ea00/0x85f5fa77adf3c276 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440142.095033:0:6892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86ea00/0x85f5fa77adf3c276 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787440142.095239:0:6892:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1787440142.095243:0:6892:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787440142.095335:0:6892:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86ea00/0x85f5fa77adf3c276 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440142.095370:0:6892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86fe00/0x85f5fa77adf3c26f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62081 expref: 8 pid: 6892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440142.095387:0:6892:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86ea00/0x85f5fa77adf3c276 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62081 expref: 7 pid: 6892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440142.095395:0:6892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ee054b3c900) 00010000:00010000:2.0:1787440142.095398:0:6892:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787440142.095401:0:6892:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee07f86ea00, rc 0) 00000100:00100000:2.0:1787440142.095458:0:6892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee07783a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+7:5628:x1874266681248896:12345-192.168.206.58@tcp:101: Request processed in 636us (864us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440142.095466:0:6892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 8 00010000:00010000:2.0:1787440142.429958:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787440143.326251:0:6723:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 792563a7-4c22-4ac7-ac25-d49ef7fb41a8 00010000:00010000:1.0:1787440143.452940:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787440144.377564:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440144.377822:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681249024 00000100:00100000:3.0:1787440144.377843:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681249024 00000100:00100000:3.0:1787440144.377924:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 9 00000100:00080000:0.0:1787440144.377927:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787440144.377936:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee05d27ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+7:5681:x1874266681249024:12345-192.168.206.58@tcp:41: 00000004:00000024:3.0:1787440144.377977:0:5850:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:3.0:1787440144.378041:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee05d27ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+7:5681:x1874266681249024:12345-192.168.206.58@tcp:41: Request processed in 108us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440144.378048:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 9 00000100:00100000:0.0:1787440144.397763:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:1.0:1787440144.397879:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681249152 00000100:00100000:1.0:1787440144.397888:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681249152 00000100:00100000:1.0:1787440144.397970:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 8 00000100:00100000:1.0:1787440144.397981:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee077838380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+5:5681:x1874266681249152:12345-192.168.206.58@tcp:13: 00002000:00000024:1.0:1787440144.398016:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1787440144.398137:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787440144.398977:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee077838380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+5:5681:x1874266681249152:12345-192.168.206.58@tcp:13: Request processed in 994us (1217us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440144.398987:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 8 00000100:00100000:2.0:1787440144.409936:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440144.410078:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681249280 00000100:00100000:0.0:1787440144.410087:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681249280 00000100:00100000:0.0:1787440144.410150:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 9 00000100:00100000:0.0:1787440144.410160:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee05d27f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+6:5681:x1874266681249280:12345-192.168.206.58@tcp:13: 00002000:00000024:0.0:1787440144.410209:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787440144.410288:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee05d27f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+6:5681:x1874266681249280:12345-192.168.206.58@tcp:13: Request processed in 129us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440144.410296:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 9 00000100:00080000:2.0:1787440144.410875:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1787440144.481251:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787440144.796811:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee0806b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1874266701193088:0@lo:13: 00000100:00100000:2.0:1787440144.796886:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440144.797002:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701193088 00000100:00100000:0.0:1787440144.797011:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701193088 00000100:00100000:0.0:1787440144.797076:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787440144.797085:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee05d27d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874266701193088:12345-0@lo:13: 00002000:00000024:0.0:1787440144.797161:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1787440144.797289:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787440144.798260:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee05d27d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874266701193088:12345-0@lo:13: Request processed in 1172us (1370us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440144.798270:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:2.0:1787440144.798371:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ee0806b6300 x1874266701193088/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787440160 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787440144.798413:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee0806b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1874266701193088:0@lo:13: 00010000:00010000:1.0:1787440145.501699:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787440145.826717:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee0806b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874266701193344:0@lo:400: 00000100:00100000:1.0:1787440145.826807:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440145.826860:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee047a21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1874266701193856:0@lo:400: 00000100:00100000:1.0:1787440145.826885:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440145.826927:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1787440145.826933:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee0806b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:168176ea-29d1-49de-a254-317e90d54802:3312:1874266701193216:0@lo:400: 00000100:00100000:1.0:1787440145.826959:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440145.826981:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee047a23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3312:1874266701193728:0@lo:400: 00000100:00100000:1.0:1787440145.827000:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440145.827023:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee047a21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1874266701193472:0@lo:400: 00000100:00100000:1.0:1787440145.827044:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440145.827061:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787440145.827066:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee047a22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874266701193600:0@lo:400: 00000100:00100000:1.0:1787440145.827088:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440145.827117:0:6892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701193344 00000100:00100000:1.0:1787440145.827124:0:6892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701193344 00000100:00100000:1.0:1787440145.827162:0:6892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701193728 00000100:00100000:1.0:1787440145.827165:0:6892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701193728 00000100:00100000:1.0:1787440145.827186:0:6892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701193472 00000100:00100000:1.0:1787440145.827189:0:6892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701193472 00000100:00100000:1.0:1787440145.827203:0:6892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787440145.827210:0:6892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee047a22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874266701193344:12345-0@lo:400: 00000100:00100000:1.0:1787440145.827255:0:6892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee047a22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874266701193344:12345-0@lo:400: Request processed in 44us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440145.827261:0:6892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787440145.827276:0:6892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787440145.827282:0:6892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee047a22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874266701193728:12345-0@lo:400: 00000100:00100000:1.0:1787440145.827318:0:6892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee047a22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874266701193728:12345-0@lo:400: Request processed in 37us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440145.827331:0:6892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787440145.827343:0:6892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787440145.827348:0:6892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee047a20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1874266701193472:12345-0@lo:400: 00000100:00100000:1.0:1787440145.827378:0:6892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee047a20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1874266701193472:12345-0@lo:400: Request processed in 30us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440145.827383:0:6892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787440145.827400:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701193856 00000100:00100000:1.0:1787440145.827403:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701193856 00000100:00100000:1.0:1787440145.827426:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701193600 00000100:00100000:1.0:1787440145.827429:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701193600 00000100:00100000:1.0:1787440145.827443:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787440145.827448:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee047a20700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1874266701193856:12345-0@lo:400: 00000100:00100000:1.0:1787440145.827476:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee047a20700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1874266701193856:12345-0@lo:400: Request processed in 28us (591us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440145.827481:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787440145.827518:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787440145.827524:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee047a23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1874266701193600:12345-0@lo:400: 00000100:00100000:1.0:1787440145.827551:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee047a23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1874266701193600:12345-0@lo:400: Request processed in 27us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440145.827556:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:1.0:1787440145.827585:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787440145.827590:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787440145.827617:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ee047a22300 x1874266701193600/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787440161 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787440145.827630:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee047a22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874266701193600:0@lo:400: 00000100:00100000:1.0:1787440145.827643:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee047a21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1874266701193472:0@lo:400: 00000100:00100000:1.0:1787440145.827682:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee047a23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3312:1874266701193728:0@lo:400: 00000100:00100000:1.0:1787440145.827691:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee0806b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874266701193344:0@lo:400: 00010000:00080000:1.0:1787440145.827700:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ee047a21f80 x1874266701193856/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787440161 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787440145.827709:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee047a21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1874266701193856:0@lo:400: 00000100:00100000:0.0:1787440145.828011:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701193216 00000100:00100000:0.0:1787440145.828016:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701193216 00000100:00100000:0.0:1787440145.828064:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1787440145.828072:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee047a40c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:168176ea-29d1-49de-a254-317e90d54802+19:3312:x1874266701193216:12345-0@lo:400: 00000100:00100000:0.0:1787440145.828111:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee047a40c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:168176ea-29d1-49de-a254-317e90d54802+19:3312:x1874266701193216:12345-0@lo:400: Request processed in 41us (1151us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440145.828117:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1787440145.828151:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee0806b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:168176ea-29d1-49de-a254-317e90d54802:3312:1874266701193216:0@lo:400: 00000001:00100000:2.0:1787440145.890318:0:5871:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 792563a7-4c22-4ac7-ac25-d49ef7fb41a8 00000100:00100000:1.0:1787440146.333276:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee07783b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874266701193984:0@lo:13: 00000100:00100000:1.0:1787440146.333339:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440146.333482:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701193984 00000100:00100000:3.0:1787440146.333517:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701193984 00000100:00100000:3.0:1787440146.333569:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787440146.333644:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee047a21f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874266701193984:12345-0@lo:13: 00002000:00000024:3.0:1787440146.333675:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787440146.333726:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee047a21f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874266701193984:12345-0@lo:13: Request processed in 85us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440146.333733:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:1.0:1787440146.334662:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ee07783b800 x1874266701193984/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787440162 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787440146.334683:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee07783b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874266701193984:0@lo:13: 00000001:00100000:0.0:1787440146.369929:0:7640:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 792563a7-4c22-4ac7-ac25-d49ef7fb41a8 00010000:00010000:2.0:1787440146.525192:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787440147.003766:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440147.003908:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440147.003944:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440147.003983:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:1.0:1787440147.004021:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681249664 00000100:00100000:1.0:1787440147.004035:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681249664 00000100:00100000:1.0:1787440147.004101:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681249792 00000100:00100000:1.0:1787440147.004104:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681249792 00000100:00080000:3.0:1787440147.004129:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787440147.004137:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 9 00000100:00080000:3.0:1787440147.004141:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787440147.004142:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681249408 00000100:00100000:0.0:1787440147.004152:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681249408 00000100:00100000:1.0:1787440147.004154:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee05fb63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+5:2362:x1874266681249664:12345-192.168.206.58@tcp:400: 00000100:00100000:0.0:1787440147.004232:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 130 00000100:00100000:1.0:1787440147.004239:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee05fb63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+5:2362:x1874266681249664:12345-192.168.206.58@tcp:400: Request processed in 88us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440147.004253:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 9 00000100:00100000:0.0:1787440147.004253:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee047a43450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+10:2362:x1874266681249408:12345-192.168.206.58@tcp:400: 00000100:00100000:1.0:1787440147.004276:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 10 00000100:00100000:1.0:1787440147.004285:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee05fb62300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+5:2362:x1874266681249792:12345-192.168.206.58@tcp:400: 00000100:00100000:0.0:1787440147.004336:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee047a43450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+10:2362:x1874266681249408:12345-192.168.206.58@tcp:400: Request processed in 80us (573us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440147.004337:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee05fb62300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+5:2362:x1874266681249792:12345-192.168.206.58@tcp:400: Request processed in 41us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440147.004360:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 10 00000100:00100000:0.0:1787440147.004391:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 130 00000100:00100000:2.0:1787440147.004601:0:6892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681249536 00000100:00100000:2.0:1787440147.004609:0:6892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681249536 00000100:00100000:2.0:1787440147.004656:0:6892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 23 00000100:00100000:2.0:1787440147.004663:0:6892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee05fb60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+6:2362:x1874266681249536:12345-192.168.206.58@tcp:400: 00000100:00100000:2.0:1787440147.004703:0:6892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee05fb60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+6:2362:x1874266681249536:12345-192.168.206.58@tcp:400: Request processed in 40us (758us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440147.004709:0:6892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 23 00000100:00080000:3.0:1787440147.005486:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:2.0:1787440147.269165:0:8294:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:1.0:1787440147.548887:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787440148.572822:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787440149.599644:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787440149.919328:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787440149.919363:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee047a23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874266701194112:0@lo:13: 00000100:00100000:3.0:1787440149.919473:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440149.919819:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701194112 00000100:00100000:1.0:1787440149.919830:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701194112 00000100:00100000:1.0:1787440149.919904:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787440149.919914:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee05fb60a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874266701194112:12345-0@lo:13: 00002000:00000024:1.0:1787440149.919959:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787440149.920018:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee05fb60a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874266701194112:12345-0@lo:13: Request processed in 105us (545us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440149.920025:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:2.0:1787440149.924623:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787440149.925681:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ee047a23b80 x1874266701194112/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787440165 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787440149.925729:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee047a23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874266701194112:0@lo:13: 00010000:00010000:2.0:1787440150.621610:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787440150.946912:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee05d27e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:168176ea-29d1-49de-a254-317e90d54802:3311:1874266701194240:0@lo:400: 00000100:00100000:2.0:1787440150.947005:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440150.947058:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee05d27c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1874266701194752:0@lo:400: 00000100:00100000:2.0:1787440150.947084:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440150.947112:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1787440150.947117:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee05d27fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874266701194368:0@lo:400: 00000100:00100000:2.0:1787440150.947140:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440150.947158:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee05d27e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874266701194880:0@lo:400: 00000100:00100000:2.0:1787440150.947183:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440150.947212:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee05d27df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1874266701194496:0@lo:400: 00000100:00100000:2.0:1787440150.947238:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440150.947269:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787440150.947274:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee05d27ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874266701194624:0@lo:400: 00000100:00100000:2.0:1787440150.947301:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440150.947337:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701194240 00000100:00100000:2.0:1787440150.947346:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701194240 00000100:00100000:2.0:1787440150.947417:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1787440150.947427:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04ca1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:168176ea-29d1-49de-a254-317e90d54802+19:3311:x1874266701194240:12345-0@lo:400: 00000100:00100000:2.0:1787440150.947478:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04ca1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:168176ea-29d1-49de-a254-317e90d54802+19:3311:x1874266701194240:12345-0@lo:400: Request processed in 52us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440150.947486:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1787440150.948687:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701194752 00000100:00100000:2.0:1787440150.948700:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701194752 00000100:00100000:2.0:1787440150.948759:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701194368 00000100:00100000:2.0:1787440150.948763:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701194368 00000100:00100000:2.0:1787440150.948777:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701194496 00000100:00100000:2.0:1787440150.948780:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701194496 00000100:00100000:2.0:1787440150.948797:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787440150.948806:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee05d27c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874266701194752:12345-0@lo:400: 00000100:00100000:2.0:1787440150.948878:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee05d27c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874266701194752:12345-0@lo:400: Request processed in 72us (1791us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440150.948885:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787440150.948899:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787440150.948906:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee05d27f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874266701194368:12345-0@lo:400: 00000100:00100000:2.0:1787440150.948935:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee05d27f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874266701194368:12345-0@lo:400: Request processed in 30us (1794us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440150.948941:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787440150.948952:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787440150.948959:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee05d27ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1874266701194496:12345-0@lo:400: 00000100:00100000:2.0:1787440150.949012:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee05d27ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1874266701194496:12345-0@lo:400: Request processed in 54us (1772us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440150.949018:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787440150.949046:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701194880 00000100:00100000:2.0:1787440150.949050:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701194880 00000100:00100000:2.0:1787440150.949079:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701194624 00000100:00100000:2.0:1787440150.949082:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701194624 00000100:00100000:2.0:1787440150.949096:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787440150.949101:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee05d27c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1874266701194880:12345-0@lo:400: 00000100:00100000:2.0:1787440150.949134:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee05d27c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1874266701194880:12345-0@lo:400: Request processed in 33us (1950us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440150.949140:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787440150.949151:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787440150.949157:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee050482680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1874266701194624:12345-0@lo:400: 00000100:00100000:2.0:1787440150.949184:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee050482680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1874266701194624:12345-0@lo:400: Request processed in 27us (1881us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440150.949190:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787440150.949248:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee05d27fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874266701194368:0@lo:400: 00010000:00080000:2.0:1787440150.949264:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ee05d27e680 x1874266701194880/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787440166 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787440150.949276:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee05d27e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874266701194880:0@lo:400: 00000100:00100000:2.0:1787440150.949287:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee05d27e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:168176ea-29d1-49de-a254-317e90d54802:3311:1874266701194240:0@lo:400: 00000100:00100000:2.0:1787440150.949296:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee05d27c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1874266701194752:0@lo:400: 00010000:00080000:2.0:1787440150.949339:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ee05d27ea00 x1874266701194624/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787440166 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787440150.949374:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee05d27ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874266701194624:0@lo:400: 00000100:00100000:2.0:1787440150.949390:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee05d27df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1874266701194496:0@lo:400: 00000100:00080000:3.0:1787440150.950271:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787440150.950280:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000080:1.0:1787440151.050589:0:8443:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd522e0f90 20000000:00000080:1.0:1787440151.050612:0:8443:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8ee0773f4c00 uarg=0000000000000000 20000000:01000000:1.0:1787440151.050812:0:8443:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:1.0:1787440151.050815:0:8443:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:1.0:1787440151.050819:0:8443:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:1.0:1787440151.050825:0:8443:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:1.0:1787440151.050831:0:8443:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:1.0:1787440151.050851:0:8443:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1787440151.050854:0:8443:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1787440151.051206:0:8443:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1787440151.051209:0:8443:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1787440151.052960:0:8444:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:1.0:1787440151.054145:0:8443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:1.0:1787440151.054233:0:8443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:1.0:1787440151.054275:0:8443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:1.0:1787440151.054290:0:8443:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1787440151.054294:0:8443:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1787440151.055447:0:8445:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:1.0:1787440151.056264:0:8443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:1.0:1787440151.056321:0:8443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:1.0:1787440151.056374:0:8443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:1.0:1787440151.056390:0:8443:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1787440151.056394:0:8443:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1787440151.061455:0:8446:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:3.0:1787440151.062286:0:8443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:3.0:1787440151.062366:0:8443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:3.0:1787440151.062425:0:8443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:3.0:1787440151.062445:0:8443:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1787440151.062448:0:8443:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1787440151.064300:0:8447:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:2.0:1787440151.065174:0:8443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:2.0:1787440151.065256:0:8443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:2.0:1787440151.065294:0:8443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 10000000:01000000:2.0:1787440151.065316:0:8443:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1787440151.065352:0:8443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8ee07f86fc00/0x85f5fa77adf3c27d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440151.065376:0:8443:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ee041664a00/0x85f5fa77adf3c17a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f5fa77adf3c173 expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440151.065385:0:8443:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ee040031200/0x85f5fa77adf3c1a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f5fa77adf3c19d expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440151.065391:0:8443:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ee040031600/0x85f5fa77adf3c1ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f5fa77adf3c1c7 expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440151.065397:0:8443:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ee041664e00/0x85f5fa77adf3c1dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f5fa77adf3c1d5 expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440151.065404:0:8443:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ee040030800/0x85f5fa77adf3c1ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f5fa77adf3c1e3 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440151.065411:0:8443:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ee07f86e400/0x85f5fa77adf3c206 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f5fa77adf3c1ff expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440151.065418:0:8443:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ee040030400/0x85f5fa77adf3c230 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f5fa77adf3c229 expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440151.065439:0:8443:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ee04cbce000/0x85f5fa77adf3c23e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6201f expref: 9 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440151.065446:0:8443:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ee07f86ee00/0x85f5fa77adf3c245 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62026 expref: 9 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440151.065453:0:8443:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8ee07f86fc00/0x85f5fa77adf3c27d lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440151.065667:0:8443:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ee07f86ee00/0x85f5fa77adf3c245 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62026 expref: 9 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440151.065933:0:8443:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ee07f86ee00/0x85f5fa77adf3c245 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62026 expref: 9 pid: 5843 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440151.065953:0:8443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee05d27df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8443:1874266701195008:192.168.206.58@tcp:104: 00010000:00010000:2.0:1787440151.066203:0:8443:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ee04cbce000/0x85f5fa77adf3c23e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6201f expref: 9 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440151.066213:0:8443:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ee04cbce000/0x85f5fa77adf3c23e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6201f expref: 9 pid: 5844 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440151.066222:0:8443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee05d27ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8443:1874266701195136:192.168.206.58@tcp:104: 00010000:00010000:2.0:1787440151.066257:0:8443:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ee040030400/0x85f5fa77adf3c230 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x85f5fa77adf3c229 expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440151.066266:0:8443:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ee040030400/0x85f5fa77adf3c230 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x85f5fa77adf3c229 expref: 18 pid: 5842 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440151.066290:0:8443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee05d27c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8443:1874266701195264:0@lo:104: 00000100:00100000:2.0:1787440151.066339:0:8443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787440151.066405:0:8443:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ee07f86e400/0x85f5fa77adf3c206 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x85f5fa77adf3c1ff expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440151.066415:0:8443:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ee07f86e400/0x85f5fa77adf3c206 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x85f5fa77adf3c1ff expref: 18 pid: 5844 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440151.066423:0:8443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee05d27e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8443:1874266701195392:0@lo:104: 00000100:00100000:2.0:1787440151.066450:0:8443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787440151.066617:0:8443:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ee040030800/0x85f5fa77adf3c1ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x85f5fa77adf3c1e3 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440151.066629:0:8443:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ee040030800/0x85f5fa77adf3c1ea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x85f5fa77adf3c1e3 expref: 18 pid: 5844 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440151.066637:0:8443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee05d27fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8443:1874266701195520:0@lo:104: 00010000:00010000:2.0:1787440151.066664:0:8443:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ee041664e00/0x85f5fa77adf3c1dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x85f5fa77adf3c1d5 expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440151.066671:0:8443:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ee041664e00/0x85f5fa77adf3c1dc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x85f5fa77adf3c1d5 expref: 18 pid: 5843 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440151.066679:0:8443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee049047800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8443:1874266701195648:0@lo:104: 00010000:00010000:2.0:1787440151.066720:0:8443:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ee040031600/0x85f5fa77adf3c1ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x85f5fa77adf3c1c7 expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440151.066728:0:8443:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ee040031600/0x85f5fa77adf3c1ce lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x85f5fa77adf3c1c7 expref: 18 pid: 5842 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440151.066747:0:8443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee049044380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8443:1874266701195776:0@lo:104: 00010000:00010000:2.0:1787440151.066775:0:8443:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ee040031200/0x85f5fa77adf3c1a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x85f5fa77adf3c19d expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440151.066784:0:8443:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ee040031200/0x85f5fa77adf3c1a4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x85f5fa77adf3c19d expref: 18 pid: 5844 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440151.066792:0:8443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee049047480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8443:1874266701195904:0@lo:104: 00010000:00010000:2.0:1787440151.066817:0:8443:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ee041664a00/0x85f5fa77adf3c17a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x85f5fa77adf3c173 expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440151.066826:0:8443:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ee041664a00/0x85f5fa77adf3c17a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x85f5fa77adf3c173 expref: 18 pid: 5842 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440151.066834:0:8443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee049046680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8443:1874266701196032:0@lo:104: 00000100:00100000:2.0:1787440151.066858:0:8443:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee047f96cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787440151.067790:0:5833:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/3 left), rc = 0 00000100:00100000:0.0:1787440151.067824:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440151.067841:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440151.067850:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440151.067860:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440151.067870:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440151.067883:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701195264 00000100:00100000:0.0:1787440151.067891:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701195264 00000100:00100000:0.0:1787440151.067940:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701195392 00000100:00100000:0.0:1787440151.067943:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701195392 00000100:00100000:0.0:1787440151.067956:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701195520 00000100:00100000:0.0:1787440151.067958:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701195520 00000100:00100000:0.0:1787440151.067967:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701195648 00000100:00100000:0.0:1787440151.067969:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701195648 00000100:00100000:0.0:1787440151.067978:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701195776 00000100:00100000:0.0:1787440151.067980:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701195776 00000100:00100000:0.0:1787440151.067989:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701195904 00000100:00100000:0.0:1787440151.067991:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701195904 00000100:00100000:0.0:1787440151.068000:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701196032 00000100:00100000:0.0:1787440151.068002:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701196032 00000100:00100000:0.0:1787440151.068015:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787440151.068024:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee05d27e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:168176ea-29d1-49de-a254-317e90d54802+9:8443:x1874266701195264:12345-0@lo:104: 00000100:00100000:1.0:1787440151.068095:0:5832:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1787440151.068103:0:5832:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:2.0:1787440151.068176:0:5832:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00010000:00010000:0.0:1787440151.068360:0:5833:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.158@tcp lock: ffff8ee07f86f600/0x85f5fa77adf3c229 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x85f5fa77adf3c230 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440151.068442:0:5833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787440151.068450:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee05d27e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:168176ea-29d1-49de-a254-317e90d54802+9:8443:x1874266701195264:12345-0@lo:104: Request processed in 427us (2111us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440151.068458:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787440151.068515:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787440151.068523:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04caf3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:168176ea-29d1-49de-a254-317e90d54802+8:8443:x1874266701195392:12345-0@lo:104: 00010000:00010000:0.0:1787440151.068532:0:5833:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.158@tcp lock: ffff8ee07f86f000/0x85f5fa77adf3c1ff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x85f5fa77adf3c206 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440151.068567:0:5833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787440151.068571:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04caf3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:168176ea-29d1-49de-a254-317e90d54802+8:8443:x1874266701195392:12345-0@lo:104: Request processed in 51us (2121us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440151.068578:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787440151.068624:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787440151.068631:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee077838000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:168176ea-29d1-49de-a254-317e90d54802+7:8443:x1874266701195520:12345-0@lo:104: 00010000:00010000:0.0:1787440151.068639:0:5833:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.158@tcp lock: ffff8ee059185a00/0x85f5fa77adf3c1e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x85f5fa77adf3c1ea expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440151.068665:0:5833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1787440151.068670:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee077838000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:168176ea-29d1-49de-a254-317e90d54802+7:8443:x1874266701195520:12345-0@lo:104: Request processed in 41us (847us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440151.068676:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787440151.068699:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787440151.068705:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee07783ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:168176ea-29d1-49de-a254-317e90d54802+6:8443:x1874266701195648:12345-0@lo:104: 00010000:00010000:0.0:1787440151.068712:0:5833:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.158@tcp lock: ffff8ee041664200/0x85f5fa77adf3c1d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x85f5fa77adf3c1dc expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440151.068740:0:5833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1787440151.068745:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee07783ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:168176ea-29d1-49de-a254-317e90d54802+6:8443:x1874266701195648:12345-0@lo:104: Request processed in 41us (904us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440151.068751:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787440151.068770:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787440151.068776:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee077839c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:168176ea-29d1-49de-a254-317e90d54802+5:8443:x1874266701195776:12345-0@lo:104: 00010000:00010000:0.0:1787440151.068784:0:5833:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.158@tcp lock: ffff8ee07f86e600/0x85f5fa77adf3c1c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x85f5fa77adf3c1ce expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440151.068810:0:5833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:0.0:1787440151.068815:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee077839c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:168176ea-29d1-49de-a254-317e90d54802+5:8443:x1874266701195776:12345-0@lo:104: Request processed in 40us (964us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440151.068821:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787440151.068832:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787440151.068838:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee077839880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:168176ea-29d1-49de-a254-317e90d54802+4:8443:x1874266701195904:12345-0@lo:104: 00010000:00010000:0.0:1787440151.068845:0:5833:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.158@tcp lock: ffff8ee07f86ec00/0x85f5fa77adf3c19d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x85f5fa77adf3c1a4 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440151.068871:0:5833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:0.0:1787440151.068876:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee077839880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:168176ea-29d1-49de-a254-317e90d54802+4:8443:x1874266701195904:12345-0@lo:104: Request processed in 39us (1015us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440151.068882:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787440151.068893:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787440151.068898:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee07783b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:168176ea-29d1-49de-a254-317e90d54802+3:8443:x1874266701196032:12345-0@lo:104: 00010000:00010000:0.0:1787440151.068905:0:5833:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.158@tcp lock: ffff8ee059185600/0x85f5fa77adf3c173 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x85f5fa77adf3c17a expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440151.068934:0:5833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:0.0:1787440151.068938:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee07783b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:168176ea-29d1-49de-a254-317e90d54802+3:8443:x1874266701196032:12345-0@lo:104: Request processed in 40us (1068us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440151.068943:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:0.0:1787440151.068969:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:0.0:1787440151.068975:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.158@tcp lock: ffff8ee07f86f600/0x85f5fa77adf3c229 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x85f5fa77adf3c230 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440151.068982:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee07f86f600 already unused, calling callback (ffffffffc1bd2c20) 10000000:00010000:0.0:1787440151.068987:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.158@tcp lock: ffff8ee07f86f600/0x85f5fa77adf3c229 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x85f5fa77adf3c230 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440151.068996:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.158@tcp lock: ffff8ee07f86f600/0x85f5fa77adf3c229 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x85f5fa77adf3c230 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787440151.069004:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.158@tcp lock: ffff8ee07f86f600/0x85f5fa77adf3c229 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x85f5fa77adf3c230 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787440151.069011:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787440151.069185:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.158@tcp lock: ffff8ee07f86f600/0x85f5fa77adf3c229 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x85f5fa77adf3c230 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440151.069194:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787440151.069217:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.158@tcp lock: ffff8ee07f86f600/0x85f5fa77adf3c229 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x85f5fa77adf3c230 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440151.069225:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.158@tcp lock: ffff8ee07f86f600/0x85f5fa77adf3c229 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x85f5fa77adf3c230 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440151.069241:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1787440151.069245:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.158@tcp lock: ffff8ee07f86f000/0x85f5fa77adf3c1ff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x85f5fa77adf3c206 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440151.069251:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee07f86f000 already unused, calling callback (ffffffffc1bd2c20) 10000000:00010000:0.0:1787440151.069254:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.158@tcp lock: ffff8ee07f86f000/0x85f5fa77adf3c1ff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x85f5fa77adf3c206 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440151.069267:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.158@tcp lock: ffff8ee07f86f000/0x85f5fa77adf3c1ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x85f5fa77adf3c206 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787440151.069274:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.158@tcp lock: ffff8ee07f86f000/0x85f5fa77adf3c1ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x85f5fa77adf3c206 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787440151.069279:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787440151.069294:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.158@tcp lock: ffff8ee07f86f000/0x85f5fa77adf3c1ff lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x85f5fa77adf3c206 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440151.069300:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787440151.069307:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.158@tcp lock: ffff8ee07f86f000/0x85f5fa77adf3c1ff lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x85f5fa77adf3c206 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440151.069313:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.158@tcp lock: ffff8ee07f86f000/0x85f5fa77adf3c1ff lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x85f5fa77adf3c206 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440151.069321:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1787440151.069324:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.158@tcp lock: ffff8ee059185a00/0x85f5fa77adf3c1e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x85f5fa77adf3c1ea expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440151.069329:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee059185a00 already unused, calling callback (ffffffffc1bd2c20) 10000000:00010000:0.0:1787440151.069331:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.158@tcp lock: ffff8ee059185a00/0x85f5fa77adf3c1e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x85f5fa77adf3c1ea expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440151.069337:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.158@tcp lock: ffff8ee059185a00/0x85f5fa77adf3c1e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x85f5fa77adf3c1ea expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787440151.069619:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.158@tcp lock: ffff8ee059185a00/0x85f5fa77adf3c1e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x85f5fa77adf3c1ea expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787440151.069634:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787440151.069650:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.158@tcp lock: ffff8ee059185a00/0x85f5fa77adf3c1e3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x85f5fa77adf3c1ea expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440151.069657:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787440151.069675:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.158@tcp lock: ffff8ee059185a00/0x85f5fa77adf3c1e3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x85f5fa77adf3c1ea expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440151.069829:0:8443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee05d27c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8443:1874266701195264:0@lo:104: 00000100:00100000:2.0:1787440151.069842:0:8443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee05d27e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8443:1874266701195392:0@lo:104: 00000100:00100000:2.0:1787440151.069850:0:8443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee05d27fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8443:1874266701195520:0@lo:104: 00000100:00100000:2.0:1787440151.069860:0:8443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee049047800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8443:1874266701195648:0@lo:104: 00000100:00100000:2.0:1787440151.069867:0:8443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee049044380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8443:1874266701195776:0@lo:104: 00000100:00100000:2.0:1787440151.069876:0:8443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee049047480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8443:1874266701195904:0@lo:104: 00000100:00100000:2.0:1787440151.069893:0:8443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee049046680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8443:1874266701196032:0@lo:104: 00010000:00010000:0.0:1787440151.069984:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.158@tcp lock: ffff8ee059185a00/0x85f5fa77adf3c1e3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x85f5fa77adf3c1ea expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440151.069997:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1787440151.070001:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.158@tcp lock: ffff8ee041664200/0x85f5fa77adf3c1d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x85f5fa77adf3c1dc expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440151.070007:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee041664200 already unused, calling callback (ffffffffc1bd2c20) 10000000:00010000:0.0:1787440151.070010:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.158@tcp lock: ffff8ee041664200/0x85f5fa77adf3c1d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x85f5fa77adf3c1dc expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440151.070018:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.158@tcp lock: ffff8ee041664200/0x85f5fa77adf3c1d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x85f5fa77adf3c1dc expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787440151.070077:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.158@tcp lock: ffff8ee041664200/0x85f5fa77adf3c1d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x85f5fa77adf3c1dc expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787440151.070082:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787440151.070110:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.158@tcp lock: ffff8ee041664200/0x85f5fa77adf3c1d5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x85f5fa77adf3c1dc expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440151.070116:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787440151.070130:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.158@tcp lock: ffff8ee041664200/0x85f5fa77adf3c1d5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x85f5fa77adf3c1dc expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440151.070135:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.158@tcp lock: ffff8ee041664200/0x85f5fa77adf3c1d5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x85f5fa77adf3c1dc expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440151.070145:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787440151.070148:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.158@tcp lock: ffff8ee07f86e600/0x85f5fa77adf3c1c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x85f5fa77adf3c1ce expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440151.070154:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee07f86e600 already unused, calling callback (ffffffffc1bd2c20) 10000000:00010000:0.0:1787440151.070156:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.158@tcp lock: ffff8ee07f86e600/0x85f5fa77adf3c1c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x85f5fa77adf3c1ce expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440151.070162:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.158@tcp lock: ffff8ee07f86e600/0x85f5fa77adf3c1c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x85f5fa77adf3c1ce expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787440151.070167:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.158@tcp lock: ffff8ee07f86e600/0x85f5fa77adf3c1c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x85f5fa77adf3c1ce expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787440151.070172:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787440151.070186:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.158@tcp lock: ffff8ee07f86e600/0x85f5fa77adf3c1c7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x85f5fa77adf3c1ce expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440151.070192:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787440151.070196:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.158@tcp lock: ffff8ee07f86e600/0x85f5fa77adf3c1c7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x85f5fa77adf3c1ce expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440151.070202:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.158@tcp lock: ffff8ee07f86e600/0x85f5fa77adf3c1c7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x85f5fa77adf3c1ce expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440151.070213:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787440151.070222:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.158@tcp lock: ffff8ee07f86ec00/0x85f5fa77adf3c19d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x85f5fa77adf3c1a4 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440151.070227:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee07f86ec00 already unused, calling callback (ffffffffc1bd2c20) 10000000:00010000:0.0:1787440151.070229:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.158@tcp lock: ffff8ee07f86ec00/0x85f5fa77adf3c19d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x85f5fa77adf3c1a4 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440151.070237:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.158@tcp lock: ffff8ee07f86ec00/0x85f5fa77adf3c19d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x85f5fa77adf3c1a4 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787440151.070243:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.158@tcp lock: ffff8ee07f86ec00/0x85f5fa77adf3c19d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x85f5fa77adf3c1a4 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787440151.070249:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787440151.070280:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.158@tcp lock: ffff8ee07f86ec00/0x85f5fa77adf3c19d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x85f5fa77adf3c1a4 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440151.070286:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787440151.070290:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.158@tcp lock: ffff8ee07f86ec00/0x85f5fa77adf3c19d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x85f5fa77adf3c1a4 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440151.070297:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.158@tcp lock: ffff8ee07f86ec00/0x85f5fa77adf3c19d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x85f5fa77adf3c1a4 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440151.070306:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787440151.070309:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.158@tcp lock: ffff8ee059185600/0x85f5fa77adf3c173 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x85f5fa77adf3c17a expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440151.070315:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee059185600 already unused, calling callback (ffffffffc1bd2c20) 10000000:00010000:0.0:1787440151.070448:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.158@tcp lock: ffff8ee059185600/0x85f5fa77adf3c173 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x85f5fa77adf3c17a expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440151.070467:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.158@tcp lock: ffff8ee059185600/0x85f5fa77adf3c173 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x85f5fa77adf3c17a expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787440151.070474:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.158@tcp lock: ffff8ee059185600/0x85f5fa77adf3c173 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x85f5fa77adf3c17a expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787440151.070480:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787440151.070639:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.158@tcp lock: ffff8ee059185600/0x85f5fa77adf3c173 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x85f5fa77adf3c17a expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440151.070646:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787440151.070652:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.158@tcp lock: ffff8ee059185600/0x85f5fa77adf3c173 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x85f5fa77adf3c17a expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440151.070658:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.158@tcp lock: ffff8ee059185600/0x85f5fa77adf3c173 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x85f5fa77adf3c17a expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440151.070673:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787440151.070675:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787440151.070677:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787440151.070809:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787440151.070828:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee07783a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:168176ea-29d1-49de-a254-317e90d54802:3309:1874266701196160:0@lo:103: 00000100:00100000:0.0:1787440151.070898:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440151.070981:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee05d27e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:168176ea-29d1-49de-a254-317e90d54802:3309:1874266701196672:0@lo:103: 00000100:00100000:0.0:1787440151.071004:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440151.071387:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1787440151.071395:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee077838e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:168176ea-29d1-49de-a254-317e90d54802:3309:1874266701196288:0@lo:103: 00000100:00100000:0.0:1787440151.071421:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440151.071479:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701196160 00000100:00100000:2.0:1787440151.071513:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701196160 00010000:00010000:2.0:1787440151.071551:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ee040030400/0x85f5fa77adf3c230 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x85f5fa77adf3c229 expref: 19 pid: 5842 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440151.071580:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701196672 00000100:00100000:2.0:1787440151.071584:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701196672 00010000:00010000:2.0:1787440151.071597:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ee040031600/0x85f5fa77adf3c1ce lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x85f5fa77adf3c1c7 expref: 20 pid: 5842 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440151.071617:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787440151.071626:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee080b06680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:168176ea-29d1-49de-a254-317e90d54802+20:3309:x1874266701196160:12345-0@lo:103: 00010000:00010000:2.0:1787440151.071641:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787440151.071647:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ee040030400/0x85f5fa77adf3c230 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x85f5fa77adf3c229 expref: 20 pid: 5842 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440151.071658:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ee040030400/0x85f5fa77adf3c230 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x85f5fa77adf3c229 expref: 20 pid: 5842 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440151.071675:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ee040030400/0x85f5fa77adf3c230 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x85f5fa77adf3c229 expref: 20 pid: 5842 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440151.071705:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787440151.071741:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee080b06680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:168176ea-29d1-49de-a254-317e90d54802+19:3309:x1874266701196160:12345-0@lo:103: Request processed in 116us (842us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440151.071749:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787440151.071770:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787440151.071776:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee080b04380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:168176ea-29d1-49de-a254-317e90d54802+18:3309:x1874266701196672:12345-0@lo:103: 00010000:00010000:2.0:1787440151.071784:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787440151.071788:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ee040031600/0x85f5fa77adf3c1ce lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x85f5fa77adf3c1c7 expref: 18 pid: 5842 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440151.071807:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ee040031600/0x85f5fa77adf3c1ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x85f5fa77adf3c1c7 expref: 18 pid: 5842 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440151.071818:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ee040031600/0x85f5fa77adf3c1ce lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x85f5fa77adf3c1c7 expref: 18 pid: 5842 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440151.071828:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787440151.071852:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee080b04380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:168176ea-29d1-49de-a254-317e90d54802+17:3309:x1874266701196672:12345-0@lo:103: Request processed in 77us (847us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440151.071858:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787440151.072058:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee080b06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:168176ea-29d1-49de-a254-317e90d54802:3309:1874266701196800:0@lo:103: 00000100:00100000:0.0:1787440151.072084:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440151.072116:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee07783a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:168176ea-29d1-49de-a254-317e90d54802:3309:1874266701196160:0@lo:103: 00000100:00100000:0.0:1787440151.072124:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee05d27e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:168176ea-29d1-49de-a254-317e90d54802:3309:1874266701196672:0@lo:103: 00000100:00100000:0.0:1787440151.072162:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee077839180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:168176ea-29d1-49de-a254-317e90d54802:3311:1874266701196416:0@lo:103: 00000100:00100000:0.0:1787440151.072185:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440151.072202:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee080b04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:168176ea-29d1-49de-a254-317e90d54802:3311:1874266701196928:0@lo:103: 00000100:00100000:0.0:1787440151.072221:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440151.072236:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787440151.072241:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee077838a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:168176ea-29d1-49de-a254-317e90d54802:3311:1874266701196544:0@lo:103: 00000100:00100000:0.0:1787440151.072264:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440151.072289:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701196288 00000100:00100000:0.0:1787440151.072293:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701196288 00010000:00010000:0.0:1787440151.072311:0:6711:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ee07f86e400/0x85f5fa77adf3c206 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x85f5fa77adf3c1ff expref: 17 pid: 5844 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440151.072326:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701196800 00000100:00100000:0.0:1787440151.072328:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701196800 00010000:00010000:0.0:1787440151.072350:0:6711:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ee040031200/0x85f5fa77adf3c1a4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x85f5fa77adf3c19d expref: 18 pid: 5844 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440151.072360:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701196416 00000100:00100000:0.0:1787440151.072363:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701196416 00010000:00010000:0.0:1787440151.072374:0:6711:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ee040030800/0x85f5fa77adf3c1ea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x85f5fa77adf3c1e3 expref: 19 pid: 5844 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440151.072383:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701196928 00000100:00100000:0.0:1787440151.072385:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701196928 00010000:00010000:0.0:1787440151.072403:0:6711:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ee041664a00/0x85f5fa77adf3c17a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x85f5fa77adf3c173 expref: 20 pid: 5842 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440151.072413:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701196544 00000100:00100000:0.0:1787440151.072416:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701196544 00010000:00010000:0.0:1787440151.072425:0:6711:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ee041664e00/0x85f5fa77adf3c1dc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x85f5fa77adf3c1d5 expref: 21 pid: 5843 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440151.072435:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787440151.072441:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee080b07800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:168176ea-29d1-49de-a254-317e90d54802+21:3309:x1874266701196288:12345-0@lo:103: 00010000:00010000:0.0:1787440151.072448:0:6711:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787440151.072453:0:6711:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ee07f86e400/0x85f5fa77adf3c206 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x85f5fa77adf3c1ff expref: 21 pid: 5844 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440151.072462:0:6711:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ee07f86e400/0x85f5fa77adf3c206 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x85f5fa77adf3c1ff expref: 21 pid: 5844 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440151.072474:0:6711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ee07f86e400/0x85f5fa77adf3c206 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x85f5fa77adf3c1ff expref: 21 pid: 5844 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440151.072485:0:6711:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787440151.072537:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee080b07800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:168176ea-29d1-49de-a254-317e90d54802+20:3309:x1874266701196288:12345-0@lo:103: Request processed in 96us (1115us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440151.072544:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787440151.072558:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787440151.072564:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee080b04000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:168176ea-29d1-49de-a254-317e90d54802+19:3309:x1874266701196800:12345-0@lo:103: 00010000:00010000:0.0:1787440151.072571:0:6711:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787440151.072575:0:6711:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ee040031200/0x85f5fa77adf3c1a4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x85f5fa77adf3c19d expref: 19 pid: 5844 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440151.072594:0:6711:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ee040031200/0x85f5fa77adf3c1a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x85f5fa77adf3c19d expref: 19 pid: 5844 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440151.072603:0:6711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ee040031200/0x85f5fa77adf3c1a4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x85f5fa77adf3c19d expref: 19 pid: 5844 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440151.072612:0:6711:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787440151.072637:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee080b04000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:168176ea-29d1-49de-a254-317e90d54802+18:3309:x1874266701196800:12345-0@lo:103: Request processed in 73us (552us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440151.072643:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787440151.072657:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787440151.072662:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee080b06d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:168176ea-29d1-49de-a254-317e90d54802+17:3311:x1874266701196416:12345-0@lo:103: 00010000:00010000:0.0:1787440151.072670:0:6711:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787440151.072674:0:6711:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ee040030800/0x85f5fa77adf3c1ea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x85f5fa77adf3c1e3 expref: 17 pid: 5844 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440151.072855:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787440151.072863:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee080b05c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:168176ea-29d1-49de-a254-317e90d54802+17:3311:x1874266701196928:12345-0@lo:103: 00010000:00010000:2.0:1787440151.072872:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787440151.072877:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ee041664a00/0x85f5fa77adf3c17a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x85f5fa77adf3c173 expref: 17 pid: 5842 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440151.072885:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ee041664a00/0x85f5fa77adf3c17a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x85f5fa77adf3c173 expref: 17 pid: 5842 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440151.072896:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ee041664a00/0x85f5fa77adf3c17a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x85f5fa77adf3c173 expref: 17 pid: 5842 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440151.072905:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787440151.072935:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee080b05c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:168176ea-29d1-49de-a254-317e90d54802+16:3311:x1874266701196928:12345-0@lo:103: Request processed in 73us (712us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440151.072941:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787440151.072956:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787440151.072962:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee06e7e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:168176ea-29d1-49de-a254-317e90d54802+15:3311:x1874266701196544:12345-0@lo:103: 00010000:00010000:2.0:1787440151.072978:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787440151.072983:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ee041664e00/0x85f5fa77adf3c1dc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x85f5fa77adf3c1d5 expref: 15 pid: 5843 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440151.072991:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ee041664e00/0x85f5fa77adf3c1dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x85f5fa77adf3c1d5 expref: 15 pid: 5843 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440151.073001:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ee041664e00/0x85f5fa77adf3c1dc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x85f5fa77adf3c1d5 expref: 15 pid: 5843 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440151.073010:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787440151.073044:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee06e7e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:168176ea-29d1-49de-a254-317e90d54802+14:3311:x1874266701196544:12345-0@lo:103: Request processed in 82us (780us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440151.073050:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:0.0:1787440151.073129:0:6711:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ee040030800/0x85f5fa77adf3c1ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x85f5fa77adf3c1e3 expref: 13 pid: 5844 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440151.073140:0:6711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ee040030800/0x85f5fa77adf3c1ea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x85f5fa77adf3c1e3 expref: 13 pid: 5844 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440151.073150:0:6711:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787440151.073174:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee080b06d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:168176ea-29d1-49de-a254-317e90d54802+12:3311:x1874266701196416:12345-0@lo:103: Request processed in 513us (989us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440151.073180:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787440151.073323:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee077838a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:168176ea-29d1-49de-a254-317e90d54802:3311:1874266701196544:0@lo:103: 00000100:00100000:0.0:1787440151.073333:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee077839180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:168176ea-29d1-49de-a254-317e90d54802:3311:1874266701196416:0@lo:103: 00000100:00100000:0.0:1787440151.073362:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee080b04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:168176ea-29d1-49de-a254-317e90d54802:3311:1874266701196928:0@lo:103: 00000100:00100000:0.0:1787440151.073389:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee077838e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:168176ea-29d1-49de-a254-317e90d54802:3309:1874266701196288:0@lo:103: 00000100:00100000:0.0:1787440151.073397:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee080b06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:168176ea-29d1-49de-a254-317e90d54802:3309:1874266701196800:0@lo:103: 00000100:00100000:2.0:1787440151.074473:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:2.0:1787440151.074546:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:2.0:1787440151.074575:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681250048 00000100:00100000:2.0:1787440151.074584:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681250048 00010000:00010000:2.0:1787440151.074618:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ee04cbce000/0x85f5fa77adf3c23e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6201f expref: 10 pid: 5844 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440151.074646:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681249920 00000100:00100000:2.0:1787440151.074649:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681249920 00010000:00010000:2.0:1787440151.074661:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ee07f86ee00/0x85f5fa77adf3c245 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62026 expref: 11 pid: 5843 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440151.074676:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 19 00000100:00100000:2.0:1787440151.074793:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee049044000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+11:2363:x1874266681250048:12345-192.168.206.58@tcp:103: 00010000:00010000:2.0:1787440151.074808:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787440151.074820:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ee04cbce000/0x85f5fa77adf3c23e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6201f expref: 11 pid: 5844 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440151.074831:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ee04cbce000/0x85f5fa77adf3c23e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6201f expref: 11 pid: 5844 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440151.074851:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787440151.074910:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee049044000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+11:2363:x1874266681250048:12345-192.168.206.58@tcp:103: Request processed in 121us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440151.075085:0:8443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee05d27df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8443:1874266701195008:192.168.206.58@tcp:104: 00010000:00010000:3.0:1787440151.075099:0:8443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ee04cbce000/0x85f5fa77adf3c23e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6201f expref: 11 pid: 5844 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440151.075112:0:8443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee05d27ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8443:1874266701195136:192.168.206.58@tcp:104: 00010000:00010000:3.0:1787440151.075167:0:8443:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8ee07f86fc00/0x85f5fa77adf3c27d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440151.075705:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 20 00000100:00100000:0.0:1787440151.075722:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee080325f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+10:2363:x1874266681249920:12345-192.168.206.58@tcp:103: 00010000:00010000:0.0:1787440151.075736:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787440151.075742:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ee07f86ee00/0x85f5fa77adf3c245 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62026 expref: 10 pid: 5843 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440151.075754:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ee07f86ee00/0x85f5fa77adf3c245 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62026 expref: 10 pid: 5843 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440151.075768:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ee07f86ee00/0x85f5fa77adf3c245 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62026 expref: 10 pid: 5843 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440151.075785:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8ee07f86fc00/0x85f5fa77adf3c27d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440151.075794:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ee07f86fc00/0x85f5fa77adf3c27d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440151.075811:0:5834:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ee07f86fc00/0x85f5fa77adf3c27d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440151.075819:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ee07f86fc00/0x85f5fa77adf3c27d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440151.075826:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8ee07f86fc00/0x85f5fa77adf3c27d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440151.075842:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8ee07f86fc00/0x85f5fa77adf3c27d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440151.075848:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee07f86fc00 already unused, calling callback (ffffffffc15b52a0) 00010000:00010000:0.0:1787440151.075853:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8ee07f86fc00/0x85f5fa77adf3c27d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440151.075861:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8ee07f86fc00/0x85f5fa77adf3c27d lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440151.075883:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8ee07f86fc00/0x85f5fa77adf3c27d lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440151.075893:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787440151.075929:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee080325f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+9:2363:x1874266681249920:12345-192.168.206.58@tcp:103: Request processed in 214us (1382us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440151.075937:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 20 00010000:00010000:3.0:1787440151.076662:0:8443:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8ee07f86fc00/0x85f5fa77adf3c27d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440151.076674:0:8443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8ee07f86fc00/0x85f5fa77adf3c27d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440151.076681:0:8443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ee07f86fc00/0x85f5fa77adf3c27d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440151.089150:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 19 00000100:00100000:0.0:1787440151.452821:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee080b06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1874266701197056:0@lo:13: 00000100:00100000:0.0:1787440151.453623:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440151.455372:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701197056 00000100:00100000:3.0:1787440151.455390:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701197056 00000100:00100000:3.0:1787440151.455563:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787440151.455578:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee080b04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874266701197056:12345-0@lo:13: 00002000:00000024:3.0:1787440151.455637:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787440151.455768:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee080b04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874266701197056:12345-0@lo:13: Request processed in 193us (2146us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440151.455777:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:1.0:1787440151.455899:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ee080b06a00 x1874266701197056/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787440167 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787440151.455928:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee080b06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1874266701197056:0@lo:13: 00010000:00010000:0.0:1787440151.645110:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787440152.126678:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440152.126723:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440152.126775:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440152.126799:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440152.126846:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681250560 00000100:00100000:3.0:1787440152.126854:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681250560 00000100:00100000:0.0:1787440152.126972:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681250432 00000100:00100000:0.0:1787440152.126978:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681250432 00000100:00100000:0.0:1787440152.127037:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 13 00000100:00100000:0.0:1787440152.127048:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee05fb63b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+5:2363:x1874266681250432:12345-192.168.206.58@tcp:400: 00000100:00100000:0.0:1787440152.127120:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee05fb63b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+5:2363:x1874266681250432:12345-192.168.206.58@tcp:400: Request processed in 74us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440152.127128:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 13 00000100:00100000:0.0:1787440152.127163:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681250176 00000100:00100000:0.0:1787440152.127179:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681250176 00000100:00100000:0.0:1787440152.127217:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 132 00000100:00100000:0.0:1787440152.127224:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04ca1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+8:2363:x1874266681250176:12345-192.168.206.58@tcp:400: 00000100:00100000:0.0:1787440152.127251:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04ca1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+8:2363:x1874266681250176:12345-192.168.206.58@tcp:400: Request processed in 27us (475us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440152.127258:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 132 00000100:00080000:0.0:1787440152.127406:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787440152.127676:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 14 00000100:00100000:3.0:1787440152.127687:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee05fb60e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+5:2363:x1874266681250560:12345-192.168.206.58@tcp:400: 00000100:00100000:3.0:1787440152.127724:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee05fb60e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+5:2363:x1874266681250560:12345-192.168.206.58@tcp:400: Request processed in 39us (1000us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440152.127731:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 14 00000100:00100000:2.0:1787440152.128521:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681250304 00000100:00100000:2.0:1787440152.128531:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681250304 00000100:00100000:2.0:1787440152.128588:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 27 00000100:00100000:2.0:1787440152.128597:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee05fb61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+6:2363:x1874266681250304:12345-192.168.206.58@tcp:400: 00000100:00100000:2.0:1787440152.128645:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee05fb61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+6:2363:x1874266681250304:12345-192.168.206.58@tcp:400: Request processed in 50us (1982us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440152.128651:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 27 00000100:00080000:0.0:1787440152.128832:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787440152.128836:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1787440152.668883:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787440152.989352:0:5847:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787440152.989362:0:5847:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8ee06db91000 from 39 10000000:01000000:2.0:1787440152.989369:0:5847:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787440152.989439:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.158@tcp lock: ffff8ee07f86fa00/0x85f5fa77adf3c284 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440152.989453:0:5847:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.158@tcp lock: ffff8ee07f86fa00/0x85f5fa77adf3c284 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440152.989466:0:5847:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.158@tcp lock: ffff8ee07f86fa00/0x85f5fa77adf3c284 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440152.989577:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee080326a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:168176ea-29d1-49de-a254-317e90d54802:5847:1874266701197184:0@lo:101: 00000100:00100000:2.0:1787440152.989679:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440152.990546:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee047f96840 going to sleep for 11 seconds 00000100:00100000:3.0:1787440152.992563:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701197184 00000100:00100000:3.0:1787440152.992578:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701197184 00000100:00100000:3.0:1787440152.992629:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1787440152.992639:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04ca1dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:168176ea-29d1-49de-a254-317e90d54802+12:5847:x1874266701197184:12345-0@lo:101: 00010000:00010000:3.0:1787440152.992655:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440152.992675:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ee041664400/0x85f5fa77adf3c28b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x85f5fa77adf3c284 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440152.992701:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ee041664400/0x85f5fa77adf3c28b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x85f5fa77adf3c284 expref: 13 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440152.992732:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ee041664400/0x85f5fa77adf3c28b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f5fa77adf3c284 expref: 13 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440152.992742:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee041664400, rc 0) 00000100:00100000:3.0:1787440152.992821:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04ca1dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:168176ea-29d1-49de-a254-317e90d54802+13:5847:x1874266701197184:12345-0@lo:101: Request processed in 184us (3142us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440152.992828:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1787440152.997664:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee080326a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:168176ea-29d1-49de-a254-317e90d54802:5847:1874266701197184:0@lo:101: 00010000:00010000:2.0:1787440152.997708:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.158@tcp lock: ffff8ee07f86fa00/0x85f5fa77adf3c284 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3c28b expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440152.997725:0:5847:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.158@tcp lock: ffff8ee07f86fa00/0x85f5fa77adf3c284 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x85f5fa77adf3c28b expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440152.997838:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee080326a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:168176ea-29d1-49de-a254-317e90d54802:5847:1874266701197312:0@lo:501: 00000100:00100000:2.0:1787440152.997919:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440152.997989:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee047f96840 going to sleep for 11 seconds 00000100:00100000:0.0:1787440153.000163:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701197312 00000100:00100000:0.0:1787440153.000183:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701197312 00000100:00100000:0.0:1787440153.000272:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1787440153.000285:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04ca1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:168176ea-29d1-49de-a254-317e90d54802+13:5847:x1874266701197312:12345-0@lo:501: 00000100:00100000:0.0:1787440153.003071:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04ca1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:168176ea-29d1-49de-a254-317e90d54802+13:5847:x1874266701197312:12345-0@lo:501: Request processed in 2762us (5126us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440153.003088:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1787440153.005623:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee080326a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:168176ea-29d1-49de-a254-317e90d54802:5847:1874266701197312:0@lo:501: 00000100:00100000:2.0:1787440153.005729:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee080326a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:168176ea-29d1-49de-a254-317e90d54802:5847:1874266701197440:0@lo:503: 00000100:00100000:2.0:1787440153.005868:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440153.005931:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee047f96840 going to sleep for 11 seconds 00000100:00100000:1.0:1787440153.006084:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701197440 00000100:00100000:1.0:1787440153.006099:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701197440 00000100:00100000:1.0:1787440153.006171:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1787440153.006180:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04ca1c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:168176ea-29d1-49de-a254-317e90d54802+13:5847:x1874266701197440:12345-0@lo:503: 00000100:00100000:1.0:1787440153.006423:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04ca1c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:168176ea-29d1-49de-a254-317e90d54802+13:5847:x1874266701197440:12345-0@lo:503: Request processed in 244us (558us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440153.006431:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1787440153.007786:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee080326a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:168176ea-29d1-49de-a254-317e90d54802:5847:1874266701197440:0@lo:503: 00000100:00100000:2.0:1787440153.014811:0:8461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee080326a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:168176ea-29d1-49de-a254-317e90d54802:8461:1874266701197568:0@lo:502: 00000100:00100000:2.0:1787440153.014937:0:8461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440153.015091:0:8461:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee047f966c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787440153.020029:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701197568 00000100:00100000:0.0:1787440153.020063:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701197568 00000100:00100000:0.0:1787440153.020146:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1787440153.020159:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04ca1e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:168176ea-29d1-49de-a254-317e90d54802+13:8461:x1874266701197568:12345-0@lo:502: 00000100:00100000:0.0:1787440153.020611:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04ca1e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:168176ea-29d1-49de-a254-317e90d54802+13:8461:x1874266701197568:12345-0@lo:502: Request processed in 452us (5671us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440153.020620:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1787440153.021013:0:8461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee080326a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:168176ea-29d1-49de-a254-317e90d54802:8461:1874266701197568:0@lo:502: 00000100:00100000:2.0:1787440153.021105:0:8461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee080326a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:168176ea-29d1-49de-a254-317e90d54802:8461:1874266701197696:0@lo:502: 00000100:00100000:2.0:1787440153.021159:0:8461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440153.021204:0:8461:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee047f966c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787440153.021264:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701197696 00000100:00100000:3.0:1787440153.021279:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701197696 00000100:00100000:3.0:1787440153.021361:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1787440153.021383:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04ca1f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:168176ea-29d1-49de-a254-317e90d54802+13:8461:x1874266701197696:12345-0@lo:502: 00000100:00100000:3.0:1787440153.021727:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04ca1f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:168176ea-29d1-49de-a254-317e90d54802+13:8461:x1874266701197696:12345-0@lo:502: Request processed in 355us (568us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440153.021737:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1787440153.021848:0:8461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee080326a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:168176ea-29d1-49de-a254-317e90d54802:8461:1874266701197696:0@lo:502: 00000040:00080000:2.0:1787440153.021885:0:8461:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1787440153.022113:0:5847:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:1.0:1787440153.022146:0:5847:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.158@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787440153.022161:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.158@tcp lock: ffff8ee07f86fa00/0x85f5fa77adf3c284 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3c28b expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440153.022173:0:5847:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.158@tcp lock: ffff8ee07f86fa00/0x85f5fa77adf3c284 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3c28b expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787440153.022184:0:5847:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:1.0:1787440153.022187:0:5847:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:1.0:1787440153.022190:0:5847:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1787440153.022225:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.158@tcp lock: ffff8ee059185400/0x85f5fa77adf3c292 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440153.022234:0:5847:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.158@tcp lock: ffff8ee059185400/0x85f5fa77adf3c292 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440153.022256:0:5847:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.158@tcp lock: ffff8ee059185400/0x85f5fa77adf3c292 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440153.022272:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee047a21500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:168176ea-29d1-49de-a254-317e90d54802:5847:1874266701197824:0@lo:101: 00000100:00100000:1.0:1787440153.022317:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440153.022361:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee0460eb180 going to sleep for 11 seconds 00000100:00100000:0.0:1787440153.022584:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701197824 00000100:00100000:0.0:1787440153.022593:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701197824 00000100:00100000:0.0:1787440153.022638:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1787440153.022657:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04ca1d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:168176ea-29d1-49de-a254-317e90d54802+13:5847:x1874266701197824:12345-0@lo:101: 00010000:00010000:0.0:1787440153.022670:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440153.022686:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ee04cbcf800/0x85f5fa77adf3c299 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x85f5fa77adf3c292 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440153.022711:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ee04cbcf800/0x85f5fa77adf3c299 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x85f5fa77adf3c292 expref: 14 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440153.022722:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ee04cbcf800/0x85f5fa77adf3c299 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f5fa77adf3c292 expref: 14 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440153.022731:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee04cbcf800, rc 0) 00000100:00100000:0.0:1787440153.022786:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04ca1d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:168176ea-29d1-49de-a254-317e90d54802+14:5847:x1874266701197824:12345-0@lo:101: Request processed in 131us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440153.022793:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1787440153.022864:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee047a21500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:168176ea-29d1-49de-a254-317e90d54802:5847:1874266701197824:0@lo:101: 00010000:00010000:1.0:1787440153.022884:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.158@tcp lock: ffff8ee059185400/0x85f5fa77adf3c292 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3c299 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440153.022895:0:5847:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.158@tcp lock: ffff8ee059185400/0x85f5fa77adf3c292 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x85f5fa77adf3c299 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440153.022959:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee047a21500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:168176ea-29d1-49de-a254-317e90d54802:5847:1874266701197952:0@lo:501: 00000100:00100000:1.0:1787440153.022994:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440153.023025:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee0460eb180 going to sleep for 11 seconds 00000100:00100000:0.0:1787440153.023132:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701197952 00000100:00100000:0.0:1787440153.023140:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701197952 00000100:00100000:0.0:1787440153.023163:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1787440153.023169:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04ca1e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:168176ea-29d1-49de-a254-317e90d54802+14:5847:x1874266701197952:12345-0@lo:501: 00000100:00100000:1.0:1787440153.024999:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04ca1e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:168176ea-29d1-49de-a254-317e90d54802+14:5847:x1874266701197952:12345-0@lo:501: Request processed in 1819us (1993us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440153.025016:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1787440153.025164:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee047a21500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:168176ea-29d1-49de-a254-317e90d54802:5847:1874266701197952:0@lo:501: 00000100:00100000:0.0:1787440153.025232:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee080b06680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:168176ea-29d1-49de-a254-317e90d54802:5847:1874266701198080:0@lo:503: 00000100:00100000:0.0:1787440153.025297:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440153.025384:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee04cbcd9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787440153.033695:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701198080 00000100:00100000:2.0:1787440153.033717:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701198080 00000100:00100000:3.0:1787440153.034139:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1787440153.034153:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04ca1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:168176ea-29d1-49de-a254-317e90d54802+14:5847:x1874266701198080:12345-0@lo:503: 00000100:00100000:3.0:1787440153.034406:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04ca1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:168176ea-29d1-49de-a254-317e90d54802+14:5847:x1874266701198080:12345-0@lo:503: Request processed in 256us (9108us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440153.034415:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1787440153.034474:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee080b06680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:168176ea-29d1-49de-a254-317e90d54802:5847:1874266701198080:0@lo:503: 00000100:00100000:0.0:1787440153.035291:0:8462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee080b06680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:168176ea-29d1-49de-a254-317e90d54802:8462:1874266701198208:0@lo:502: 00000100:00100000:0.0:1787440153.035371:0:8462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440153.035610:0:8462:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee04cbcd900 going to sleep for 11 seconds 00000100:00100000:1.0:1787440153.035685:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701198208 00000100:00100000:1.0:1787440153.035693:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701198208 00000100:00100000:1.0:1787440153.035827:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1787440153.035839:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04ca1f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:168176ea-29d1-49de-a254-317e90d54802+14:8462:x1874266701198208:12345-0@lo:502: 00000100:00100000:1.0:1787440153.036216:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04ca1f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:168176ea-29d1-49de-a254-317e90d54802+14:8462:x1874266701198208:12345-0@lo:502: Request processed in 373us (839us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440153.036228:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1787440153.037898:0:8462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee080b06680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:168176ea-29d1-49de-a254-317e90d54802:8462:1874266701198208:0@lo:502: 00000020:01000000:0.0:1787440153.037960:0:8462:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787440153.037977:0:8462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787440153.037980:0:8462:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1787440153.037987:0:8462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1787440153.038034:0:8462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee080b06680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:168176ea-29d1-49de-a254-317e90d54802:8462:1874266701198336:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787440153.038136:0:8462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440153.038194:0:8462:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee04cbcd900 going to sleep for 11 seconds 00000100:00100000:2.0:1787440153.038216:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701198336 00000100:00100000:2.0:1787440153.038231:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701198336 00000100:00100000:2.0:1787440153.038297:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1787440153.038307:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04ca1f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:168176ea-29d1-49de-a254-317e90d54802+14:8462:x1874266701198336:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787440153.038813:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04ca1f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:168176ea-29d1-49de-a254-317e90d54802+14:8462:x1874266701198336:12345-0@lo:502:llog_process_th.0 Request processed in 506us (677us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440153.038822:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1787440153.039777:0:8462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee080b06680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:168176ea-29d1-49de-a254-317e90d54802:8462:1874266701198336:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787440153.039826:0:8462:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787440153.039836:0:8462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787440153.039838:0:8462:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1787440153.039843:0:8462:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:1.0:1787440153.040150:0:5847:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:1.0:1787440153.040177:0:5847:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.158@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1787440153.040191:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.158@tcp lock: ffff8ee059185400/0x85f5fa77adf3c292 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3c299 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440153.040204:0:5847:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.158@tcp lock: ffff8ee059185400/0x85f5fa77adf3c292 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3c299 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787440153.040216:0:5847:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1787440153.040220:0:5847:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8ee045e4e000 from 39 10000000:01000000:1.0:1787440153.040223:0:5847:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787440153.040265:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.158@tcp lock: ffff8ee059184400/0x85f5fa77adf3c2a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440153.040274:0:5847:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.158@tcp lock: ffff8ee059184400/0x85f5fa77adf3c2a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440153.040285:0:5847:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.158@tcp lock: ffff8ee059184400/0x85f5fa77adf3c2a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440153.040309:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee047a22300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:168176ea-29d1-49de-a254-317e90d54802:5847:1874266701198464:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787440153.040383:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440153.040439:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee0460eb300 going to sleep for 11 seconds 00000100:00100000:3.0:1787440153.040635:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701198464 00000100:00100000:3.0:1787440153.040643:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701198464 00000100:00100000:3.0:1787440153.040703:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1787440153.040714:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04ca1d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:168176ea-29d1-49de-a254-317e90d54802+14:5847:x1874266701198464:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787440153.040740:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440153.040757:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ee041664000/0x85f5fa77adf3c2a7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x85f5fa77adf3c2a0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440153.040803:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ee041664000/0x85f5fa77adf3c2a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x85f5fa77adf3c2a0 expref: 15 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440153.040814:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ee041664000/0x85f5fa77adf3c2a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f5fa77adf3c2a0 expref: 15 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440153.040823:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee041664000, rc 0) 00000100:00100000:3.0:1787440153.040875:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04ca1d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:168176ea-29d1-49de-a254-317e90d54802+15:5847:x1874266701198464:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 164us (492us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440153.040882:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1787440153.041599:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee047a22300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:168176ea-29d1-49de-a254-317e90d54802:5847:1874266701198464:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787440153.041621:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.158@tcp lock: ffff8ee059184400/0x85f5fa77adf3c2a0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3c2a7 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440153.041633:0:5847:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.158@tcp lock: ffff8ee059184400/0x85f5fa77adf3c2a0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x85f5fa77adf3c2a7 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440153.041720:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee047a22300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:168176ea-29d1-49de-a254-317e90d54802:5847:1874266701198592:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787440153.041833:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440153.041871:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee0460eb300 going to sleep for 11 seconds 00000100:00100000:2.0:1787440153.041914:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701198592 00000100:00100000:2.0:1787440153.041928:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701198592 00000100:00100000:2.0:1787440153.041999:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1787440153.042008:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04ca1d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:168176ea-29d1-49de-a254-317e90d54802+15:5847:x1874266701198592:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787440153.042905:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04ca1d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:168176ea-29d1-49de-a254-317e90d54802+15:5847:x1874266701198592:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 896us (1069us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440153.042914:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1787440153.043151:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee047a22300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:168176ea-29d1-49de-a254-317e90d54802:5847:1874266701198592:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787440153.043198:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee047a22300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:168176ea-29d1-49de-a254-317e90d54802:5847:1874266701198720:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787440153.043243:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440153.043271:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee0460eb300 going to sleep for 11 seconds 00000100:00100000:3.0:1787440153.043340:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701198720 00000100:00100000:3.0:1787440153.043355:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701198720 00000100:00100000:3.0:1787440153.043577:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1787440153.043587:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04ca1c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:168176ea-29d1-49de-a254-317e90d54802+15:5847:x1874266701198720:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787440153.043734:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04ca1c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:168176ea-29d1-49de-a254-317e90d54802+15:5847:x1874266701198720:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 149us (490us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440153.043741:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1787440153.044262:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee047a22300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:168176ea-29d1-49de-a254-317e90d54802:5847:1874266701198720:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787440153.046789:0:8463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee080b06680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:168176ea-29d1-49de-a254-317e90d54802:8463:1874266701198848:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787440153.046906:0:8463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440153.046961:0:8463:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee04cbcd840 going to sleep for 11 seconds 00000100:00100000:1.0:1787440153.047092:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701198848 00000100:00100000:1.0:1787440153.047102:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701198848 00000100:00100000:1.0:1787440153.047165:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1787440153.047176:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04ca1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:168176ea-29d1-49de-a254-317e90d54802+15:8463:x1874266701198848:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787440153.047485:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04ca1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:168176ea-29d1-49de-a254-317e90d54802+15:8463:x1874266701198848:12345-0@lo:502:llog_process_th.0 Request processed in 310us (579us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440153.047526:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1787440153.048601:0:8463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee080b06680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:168176ea-29d1-49de-a254-317e90d54802:8463:1874266701198848:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787440153.048691:0:8463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee080b06680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:168176ea-29d1-49de-a254-317e90d54802:8463:1874266701198976:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787440153.048768:0:8463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440153.048800:0:8463:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee045f0e840 going to sleep for 11 seconds 00000100:00100000:1.0:1787440153.048934:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701198976 00000100:00100000:1.0:1787440153.048941:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701198976 00000100:00100000:1.0:1787440153.048995:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1787440153.049006:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04a69a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:168176ea-29d1-49de-a254-317e90d54802+15:8463:x1874266701198976:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787440153.049253:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04a69a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:168176ea-29d1-49de-a254-317e90d54802+15:8463:x1874266701198976:12345-0@lo:502:llog_process_th.0 Request processed in 250us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440153.049261:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1787440153.052683:0:8463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee080b06680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:168176ea-29d1-49de-a254-317e90d54802:8463:1874266701198976:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1787440153.052784:0:8463:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1787440153.053558:0:5847:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1787440153.053594:0:5847:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.158@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787440153.053608:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.158@tcp lock: ffff8ee059184400/0x85f5fa77adf3c2a0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3c2a7 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440153.053621:0:5847:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.158@tcp lock: ffff8ee059184400/0x85f5fa77adf3c2a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3c2a7 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787440153.053632:0:5847:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1787440153.053634:0:5847:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:2.0:1787440153.053638:0:5847:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1787440153.053691:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.158@tcp lock: ffff8ee07f86e000/0x85f5fa77adf3c2ae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440153.053699:0:5847:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.158@tcp lock: ffff8ee07f86e000/0x85f5fa77adf3c2ae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440153.053709:0:5847:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.158@tcp lock: ffff8ee07f86e000/0x85f5fa77adf3c2ae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440153.053733:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee080326a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:168176ea-29d1-49de-a254-317e90d54802:5847:1874266701199104:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787440153.053799:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440153.053854:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee047f960c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787440153.053872:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701199104 00000100:00100000:1.0:1787440153.053884:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701199104 00000100:00100000:1.0:1787440153.053954:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1787440153.053965:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04a69b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:168176ea-29d1-49de-a254-317e90d54802+15:5847:x1874266701199104:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787440153.053982:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440153.054001:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ee059184600/0x85f5fa77adf3c2b5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x85f5fa77adf3c2ae expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440153.054032:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ee059184600/0x85f5fa77adf3c2b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x85f5fa77adf3c2ae expref: 16 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440153.054055:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ee059184600/0x85f5fa77adf3c2b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f5fa77adf3c2ae expref: 16 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440153.054065:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee059184600, rc 0) 00000100:00100000:1.0:1787440153.054133:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04a69b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:168176ea-29d1-49de-a254-317e90d54802+16:5847:x1874266701199104:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 170us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440153.054167:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1787440153.055208:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee080326a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:168176ea-29d1-49de-a254-317e90d54802:5847:1874266701199104:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787440153.055238:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.158@tcp lock: ffff8ee07f86e000/0x85f5fa77adf3c2ae lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3c2b5 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440153.055250:0:5847:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.158@tcp lock: ffff8ee07f86e000/0x85f5fa77adf3c2ae lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x85f5fa77adf3c2b5 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440153.055482:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee047a22300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:168176ea-29d1-49de-a254-317e90d54802:5847:1874266701199232:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787440153.055565:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440153.055612:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee0460ebc00 going to sleep for 11 seconds 00000100:00100000:2.0:1787440153.055650:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701199232 00000100:00100000:2.0:1787440153.055659:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701199232 00000100:00100000:2.0:1787440153.055715:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1787440153.055725:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04a699850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:168176ea-29d1-49de-a254-317e90d54802+16:5847:x1874266701199232:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787440153.055996:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04a699850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:168176ea-29d1-49de-a254-317e90d54802+16:5847:x1874266701199232:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 272us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440153.056004:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1787440153.056555:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee047a22300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:168176ea-29d1-49de-a254-317e90d54802:5847:1874266701199232:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787440153.056602:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee047a22300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:168176ea-29d1-49de-a254-317e90d54802:5847:1874266701199360:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787440153.056663:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440153.056688:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee0460ebc00 going to sleep for 11 seconds 00000100:00100000:1.0:1787440153.056710:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701199360 00000100:00100000:1.0:1787440153.056735:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701199360 00000100:00100000:1.0:1787440153.056778:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1787440153.056787:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04a69a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:168176ea-29d1-49de-a254-317e90d54802+16:5847:x1874266701199360:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787440153.057004:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04a69a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:168176ea-29d1-49de-a254-317e90d54802+16:5847:x1874266701199360:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 216us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440153.057012:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1787440153.057065:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee047a22300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:168176ea-29d1-49de-a254-317e90d54802:5847:1874266701199360:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787440153.057674:0:8464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee047a20000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:168176ea-29d1-49de-a254-317e90d54802:8464:1874266701199488:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787440153.057880:0:8464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440153.057955:0:8464:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee047ed2480 going to sleep for 11 seconds 00000100:00100000:3.0:1787440153.057991:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701199488 00000100:00100000:3.0:1787440153.057997:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701199488 00000100:00100000:3.0:1787440153.058037:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1787440153.058055:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04a698c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:168176ea-29d1-49de-a254-317e90d54802+16:8464:x1874266701199488:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787440153.058298:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04a698c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:168176ea-29d1-49de-a254-317e90d54802+16:8464:x1874266701199488:12345-0@lo:502:llog_process_th.0 Request processed in 243us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440153.058307:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1787440153.058382:0:8464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee047a20000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:168176ea-29d1-49de-a254-317e90d54802:8464:1874266701199488:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787440153.058405:0:8464:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787440153.058414:0:8464:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787440153.058416:0:8464:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1787440153.058422:0:8464:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1787440153.058445:0:8464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee047a20000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:168176ea-29d1-49de-a254-317e90d54802:8464:1874266701199616:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787440153.058478:0:8464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440153.058760:0:8464:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee047ed2480 going to sleep for 11 seconds 00000100:00100000:2.0:1787440153.058899:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701199616 00000100:00100000:2.0:1787440153.058905:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701199616 00000100:00100000:2.0:1787440153.058972:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1787440153.058988:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04a69b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:168176ea-29d1-49de-a254-317e90d54802+16:8464:x1874266701199616:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787440153.059175:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04a69b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:168176ea-29d1-49de-a254-317e90d54802+16:8464:x1874266701199616:12345-0@lo:502:llog_process_th.0 Request processed in 188us (695us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440153.059182:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1787440153.059253:0:8464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee047a20000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:168176ea-29d1-49de-a254-317e90d54802:8464:1874266701199616:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787440153.059272:0:8464:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787440153.059277:0:8464:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787440153.059278:0:8464:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1787440153.059282:0:8464:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:3.0:1787440153.059970:0:5847:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:3.0:1787440153.059992:0:5847:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.158@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1787440153.060003:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.158@tcp lock: ffff8ee07f86e000/0x85f5fa77adf3c2ae lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3c2b5 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440153.060014:0:5847:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.158@tcp lock: ffff8ee07f86e000/0x85f5fa77adf3c2ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3c2b5 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787440153.060025:0:5847:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1787440153.060027:0:5847:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8ee045f41000 from 39 10000000:01000000:3.0:1787440153.060030:0:5847:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787440153.060067:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.158@tcp lock: ffff8ee041665400/0x85f5fa77adf3c2bc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440153.060075:0:5847:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.158@tcp lock: ffff8ee041665400/0x85f5fa77adf3c2bc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440153.060085:0:5847:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.158@tcp lock: ffff8ee041665400/0x85f5fa77adf3c2bc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440153.060103:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee05fb61500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:168176ea-29d1-49de-a254-317e90d54802:5847:1874266701199744:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787440153.060142:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440153.060213:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee077da7240 going to sleep for 11 seconds 00000100:00100000:1.0:1787440153.060254:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701199744 00000100:00100000:1.0:1787440153.060260:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701199744 00000100:00100000:1.0:1787440153.060331:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1787440153.060340:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04a69b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:168176ea-29d1-49de-a254-317e90d54802+16:5847:x1874266701199744:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787440153.060350:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440153.060374:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ee059185600/0x85f5fa77adf3c2c3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x85f5fa77adf3c2bc expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440153.060395:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ee059185600/0x85f5fa77adf3c2c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x85f5fa77adf3c2bc expref: 17 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440153.060405:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ee059185600/0x85f5fa77adf3c2c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f5fa77adf3c2bc expref: 17 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440153.060414:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee059185600, rc 0) 00000100:00100000:1.0:1787440153.060459:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04a69b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:168176ea-29d1-49de-a254-317e90d54802+17:5847:x1874266701199744:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 121us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440153.060466:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1787440153.060571:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee05fb61500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:168176ea-29d1-49de-a254-317e90d54802:5847:1874266701199744:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787440153.060606:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.158@tcp lock: ffff8ee041665400/0x85f5fa77adf3c2bc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3c2c3 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440153.060615:0:5847:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.158@tcp lock: ffff8ee041665400/0x85f5fa77adf3c2bc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x85f5fa77adf3c2c3 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440153.060660:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee080326a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:168176ea-29d1-49de-a254-317e90d54802:5847:1874266701199872:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787440153.060686:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440153.061109:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee047f96f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787440153.061141:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701199872 00000100:00100000:3.0:1787440153.061146:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701199872 00000100:00100000:3.0:1787440153.061169:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1787440153.061176:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04a699450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:168176ea-29d1-49de-a254-317e90d54802+17:5847:x1874266701199872:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787440153.061392:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04a699450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:168176ea-29d1-49de-a254-317e90d54802+17:5847:x1874266701199872:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 216us (704us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440153.061399:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1787440153.061474:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee080326a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:168176ea-29d1-49de-a254-317e90d54802:5847:1874266701199872:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787440153.061499:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee080326a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:168176ea-29d1-49de-a254-317e90d54802:5847:1874266701200000:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787440153.061582:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440153.061609:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee047f96f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787440153.061672:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701200000 00000100:00100000:3.0:1787440153.061677:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701200000 00000100:00100000:3.0:1787440153.061705:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1787440153.061711:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04a699050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:168176ea-29d1-49de-a254-317e90d54802+17:5847:x1874266701200000:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787440153.061856:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04a699050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:168176ea-29d1-49de-a254-317e90d54802+17:5847:x1874266701200000:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 145us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440153.061863:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1787440153.063442:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee080326a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:168176ea-29d1-49de-a254-317e90d54802:5847:1874266701200000:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787440153.070149:0:8465:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee047a20000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:168176ea-29d1-49de-a254-317e90d54802:8465:1874266701200128:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787440153.070238:0:8465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440153.070284:0:8465:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee047ed20c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787440153.071377:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701200128 00000100:00100000:3.0:1787440153.071386:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701200128 00000100:00100000:3.0:1787440153.071439:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1787440153.071449:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04a698050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:168176ea-29d1-49de-a254-317e90d54802+17:8465:x1874266701200128:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787440153.071762:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04a698050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:168176ea-29d1-49de-a254-317e90d54802+17:8465:x1874266701200128:12345-0@lo:502:llog_process_th.0 Request processed in 314us (1523us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440153.071771:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1787440153.076304:0:8465:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee047a20000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:168176ea-29d1-49de-a254-317e90d54802:8465:1874266701200128:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787440153.076567:0:8465:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee080b04380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:168176ea-29d1-49de-a254-317e90d54802:8465:1874266701200256:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787440153.077288:0:8465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440153.077353:0:8465:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee045f0eb40 going to sleep for 11 seconds 00000100:00100000:2.0:1787440153.077650:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701200256 00000100:00100000:2.0:1787440153.077665:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701200256 00000100:00100000:0.0:1787440153.077846:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1787440153.077864:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04a69a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:168176ea-29d1-49de-a254-317e90d54802+17:8465:x1874266701200256:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787440153.078206:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04a69a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:168176ea-29d1-49de-a254-317e90d54802+17:8465:x1874266701200256:12345-0@lo:502:llog_process_th.0 Request processed in 348us (920us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440153.078714:0:8465:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee080b04380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:168176ea-29d1-49de-a254-317e90d54802:8465:1874266701200256:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1787440153.078774:0:8465:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1787440153.080073:0:5847:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:3.0:1787440153.080098:0:5847:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.158@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787440153.080109:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.158@tcp lock: ffff8ee041665400/0x85f5fa77adf3c2bc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3c2c3 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440153.080121:0:5847:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.158@tcp lock: ffff8ee041665400/0x85f5fa77adf3c2bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3c2c3 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787440153.080131:0:5847:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1787440153.080134:0:5847:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:3.0:1787440153.080137:0:5847:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1787440153.080173:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.158@tcp lock: ffff8ee041665e00/0x85f5fa77adf3c2ca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440153.080182:0:5847:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.158@tcp lock: ffff8ee041665e00/0x85f5fa77adf3c2ca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440153.080204:0:5847:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.158@tcp lock: ffff8ee041665e00/0x85f5fa77adf3c2ca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440153.080228:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee05fb62a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:168176ea-29d1-49de-a254-317e90d54802:5847:1874266701200384:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787440153.080287:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440153.080332:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee0460ebc00 going to sleep for 11 seconds 00000100:00100000:1.0:1787440153.080385:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701200384 00000100:00100000:1.0:1787440153.080391:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701200384 00000100:00100000:0.0:1787440153.083927:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1787440153.084332:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1787440153.084355:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04a69ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:168176ea-29d1-49de-a254-317e90d54802+17:5847:x1874266701200384:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787440153.084373:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440153.084391:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ee059185a00/0x85f5fa77adf3c2d1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x85f5fa77adf3c2ca expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440153.084418:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ee059185a00/0x85f5fa77adf3c2d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x85f5fa77adf3c2ca expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440153.084447:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ee059185a00/0x85f5fa77adf3c2d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f5fa77adf3c2ca expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440153.084456:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee059185a00, rc 0) 00000100:00100000:1.0:1787440153.084566:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04a69ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:168176ea-29d1-49de-a254-317e90d54802+18:5847:x1874266701200384:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 223us (4278us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440153.084574:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1787440153.084658:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee05fb62a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:168176ea-29d1-49de-a254-317e90d54802:5847:1874266701200384:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787440153.084678:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.158@tcp lock: ffff8ee041665e00/0x85f5fa77adf3c2ca lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3c2d1 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440153.084687:0:5847:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.158@tcp lock: ffff8ee041665e00/0x85f5fa77adf3c2ca lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x85f5fa77adf3c2d1 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440153.084772:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee05fb62a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:168176ea-29d1-49de-a254-317e90d54802:5847:1874266701200512:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787440153.084807:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440153.089267:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee0460ebc00 going to sleep for 11 seconds 00000100:00100000:2.0:1787440153.089489:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701200512 00000100:00100000:2.0:1787440153.089513:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701200512 00000100:00100000:2.0:1787440153.089633:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1787440153.089643:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04a69bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:168176ea-29d1-49de-a254-317e90d54802+18:5847:x1874266701200512:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787440153.090207:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04a69bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:168176ea-29d1-49de-a254-317e90d54802+18:5847:x1874266701200512:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 564us (5398us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440153.090215:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1787440153.090329:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee05fb62a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:168176ea-29d1-49de-a254-317e90d54802:5847:1874266701200512:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787440153.090376:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee05fb62a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:168176ea-29d1-49de-a254-317e90d54802:5847:1874266701200640:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787440153.090420:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440153.090490:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee0460ebc00 going to sleep for 11 seconds 00000100:00100000:1.0:1787440153.090629:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701200640 00000100:00100000:1.0:1787440153.090635:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701200640 00000100:00100000:2.0:1787440153.090728:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1787440153.091099:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04a698450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:168176ea-29d1-49de-a254-317e90d54802+18:5847:x1874266701200640:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787440153.091307:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04a698450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:168176ea-29d1-49de-a254-317e90d54802+18:5847:x1874266701200640:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 397us (886us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440153.091315:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1787440153.091391:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee05fb62a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:168176ea-29d1-49de-a254-317e90d54802:5847:1874266701200640:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787440153.092071:0:8466:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee05fb60700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:168176ea-29d1-49de-a254-317e90d54802:8466:1874266701200768:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787440153.092120:0:8466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440153.092155:0:8466:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee0453e5d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787440153.092199:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701200768 00000100:00100000:1.0:1787440153.092205:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701200768 00000100:00100000:1.0:1787440153.092241:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1787440153.092250:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04a698850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:168176ea-29d1-49de-a254-317e90d54802+18:8466:x1874266701200768:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787440153.092667:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04a698850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:168176ea-29d1-49de-a254-317e90d54802+18:8466:x1874266701200768:12345-0@lo:502:llog_process_th.0 Request processed in 418us (546us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440153.092676:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1787440153.094679:0:8466:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee05fb60700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:168176ea-29d1-49de-a254-317e90d54802:8466:1874266701200768:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787440153.095747:0:8466:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787440153.095771:0:8466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787440153.095773:0:8466:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1787440153.095783:0:8466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1787440153.095845:0:8466:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee05fb63100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:168176ea-29d1-49de-a254-317e90d54802:8466:1874266701200896:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787440153.095960:0:8466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440153.096049:0:8466:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee0453e5d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787440153.096052:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701200896 00000100:00100000:1.0:1787440153.096065:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701200896 00000100:00100000:1.0:1787440153.096129:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1787440153.096138:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee043b4b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:168176ea-29d1-49de-a254-317e90d54802+18:8466:x1874266701200896:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787440153.096692:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee043b4b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:168176ea-29d1-49de-a254-317e90d54802+18:8466:x1874266701200896:12345-0@lo:502:llog_process_th.0 Request processed in 554us (732us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440153.096704:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1787440153.096754:0:8466:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee05fb63100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:168176ea-29d1-49de-a254-317e90d54802:8466:1874266701200896:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787440153.096797:0:8466:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787440153.096804:0:8466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787440153.096806:0:8466:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1787440153.096811:0:8466:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:2.0:1787440153.097828:0:5847:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:2.0:1787440153.097860:0:5847:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.158@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1787440153.097871:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.158@tcp lock: ffff8ee041665e00/0x85f5fa77adf3c2ca lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3c2d1 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440153.097882:0:5847:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.158@tcp lock: ffff8ee041665e00/0x85f5fa77adf3c2ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3c2d1 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787440153.097891:0:5847:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1787440153.097894:0:5847:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8ee04a7e3370 from 1 10000000:01000000:2.0:1787440153.097896:0:5847:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787440153.097939:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.158@tcp lock: ffff8ee07f86f400/0x85f5fa77adf3c2d8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440153.097948:0:5847:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.158@tcp lock: ffff8ee07f86f400/0x85f5fa77adf3c2d8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440153.097958:0:5847:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.158@tcp lock: ffff8ee07f86f400/0x85f5fa77adf3c2d8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440153.097980:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee080326a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:168176ea-29d1-49de-a254-317e90d54802:5847:1874266701201024:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787440153.098050:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440153.098091:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee047f963c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787440153.098128:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701201024 00000100:00100000:3.0:1787440153.098140:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701201024 00000100:00100000:3.0:1787440153.098207:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1787440153.098218:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee043b48450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:168176ea-29d1-49de-a254-317e90d54802+18:5847:x1874266701201024:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787440153.098236:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440153.098255:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ee041664e00/0x85f5fa77adf3c2df lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x85f5fa77adf3c2d8 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440153.098283:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ee041664e00/0x85f5fa77adf3c2df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x85f5fa77adf3c2d8 expref: 19 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440153.098295:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ee041664e00/0x85f5fa77adf3c2df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f5fa77adf3c2d8 expref: 19 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440153.098304:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee041664e00, rc 0) 00000100:00100000:3.0:1787440153.098383:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee043b48450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:168176ea-29d1-49de-a254-317e90d54802+19:5847:x1874266701201024:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 167us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440153.098390:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1787440153.098558:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee080326a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:168176ea-29d1-49de-a254-317e90d54802:5847:1874266701201024:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787440153.098577:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.158@tcp lock: ffff8ee07f86f400/0x85f5fa77adf3c2d8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3c2df expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440153.098587:0:5847:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.158@tcp lock: ffff8ee07f86f400/0x85f5fa77adf3c2d8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x85f5fa77adf3c2df expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440153.098652:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee080326a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:168176ea-29d1-49de-a254-317e90d54802:5847:1874266701201152:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787440153.098686:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440153.098711:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee047f963c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787440153.099079:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701201152 00000100:00100000:1.0:1787440153.099085:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701201152 00000100:00100000:1.0:1787440153.099135:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1787440153.099153:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee06d270050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:168176ea-29d1-49de-a254-317e90d54802+19:5847:x1874266701201152:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787440153.099379:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee06d270050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:168176ea-29d1-49de-a254-317e90d54802+19:5847:x1874266701201152:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 227us (691us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787440153.099387:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1787440153.100847:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee080326a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:168176ea-29d1-49de-a254-317e90d54802:5847:1874266701201152:0@lo:501:ll_cfg_requeue.0 10000000:01000000:2.0:1787440153.100886:0:5847:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.158@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1787440153.100896:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.158@tcp lock: ffff8ee07f86f400/0x85f5fa77adf3c2d8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3c2df expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440153.100906:0:5847:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.158@tcp lock: ffff8ee07f86f400/0x85f5fa77adf3c2d8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3c2df expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440153.692841:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787440154.170616:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440154.170865:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681250688 00000100:00100000:0.0:1787440154.170885:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681250688 00000100:00100000:0.0:1787440154.170942:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 165 00000100:00100000:0.0:1787440154.170952:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee06d273850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+8:5603:x1874266681250688:12345-192.168.206.58@tcp:101: 00010000:00010000:0.0:1787440154.170970:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440154.170988:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ee04cbcf000/0x85f5fa77adf3c2e6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fab14535dc62088 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440154.171015:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ee04cbcf000/0x85f5fa77adf3c2e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62088 expref: 9 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440154.171026:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ee04cbcf000/0x85f5fa77adf3c2e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62088 expref: 9 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440154.171035:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee04cbcf000, rc 0) 00000100:00100000:0.0:1787440154.171092:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee06d273850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+9:5603:x1874266681250688:12345-192.168.206.58@tcp:101: Request processed in 141us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440154.171099:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 165 00000100:00100000:0.0:1787440154.180846:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:1.0:1787440154.185141:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681250816 00000100:00100000:1.0:1787440154.185162:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681250816 00000100:00100000:1.0:1787440154.185244:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 166 00000100:00100000:1.0:1787440154.185256:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04a699c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+9:5603:x1874266681250816:12345-192.168.206.58@tcp:501: 00000100:00100000:1.0:1787440154.185663:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04a699c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+9:5603:x1874266681250816:12345-192.168.206.58@tcp:501: Request processed in 407us (5395us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440154.185672:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 166 00000100:00100000:2.0:1787440154.191512:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:1.0:1787440154.191851:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681250944 00000100:00100000:1.0:1787440154.191861:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681250944 00000100:00100000:1.0:1787440154.191980:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 167 00000100:00100000:1.0:1787440154.191991:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee06d273450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+9:5603:x1874266681250944:12345-192.168.206.58@tcp:503: 00000100:00100000:1.0:1787440154.192331:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee06d273450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+9:5603:x1874266681250944:12345-192.168.206.58@tcp:503: Request processed in 341us (845us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440154.192339:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 167 00000100:00100000:2.0:1787440154.204036:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440154.204122:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681251072 00000100:00100000:0.0:1787440154.204130:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681251072 00000100:00100000:0.0:1787440154.204185:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 168 00000100:00100000:0.0:1787440154.204195:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee06d270c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+9:6081:x1874266681251072:12345-192.168.206.58@tcp:502: 00000100:00100000:0.0:1787440154.204436:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee06d270c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+9:6081:x1874266681251072:12345-192.168.206.58@tcp:502: Request processed in 241us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440154.204444:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 168 00000100:00100000:2.0:1787440154.207286:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:1.0:1787440154.207383:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681251200 00000100:00100000:1.0:1787440154.207404:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681251200 00000100:00100000:1.0:1787440154.207456:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 169 00000100:00100000:1.0:1787440154.207466:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee06d271c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+9:6081:x1874266681251200:12345-192.168.206.58@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787440154.208107:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee06d271c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+9:6081:x1874266681251200:12345-192.168.206.58@tcp:502:llog_process_th.0 Request processed in 640us (826us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440154.208116:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 169 00000100:00100000:2.0:1787440154.213362:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:1.0:1787440154.214191:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681251328 00000100:00100000:1.0:1787440154.214204:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681251328 00000100:00100000:1.0:1787440154.214430:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 170 00000100:00100000:1.0:1787440154.214440:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee06d273c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+9:5603:x1874266681251328:12345-192.168.206.58@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787440154.214456:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440154.214484:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ee059184800/0x85f5fa77adf3c2ed lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fab14535dc6208f expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440154.214540:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ee059184800/0x85f5fa77adf3c2ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6208f expref: 10 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440154.214562:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ee059184800/0x85f5fa77adf3c2ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6208f expref: 10 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440154.214571:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee059184800, rc 0) 00000100:00100000:1.0:1787440154.214633:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee06d273c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+10:5603:x1874266681251328:12345-192.168.206.58@tcp:101:ll_cfg_requeue.0 Request processed in 194us (1280us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440154.214640:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 170 00000100:00100000:2.0:1787440154.223299:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:1.0:1787440154.225204:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681251456 00000100:00100000:1.0:1787440154.225216:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681251456 00000100:00100000:1.0:1787440154.225282:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 171 00000100:00100000:1.0:1787440154.225292:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee06d271850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+10:5603:x1874266681251456:12345-192.168.206.58@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787440154.225929:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee06d271850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+10:5603:x1874266681251456:12345-192.168.206.58@tcp:501:ll_cfg_requeue.0 Request processed in 636us (2636us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787440154.225939:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 171 00010000:00010000:2.0:1787440154.720698:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787440155.036734:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee047a22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874266701201280:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787440155.036849:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440155.037057:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701201280 00000100:00100000:3.0:1787440155.037067:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701201280 00000100:00100000:3.0:1787440155.037145:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787440155.037156:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee080b07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874266701201280:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787440155.037200:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1787440155.037284:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787440155.041026:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee080b07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874266701201280:12345-0@lo:13:osp-pre-0-0.0 Request processed in 3859us (4164us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440155.041044:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:0.0:1787440155.049948:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ee047a22d80 x1874266701201280/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787440171 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787440155.049983:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee047a22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874266701201280:0@lo:13:osp-pre-0-0.0 00000020:00000080:2.0:1787440155.430236:0:8503:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd2f4f4ab0 20000000:00000080:2.0:1787440155.430262:0:8503:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8ee07fb76c00 uarg=0000000000000000 20000000:01000000:2.0:1787440155.430307:0:8503:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1787440155.430315:0:8503:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1787440155.430321:0:8503:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1787440155.431666:0:8504:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:2.0:1787440155.431941:0:8503:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:3.0:1787440155.437234:0:8503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:3.0:1787440155.437296:0:8503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:3.0:1787440155.437357:0:8503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:3.0:1787440155.437379:0:8503:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1787440155.437406:0:8503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8ee041664a00/0x85f5fa77adf3c2f4 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440155.437431:0:8503:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ee041664c00/0x85f5fa77adf3c069 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f5fa77adf3c062 expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440155.437441:0:8503:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ee040030a00/0x85f5fa77adf3c0cb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f5fa77adf3c0c4 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440155.437449:0:8503:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ee07f86f200/0x85f5fa77adf3c196 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f5fa77adf3c18f expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440155.437459:0:8503:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ee041665a00/0x85f5fa77adf3c253 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62057 expref: 9 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440155.437467:0:8503:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8ee041664a00/0x85f5fa77adf3c2f4 lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440155.439680:0:8503:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ee041665a00/0x85f5fa77adf3c253 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62057 expref: 9 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440155.439727:0:8503:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ee041665a00/0x85f5fa77adf3c253 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62057 expref: 9 pid: 5843 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440155.439746:0:8503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee05fb62680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8503:1874266701201408:192.168.206.58@tcp:104: 00010000:00010000:3.0:1787440155.440357:0:8503:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ee07f86f200/0x85f5fa77adf3c196 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x85f5fa77adf3c18f expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440155.440370:0:8503:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ee07f86f200/0x85f5fa77adf3c196 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x85f5fa77adf3c18f expref: 18 pid: 5843 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440155.440381:0:8503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee05fb63100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8503:1874266701201536:0@lo:104: 00000100:00100000:3.0:1787440155.440431:0:8503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787440155.440465:0:8503:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ee040030a00/0x85f5fa77adf3c0cb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x85f5fa77adf3c0c4 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440155.440474:0:8503:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ee040030a00/0x85f5fa77adf3c0cb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x85f5fa77adf3c0c4 expref: 18 pid: 5844 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440155.440483:0:8503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee05fb62a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8503:1874266701201664:0@lo:104: 00000100:00100000:3.0:1787440155.440545:0:8503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787440155.440570:0:8503:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ee041664c00/0x85f5fa77adf3c069 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x85f5fa77adf3c062 expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440155.440579:0:8503:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ee041664c00/0x85f5fa77adf3c069 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x85f5fa77adf3c062 expref: 18 pid: 5842 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440155.440588:0:8503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee05fb61500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8503:1874266701201792:0@lo:104: 00000100:00100000:3.0:1787440155.440610:0:8503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440155.440658:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701201536 00000100:00100000:3.0:1787440155.440667:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701201536 00000100:00100000:3.0:1787440155.440713:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701201664 00000100:00100000:3.0:1787440155.440716:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701201664 00000100:00100000:3.0:1787440155.440726:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701201792 00000100:00100000:3.0:1787440155.440728:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701201792 00000100:00100000:3.0:1787440155.440740:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787440155.440749:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee05fb60700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:168176ea-29d1-49de-a254-317e90d54802+5:8503:x1874266701201536:12345-0@lo:104: 00010000:00010000:3.0:1787440155.441220:0:8448:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.158@tcp lock: ffff8ee040031800/0x85f5fa77adf3c18f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x85f5fa77adf3c196 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440155.441299:0:8448:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787440155.441307:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee05fb60700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:168176ea-29d1-49de-a254-317e90d54802+5:8503:x1874266701201536:12345-0@lo:104: Request processed in 559us (876us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440155.441317:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787440155.441344:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787440155.441353:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee080b4f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:168176ea-29d1-49de-a254-317e90d54802+4:8503:x1874266701201664:12345-0@lo:104: 00010000:00010000:3.0:1787440155.441361:0:8448:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.158@tcp lock: ffff8ee040031000/0x85f5fa77adf3c0c4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x85f5fa77adf3c0cb expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440155.441394:0:8448:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787440155.441399:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee080b4f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:168176ea-29d1-49de-a254-317e90d54802+4:8503:x1874266701201664:12345-0@lo:104: Request processed in 50us (855us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440155.441405:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787440155.441441:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787440155.441448:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee049046680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:168176ea-29d1-49de-a254-317e90d54802+3:8503:x1874266701201792:12345-0@lo:104: 00010000:00010000:3.0:1787440155.441456:0:8448:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.158@tcp lock: ffff8ee059185c00/0x85f5fa77adf3c062 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x85f5fa77adf3c069 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440155.441625:0:5837:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787440155.441634:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.158@tcp lock: ffff8ee040031800/0x85f5fa77adf3c18f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x85f5fa77adf3c196 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440155.441642:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee040031800 already unused, calling callback (ffffffffc1bd2c20) 10000000:00010000:2.0:1787440155.441646:0:5837:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.158@tcp lock: ffff8ee040031800/0x85f5fa77adf3c18f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x85f5fa77adf3c196 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440155.441655:0:5837:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.158@tcp lock: ffff8ee040031800/0x85f5fa77adf3c18f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x85f5fa77adf3c196 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787440155.441663:0:5837:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.158@tcp lock: ffff8ee040031800/0x85f5fa77adf3c18f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x85f5fa77adf3c196 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787440155.441670:0:5837:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787440155.441709:0:5837:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.158@tcp lock: ffff8ee040031800/0x85f5fa77adf3c18f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x85f5fa77adf3c196 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440155.441716:0:5837:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787440155.441740:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.158@tcp lock: ffff8ee040031800/0x85f5fa77adf3c18f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x85f5fa77adf3c196 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440155.441748:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.158@tcp lock: ffff8ee040031800/0x85f5fa77adf3c18f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x85f5fa77adf3c196 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440155.441765:0:5837:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787440155.441789:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.158@tcp lock: ffff8ee040031000/0x85f5fa77adf3c0c4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x85f5fa77adf3c0cb expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440155.441796:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee040031000 already unused, calling callback (ffffffffc1bd2c20) 10000000:00010000:2.0:1787440155.441799:0:5837:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.158@tcp lock: ffff8ee040031000/0x85f5fa77adf3c0c4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x85f5fa77adf3c0cb expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440155.441806:0:5837:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.158@tcp lock: ffff8ee040031000/0x85f5fa77adf3c0c4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x85f5fa77adf3c0cb expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787440155.441812:0:5837:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.158@tcp lock: ffff8ee040031000/0x85f5fa77adf3c0c4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x85f5fa77adf3c0cb expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787440155.441818:0:5837:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787440155.441843:0:5837:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.158@tcp lock: ffff8ee040031000/0x85f5fa77adf3c0c4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x85f5fa77adf3c0cb expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440155.441850:0:5837:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787440155.441866:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.158@tcp lock: ffff8ee040031000/0x85f5fa77adf3c0c4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x85f5fa77adf3c0cb expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440155.441872:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.158@tcp lock: ffff8ee040031000/0x85f5fa77adf3c0c4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x85f5fa77adf3c0cb expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440155.441882:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787440155.441884:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787440155.441886:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787440155.441902:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee080326a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:168176ea-29d1-49de-a254-317e90d54802:3310:1874266701201920:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787440155.441942:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787440155.442017:0:8448:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787440155.442024:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee049046680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:168176ea-29d1-49de-a254-317e90d54802+3:8503:x1874266701201792:12345-0@lo:104: Request processed in 576us (1413us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440155.442031:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:0.0:1787440155.442182:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787440155.442191:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.158@tcp lock: ffff8ee059185c00/0x85f5fa77adf3c062 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x85f5fa77adf3c069 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440155.442197:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee059185c00 already unused, calling callback (ffffffffc1bd2c20) 10000000:00010000:0.0:1787440155.442200:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.158@tcp lock: ffff8ee059185c00/0x85f5fa77adf3c062 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x85f5fa77adf3c069 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440155.442207:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.158@tcp lock: ffff8ee059185c00/0x85f5fa77adf3c062 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x85f5fa77adf3c069 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787440155.442213:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.158@tcp lock: ffff8ee059185c00/0x85f5fa77adf3c062 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x85f5fa77adf3c069 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787440155.442229:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787440155.442257:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.158@tcp lock: ffff8ee059185c00/0x85f5fa77adf3c062 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x85f5fa77adf3c069 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440155.442263:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787440155.442270:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.158@tcp lock: ffff8ee059185c00/0x85f5fa77adf3c062 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x85f5fa77adf3c069 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440155.442277:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.158@tcp lock: ffff8ee059185c00/0x85f5fa77adf3c062 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x85f5fa77adf3c069 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440155.442294:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787440155.442296:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787440155.442298:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787440155.442988:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701201920 00000100:00100000:0.0:1787440155.443000:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701201920 00010000:00010000:0.0:1787440155.443042:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ee07f86f200/0x85f5fa77adf3c196 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x85f5fa77adf3c18f expref: 19 pid: 5843 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440155.443076:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787440155.443085:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee080326680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:168176ea-29d1-49de-a254-317e90d54802+19:3310:x1874266701201920:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787440155.443098:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787440155.443103:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ee07f86f200/0x85f5fa77adf3c196 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x85f5fa77adf3c18f expref: 19 pid: 5843 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440155.443115:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ee07f86f200/0x85f5fa77adf3c196 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x85f5fa77adf3c18f expref: 19 pid: 5843 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440155.443138:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787440155.443206:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee080326680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:168176ea-29d1-49de-a254-317e90d54802+19:3310:x1874266701201920:12345-0@lo:103:ldlm_bl.0 Request processed in 123us (1263us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440155.443214:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787440155.443245:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee080b04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:168176ea-29d1-49de-a254-317e90d54802:3312:1874266701202176:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787440155.443277:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440155.443993:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee080324700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:168176ea-29d1-49de-a254-317e90d54802:3311:1874266701202048:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787440155.444050:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440155.444106:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701202176 00000100:00100000:1.0:1787440155.444113:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701202176 00010000:00010000:1.0:1787440155.444143:0:6711:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ee041664c00/0x85f5fa77adf3c069 lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x85f5fa77adf3c062 expref: 19 pid: 5842 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440155.444167:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701202048 00000100:00100000:1.0:1787440155.444170:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701202048 00010000:00010000:1.0:1787440155.444183:0:6711:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ee040030a00/0x85f5fa77adf3c0cb lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x85f5fa77adf3c0c4 expref: 20 pid: 5844 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440155.444196:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787440155.444204:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee080b05c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:168176ea-29d1-49de-a254-317e90d54802+20:3312:x1874266701202176:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787440155.444214:0:6711:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787440155.444219:0:6711:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ee041664c00/0x85f5fa77adf3c069 lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x85f5fa77adf3c062 expref: 20 pid: 5842 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440155.444229:0:6711:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ee041664c00/0x85f5fa77adf3c069 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x85f5fa77adf3c062 expref: 20 pid: 5842 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440155.444246:0:6711:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787440155.444276:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee080b05c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:168176ea-29d1-49de-a254-317e90d54802+20:3312:x1874266701202176:12345-0@lo:103:ldlm_bl.0 Request processed in 73us (997us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440155.444283:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787440155.444300:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787440155.444306:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee047a21c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:168176ea-29d1-49de-a254-317e90d54802+19:3311:x1874266701202048:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787440155.444313:0:6711:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787440155.444317:0:6711:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ee040030a00/0x85f5fa77adf3c0cb lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x85f5fa77adf3c0c4 expref: 19 pid: 5844 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440155.444338:0:6711:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ee040030a00/0x85f5fa77adf3c0cb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x85f5fa77adf3c0c4 expref: 19 pid: 5844 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440155.444348:0:6711:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787440155.444377:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee047a21c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:168176ea-29d1-49de-a254-317e90d54802+19:3311:x1874266701202048:12345-0@lo:103:ldlm_bl.0 Request processed in 72us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440155.444383:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:1.0:1787440155.444422:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787440155.444688:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee080326a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:168176ea-29d1-49de-a254-317e90d54802:3310:1874266701201920:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787440155.444929:0:8503:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee080569480 going to sleep for 11 seconds 00010000:00010000:3.0:1787440155.444951:0:8503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ee07f86f200/0x85f5fa77adf3c196 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x85f5fa77adf3c18f expref: 18 pid: 5843 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440155.444967:0:8503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee05fb63100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8503:1874266701201536:0@lo:104: 00010000:00010000:3.0:1787440155.444978:0:8503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ee040030a00/0x85f5fa77adf3c0cb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x85f5fa77adf3c0c4 expref: 17 pid: 5844 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440155.444988:0:8503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee05fb62a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8503:1874266701201664:0@lo:104: 00010000:00010000:3.0:1787440155.444998:0:8503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ee041664c00/0x85f5fa77adf3c069 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x85f5fa77adf3c062 expref: 16 pid: 5842 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440155.445007:0:8503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee05fb61500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8503:1874266701201792:0@lo:104: 00000100:00100000:1.0:1787440155.445078:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee080324700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:168176ea-29d1-49de-a254-317e90d54802:3311:1874266701202048:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787440155.446078:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee080b04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:168176ea-29d1-49de-a254-317e90d54802:3312:1874266701202176:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787440155.446907:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440155.447038:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681251584 00000100:00100000:0.0:1787440155.447048:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681251584 00010000:00010000:0.0:1787440155.447093:0:6711:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ee041665a00/0x85f5fa77adf3c253 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62057 expref: 10 pid: 5843 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440155.447140:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 24 00000100:00100000:0.0:1787440155.447151:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee080326a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+10:2362:x1874266681251584:12345-192.168.206.58@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787440155.447168:0:6711:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787440155.447175:0:6711:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ee041665a00/0x85f5fa77adf3c253 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62057 expref: 10 pid: 5843 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440155.447188:0:6711:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ee041665a00/0x85f5fa77adf3c253 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62057 expref: 10 pid: 5843 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440155.447215:0:6711:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8ee041664a00/0x85f5fa77adf3c2f4 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440155.447225:0:6711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ee041664a00/0x85f5fa77adf3c2f4 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440155.447243:0:6711:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ee041664a00/0x85f5fa77adf3c2f4 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440155.447274:0:6711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ee041664a00/0x85f5fa77adf3c2f4 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440155.447281:0:6711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8ee041664a00/0x85f5fa77adf3c2f4 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440155.447287:0:6711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8ee041664a00/0x85f5fa77adf3c2f4 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440155.447294:0:6711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee041664a00 already unused, calling callback (ffffffffc15b52a0) 00010000:00010000:0.0:1787440155.447299:0:6711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8ee041664a00/0x85f5fa77adf3c2f4 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440155.447308:0:6711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8ee041664a00/0x85f5fa77adf3c2f4 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440155.447318:0:6711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8ee041664a00/0x85f5fa77adf3c2f4 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440155.447330:0:6711:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787440155.447390:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee080326a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+10:2362:x1874266681251584:12345-192.168.206.58@tcp:103:ldlm_bl.0 Request processed in 240us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440155.447399:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 24 00010000:00010000:3.0:1787440155.447562:0:8503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ee041665a00/0x85f5fa77adf3c253 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62057 expref: 9 pid: 5843 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440155.447580:0:8503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee05fb62680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8503:1874266701201408:192.168.206.58@tcp:104: 00010000:00010000:3.0:1787440155.447610:0:8503:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8ee041664a00/0x85f5fa77adf3c2f4 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440155.447619:0:8503:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8ee041664a00/0x85f5fa77adf3c2f4 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440155.447626:0:8503:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8ee041664a00/0x85f5fa77adf3c2f4 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440155.447640:0:8503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ee041664a00/0x85f5fa77adf3c2f4 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440155.556124:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440155.556169:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681251712 00000100:00100000:0.0:1787440155.556180:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681251712 00000100:00100000:0.0:1787440155.556237:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 172 00000100:00100000:0.0:1787440155.556248:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee06d270850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+9:5603:x1874266681251712:12345-192.168.206.58@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787440155.556268:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440155.556306:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ee04cbcfc00/0x85f5fa77adf3c2fb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fab14535dc62096 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440155.556339:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ee04cbcfc00/0x85f5fa77adf3c2fb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62096 expref: 10 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440155.556352:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ee04cbcfc00/0x85f5fa77adf3c2fb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62096 expref: 10 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440155.556364:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee04cbcfc00, rc 0) 00000100:00100000:0.0:1787440155.556426:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee06d270850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+10:5603:x1874266681251712:12345-192.168.206.58@tcp:101:ll_cfg_requeue.0 Request processed in 180us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440155.556434:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 172 00000100:00100000:2.0:1787440155.563336:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440155.563418:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681251840 00000100:00100000:3.0:1787440155.563431:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681251840 00000100:00100000:3.0:1787440155.563550:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 173 00000100:00100000:3.0:1787440155.563562:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee06d271050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+10:5603:x1874266681251840:12345-192.168.206.58@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787440155.563939:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee06d271050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+10:5603:x1874266681251840:12345-192.168.206.58@tcp:501:ll_cfg_requeue.0 Request processed in 377us (612us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440155.563949:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 173 00000100:00100000:0.0:1787440155.567479:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:2.0:1787440155.567901:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681251968 00000100:00100000:2.0:1787440155.567915:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681251968 00000100:00100000:2.0:1787440155.568020:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 174 00000100:00100000:2.0:1787440155.568032:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee06d271450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+10:5603:x1874266681251968:12345-192.168.206.58@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787440155.568356:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee06d271450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+10:5603:x1874266681251968:12345-192.168.206.58@tcp:503:ll_cfg_requeue.0 Request processed in 325us (889us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440155.568365:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 174 00000100:00100000:0.0:1787440155.573301:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440155.573387:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681252096 00000100:00100000:3.0:1787440155.573399:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681252096 00000100:00100000:3.0:1787440155.573469:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 175 00000100:00100000:3.0:1787440155.573480:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee06d272450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+10:6112:x1874266681252096:12345-192.168.206.58@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787440155.573925:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee06d272450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+10:6112:x1874266681252096:12345-192.168.206.58@tcp:502:llog_process_th.0 Request processed in 445us (636us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440155.573935:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 175 00000100:00100000:0.0:1787440155.580712:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440155.581644:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681252224 00000100:00100000:3.0:1787440155.581659:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681252224 00000100:00100000:3.0:1787440155.581735:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 176 00000100:00100000:3.0:1787440155.581746:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee06d272850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+10:6112:x1874266681252224:12345-192.168.206.58@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787440155.582943:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee06d272850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+10:6112:x1874266681252224:12345-192.168.206.58@tcp:502:llog_process_th.0 Request processed in 1188us (2234us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440155.582958:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 176 00010000:00010000:0.0:1787440155.741732:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787440156.060658:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee080324380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:168176ea-29d1-49de-a254-317e90d54802:3309:1874266701202304:0@lo:400:kworker.0 00000100:00100000:2.0:1787440156.060705:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee080327800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874266701202432:0@lo:400:kworker.0 00000100:00100000:1.0:1787440156.060734:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440156.060750:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440156.060942:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee080325c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1874266701202816:0@lo:400:kworker.0 00000100:00100000:1.0:1787440156.060968:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440156.061004:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee080324000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1874266701202560:0@lo:400:kworker.0 00000100:00100000:1.0:1787440156.061026:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440156.061045:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787440156.061051:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee080326d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874266701202688:0@lo:400:kworker.0 00000100:00100000:1.0:1787440156.061074:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440156.061114:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701202304 00000100:00100000:1.0:1787440156.061121:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701202304 00000100:00100000:1.0:1787440156.061163:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1787440156.061172:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee06d270450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:168176ea-29d1-49de-a254-317e90d54802+16:3309:x1874266701202304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440156.061232:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee06d270450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:168176ea-29d1-49de-a254-317e90d54802+16:3309:x1874266701202304:12345-0@lo:400:kworker.0 Request processed in 61us (499us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440156.061239:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1787440156.061701:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701202432 00000100:00100000:1.0:1787440156.061707:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701202432 00000100:00100000:1.0:1787440156.061733:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701202816 00000100:00100000:1.0:1787440156.061736:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701202816 00000100:00100000:1.0:1787440156.061753:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701202560 00000100:00100000:1.0:1787440156.061755:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701202560 00000100:00100000:1.0:1787440156.061856:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787440156.061865:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee080324a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874266701202432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440156.061906:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee080324a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874266701202432:12345-0@lo:400:kworker.0 Request processed in 44us (1159us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440156.061912:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787440156.061924:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787440156.061931:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee047a21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1874266701202816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440156.061958:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee047a21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1874266701202816:12345-0@lo:400:kworker.0 Request processed in 29us (989us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440156.061964:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787440156.061975:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787440156.061981:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee047a20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874266701202560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440156.062011:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee047a20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874266701202560:12345-0@lo:400:kworker.0 Request processed in 31us (984us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440156.062017:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787440156.062036:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701202688 00000100:00100000:1.0:1787440156.062039:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701202688 00000100:00100000:1.0:1787440156.062065:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787440156.062071:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee047a23480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1874266701202688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440156.062099:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee047a23480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1874266701202688:12345-0@lo:400:kworker.0 Request processed in 29us (1024us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440156.062115:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787440156.062156:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee080325c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1874266701202816:0@lo:400:kworker.0 00000100:00100000:1.0:1787440156.062166:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee080324380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:168176ea-29d1-49de-a254-317e90d54802:3309:1874266701202304:0@lo:400:kworker.0 00000100:00080000:1.0:1787440156.062736:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787440156.062762:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ee080326d80 x1874266701202688/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787440172 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787440156.063890:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee080326d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874266701202688:0@lo:400:kworker.0 00000100:00100000:1.0:1787440156.064978:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee080324000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1874266701202560:0@lo:400:kworker.0 00000100:00100000:2.0:1787440156.069015:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee080327800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874266701202432:0@lo:400:kworker.0 00000100:00100000:2.0:1787440156.069031:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee080325880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1874266701202944:0@lo:400:kworker.0 00000100:00100000:2.0:1787440156.069090:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440156.069160:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701202944 00000100:00100000:2.0:1787440156.069166:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701202944 00000100:00100000:2.0:1787440156.069365:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787440156.069376:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee080327480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1874266701202944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787440156.069433:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee080327480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1874266701202944:12345-0@lo:400:kworker.0 Request processed in 60us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440156.069441:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:1.0:1787440156.069987:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1787440156.070028:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ee080325880 x1874266701202944/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787440172 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787440156.070041:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee080325880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1874266701202944:0@lo:400:kworker.0 00000100:00100000:3.0:1787440156.587520:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787440156.587542:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee049047480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1874266701203072:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787440156.587608:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440156.587720:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701203072 00000100:00100000:3.0:1787440156.587727:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701203072 00000100:00100000:3.0:1787440156.587861:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787440156.587871:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee049044380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874266701203072:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787440156.587945:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787440156.587988:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee049044380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874266701203072:12345-0@lo:13:osp-pre-1-0.0 Request processed in 119us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440156.587995:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:3.0:1787440156.588203:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ee049047480 x1874266701203072/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787440172 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787440156.588222:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee049047480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1874266701203072:0@lo:13:osp-pre-1-0.0 10000000:01000000:3.0:1787440156.700613:0:5847:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787440156.700622:0:5847:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8ee06db91000 from 4 10000000:01000000:3.0:1787440156.700627:0:5847:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787440156.700672:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.158@tcp lock: ffff8ee041664a00/0x85f5fa77adf3c302 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440156.700684:0:5847:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.158@tcp lock: ffff8ee041664a00/0x85f5fa77adf3c302 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440156.700707:0:5847:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.158@tcp lock: ffff8ee041664a00/0x85f5fa77adf3c302 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440156.700731:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee049047480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:168176ea-29d1-49de-a254-317e90d54802:5847:1874266701203200:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787440156.700798:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440156.700865:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee06e7c7180 going to sleep for 11 seconds 00000100:00100000:0.0:1787440156.700999:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701203200 00000100:00100000:0.0:1787440156.701005:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701203200 00000100:00100000:0.0:1787440156.701056:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1787440156.701065:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee06d273050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:168176ea-29d1-49de-a254-317e90d54802+16:5847:x1874266701203200:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787440156.701077:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440156.701090:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ee04cbcee00/0x85f5fa77adf3c309 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x85f5fa77adf3c302 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440156.701112:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ee04cbcee00/0x85f5fa77adf3c309 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x85f5fa77adf3c302 expref: 17 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440156.701124:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ee04cbcee00/0x85f5fa77adf3c309 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f5fa77adf3c302 expref: 17 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440156.701140:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee04cbcee00, rc 0) 00000100:00100000:0.0:1787440156.701189:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee06d273050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:168176ea-29d1-49de-a254-317e90d54802+17:5847:x1874266701203200:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 125us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440156.701195:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1787440156.701412:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee049047480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:168176ea-29d1-49de-a254-317e90d54802:5847:1874266701203200:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787440156.701427:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.158@tcp lock: ffff8ee041664a00/0x85f5fa77adf3c302 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3c309 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440156.701435:0:5847:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.158@tcp lock: ffff8ee041664a00/0x85f5fa77adf3c302 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x85f5fa77adf3c309 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440156.701634:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee049047480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:168176ea-29d1-49de-a254-317e90d54802:5847:1874266701203328:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787440156.701662:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440156.703083:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701203328 00000100:00100000:0.0:1787440156.703093:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701203328 00000100:00100000:0.0:1787440156.703198:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1787440156.703208:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee06d272c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:168176ea-29d1-49de-a254-317e90d54802+17:5847:x1874266701203328:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787440156.703837:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee06d272c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:168176ea-29d1-49de-a254-317e90d54802+17:5847:x1874266701203328:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 629us (2171us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440156.703845:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1787440156.708130:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee06e7c7180 going to sleep for 11 seconds 00000100:00100000:3.0:1787440156.708174:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee049047480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:168176ea-29d1-49de-a254-317e90d54802:5847:1874266701203328:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787440156.708233:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee049047480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:168176ea-29d1-49de-a254-317e90d54802:5847:1874266701203456:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787440156.708313:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440156.708352:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee06e7c7180 going to sleep for 11 seconds 00000100:00100000:2.0:1787440156.708768:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701203456 00000100:00100000:2.0:1787440156.708775:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701203456 00000100:00100000:2.0:1787440156.708852:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1787440156.708862:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee06d272050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:168176ea-29d1-49de-a254-317e90d54802+17:5847:x1874266701203456:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787440156.709138:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee06d272050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:168176ea-29d1-49de-a254-317e90d54802+17:5847:x1874266701203456:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 277us (825us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440156.709146:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1787440156.710162:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee049047480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:168176ea-29d1-49de-a254-317e90d54802:5847:1874266701203456:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787440156.710860:0:8559:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee049047480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:168176ea-29d1-49de-a254-317e90d54802:8559:1874266701203584:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787440156.710922:0:8559:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440156.711539:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701203584 00000100:00100000:0.0:1787440156.711546:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701203584 00000100:00100000:0.0:1787440156.711591:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1787440156.711601:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee05d265050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:168176ea-29d1-49de-a254-317e90d54802+17:8559:x1874266701203584:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787440156.711683:0:8559:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee06e7c7cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787440156.711815:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee05d265050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:168176ea-29d1-49de-a254-317e90d54802+17:8559:x1874266701203584:12345-0@lo:502:llog_process_th.0 Request processed in 215us (893us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440156.711833:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1787440156.711986:0:8559:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee049047480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:168176ea-29d1-49de-a254-317e90d54802:8559:1874266701203584:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787440156.712013:0:8559:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787440156.712022:0:8559:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787440156.712024:0:8559:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1787440156.712030:0:8559:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8ee06db91000 00000020:00000080:3.0:1787440156.712033:0:8559:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787440156.713925:0:8559:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee049047480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:168176ea-29d1-49de-a254-317e90d54802:8559:1874266701203712:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787440156.714015:0:8559:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440156.714057:0:8559:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee06e7c7cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787440156.715750:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701203712 00000100:00100000:0.0:1787440156.715760:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701203712 00000100:00100000:0.0:1787440156.715806:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1787440156.715816:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee05d264850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:168176ea-29d1-49de-a254-317e90d54802+17:8559:x1874266701203712:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787440156.716099:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee05d264850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:168176ea-29d1-49de-a254-317e90d54802+17:8559:x1874266701203712:12345-0@lo:502:llog_process_th.0 Request processed in 284us (2083us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440156.716107:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1787440156.717038:0:8559:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee049047480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:168176ea-29d1-49de-a254-317e90d54802:8559:1874266701203712:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787440156.717075:0:8559:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787440156.717083:0:8559:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787440156.717086:0:8559:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1787440156.717091:0:8559:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1787440156.717631:0:5847:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1787440156.717651:0:5847:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.158@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787440156.717662:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.158@tcp lock: ffff8ee041664a00/0x85f5fa77adf3c302 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3c309 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440156.717673:0:5847:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.158@tcp lock: ffff8ee041664a00/0x85f5fa77adf3c302 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3c309 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787440156.717683:0:5847:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787440156.717686:0:5847:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8ee045e4e000 from 4 10000000:01000000:0.0:1787440156.717689:0:5847:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787440156.717720:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.158@tcp lock: ffff8ee04cbcfa00/0x85f5fa77adf3c310 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440156.717729:0:5847:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.158@tcp lock: ffff8ee04cbcfa00/0x85f5fa77adf3c310 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440156.717738:0:5847:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.158@tcp lock: ffff8ee04cbcfa00/0x85f5fa77adf3c310 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440156.717758:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee080b04000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:168176ea-29d1-49de-a254-317e90d54802:5847:1874266701203840:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787440156.717806:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440156.717850:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee045f0ec00 going to sleep for 11 seconds 00000100:00100000:3.0:1787440156.719050:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701203840 00000100:00100000:3.0:1787440156.719059:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701203840 00000100:00100000:3.0:1787440156.719108:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1787440156.719116:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee05d265c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:168176ea-29d1-49de-a254-317e90d54802+17:5847:x1874266701203840:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787440156.719131:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440156.719145:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ee041665a00/0x85f5fa77adf3c317 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x85f5fa77adf3c310 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440156.719169:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ee041665a00/0x85f5fa77adf3c317 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x85f5fa77adf3c310 expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440156.719179:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ee041665a00/0x85f5fa77adf3c317 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f5fa77adf3c310 expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440156.719189:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee041665a00, rc 0) 00000100:00100000:3.0:1787440156.719243:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee05d265c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:168176ea-29d1-49de-a254-317e90d54802+18:5847:x1874266701203840:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 128us (1437us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440156.719250:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1787440156.719294:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee080b04000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:168176ea-29d1-49de-a254-317e90d54802:5847:1874266701203840:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787440156.719309:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.158@tcp lock: ffff8ee04cbcfa00/0x85f5fa77adf3c310 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3c317 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440156.719329:0:5847:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.158@tcp lock: ffff8ee04cbcfa00/0x85f5fa77adf3c310 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x85f5fa77adf3c317 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440156.719387:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee049047480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:168176ea-29d1-49de-a254-317e90d54802:5847:1874266701203968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787440156.719418:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440156.719448:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee06e7c7240 going to sleep for 11 seconds 00000100:00100000:3.0:1787440156.719461:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701203968 00000100:00100000:3.0:1787440156.719464:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701203968 00000100:00100000:3.0:1787440156.719487:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1787440156.719511:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee05d265850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:168176ea-29d1-49de-a254-317e90d54802+18:5847:x1874266701203968:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787440156.722383:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee05d265850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:168176ea-29d1-49de-a254-317e90d54802+18:5847:x1874266701203968:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 2882us (2957us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440156.722396:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1787440156.722559:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee049047480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:168176ea-29d1-49de-a254-317e90d54802:5847:1874266701203968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787440156.722611:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee047a21180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:168176ea-29d1-49de-a254-317e90d54802:5847:1874266701204096:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787440156.722670:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440156.722836:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee07f9a8300 going to sleep for 11 seconds 00000100:00100000:3.0:1787440156.722899:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701204096 00000100:00100000:3.0:1787440156.722905:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701204096 00000100:00100000:3.0:1787440156.722958:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1787440156.722966:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee05d267050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:168176ea-29d1-49de-a254-317e90d54802+18:5847:x1874266701204096:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787440156.723145:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee05d267050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:168176ea-29d1-49de-a254-317e90d54802+18:5847:x1874266701204096:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 179us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440156.723153:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1787440156.723287:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee047a21180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:168176ea-29d1-49de-a254-317e90d54802:5847:1874266701204096:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787440156.725343:0:8562:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee047a21180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:168176ea-29d1-49de-a254-317e90d54802:8562:1874266701204224:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787440156.725419:0:8562:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440156.725461:0:8562:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee07f9a8000 going to sleep for 11 seconds 00000100:00100000:3.0:1787440156.725532:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701204224 00000100:00100000:3.0:1787440156.725538:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701204224 00000100:00100000:3.0:1787440156.725580:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1787440156.725588:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee05d264450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:168176ea-29d1-49de-a254-317e90d54802+18:8562:x1874266701204224:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787440156.725812:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee05d264450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:168176ea-29d1-49de-a254-317e90d54802+18:8562:x1874266701204224:12345-0@lo:502:llog_process_th.0 Request processed in 224us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440156.725839:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1787440156.726123:0:8562:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee047a21180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:168176ea-29d1-49de-a254-317e90d54802:8562:1874266701204224:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787440156.726158:0:8562:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787440156.726167:0:8562:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787440156.726170:0:8562:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1787440156.726176:0:8562:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8ee045e4e000 00000020:00000080:1.0:1787440156.726179:0:8562:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787440156.726663:0:8562:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee047a21180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:168176ea-29d1-49de-a254-317e90d54802:8562:1874266701204352:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787440156.726784:0:8562:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440156.726812:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701204352 00000100:00100000:1.0:1787440156.726826:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701204352 00000100:00100000:1.0:1787440156.726858:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1787440156.726865:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee05d267c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:168176ea-29d1-49de-a254-317e90d54802+18:8562:x1874266701204352:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787440156.727117:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee05d267c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:168176ea-29d1-49de-a254-317e90d54802+18:8562:x1874266701204352:12345-0@lo:502:llog_process_th.0 Request processed in 252us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440156.727124:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1787440156.727229:0:8562:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee07f9a8000 going to sleep for 11 seconds 00000100:00100000:1.0:1787440156.727244:0:8562:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee047a21180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:168176ea-29d1-49de-a254-317e90d54802:8562:1874266701204352:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787440156.727266:0:8562:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787440156.727271:0:8562:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787440156.727273:0:8562:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1787440156.727277:0:8562:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1787440156.731120:0:5847:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1787440156.731153:0:5847:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.158@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787440156.731164:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.158@tcp lock: ffff8ee04cbcfa00/0x85f5fa77adf3c310 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3c317 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440156.731176:0:5847:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.158@tcp lock: ffff8ee04cbcfa00/0x85f5fa77adf3c310 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3c317 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787440156.731186:0:5847:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787440156.731189:0:5847:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8ee045f41000 from 4 10000000:01000000:3.0:1787440156.731191:0:5847:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787440156.731225:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.158@tcp lock: ffff8ee041664c00/0x85f5fa77adf3c31e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440156.731233:0:5847:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.158@tcp lock: ffff8ee041664c00/0x85f5fa77adf3c31e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440156.731244:0:5847:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.158@tcp lock: ffff8ee041664c00/0x85f5fa77adf3c31e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440156.731268:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee049047800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:168176ea-29d1-49de-a254-317e90d54802:5847:1874266701204480:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787440156.731332:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440156.731371:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee06e7c7f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787440156.731390:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701204480 00000100:00100000:3.0:1787440156.731395:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701204480 00000100:00100000:3.0:1787440156.731436:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1787440156.731444:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee05d266c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:168176ea-29d1-49de-a254-317e90d54802+18:5847:x1874266701204480:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787440156.731457:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440156.731476:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ee041664200/0x85f5fa77adf3c325 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x85f5fa77adf3c31e expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440156.731518:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ee041664200/0x85f5fa77adf3c325 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x85f5fa77adf3c31e expref: 19 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440156.731529:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ee041664200/0x85f5fa77adf3c325 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f5fa77adf3c31e expref: 19 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440156.731537:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee041664200, rc 0) 00000100:00100000:3.0:1787440156.731577:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee05d266c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:168176ea-29d1-49de-a254-317e90d54802+19:5847:x1874266701204480:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 134us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440156.731584:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1787440156.731625:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee049047800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:168176ea-29d1-49de-a254-317e90d54802:5847:1874266701204480:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787440156.731654:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.158@tcp lock: ffff8ee041664c00/0x85f5fa77adf3c31e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3c325 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440156.731663:0:5847:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.158@tcp lock: ffff8ee041664c00/0x85f5fa77adf3c31e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x85f5fa77adf3c325 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440156.731805:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee049047800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:168176ea-29d1-49de-a254-317e90d54802:5847:1874266701204608:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787440156.731845:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440156.731865:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee06e7c7f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787440156.731876:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701204608 00000100:00100000:3.0:1787440156.731879:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701204608 00000100:00100000:3.0:1787440156.731897:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1787440156.731903:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee05d264050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:168176ea-29d1-49de-a254-317e90d54802+19:5847:x1874266701204608:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787440156.734091:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee05d264050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:168176ea-29d1-49de-a254-317e90d54802+19:5847:x1874266701204608:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 2180us (2238us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440156.734108:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1787440156.734168:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee049047800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:168176ea-29d1-49de-a254-317e90d54802:5847:1874266701204608:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787440156.734211:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee049047800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:168176ea-29d1-49de-a254-317e90d54802:5847:1874266701204736:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787440156.734251:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440156.734284:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee06e7c7f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787440156.734607:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701204736 00000100:00100000:0.0:1787440156.734614:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701204736 00000100:00100000:0.0:1787440156.734646:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1787440156.734654:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee05d266050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:168176ea-29d1-49de-a254-317e90d54802+19:5847:x1874266701204736:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787440156.734811:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee05d266050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:168176ea-29d1-49de-a254-317e90d54802+19:5847:x1874266701204736:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 157us (560us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440156.734830:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1787440156.735906:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee049047800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:168176ea-29d1-49de-a254-317e90d54802:5847:1874266701204736:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787440156.742776:0:8564:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee049047800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:168176ea-29d1-49de-a254-317e90d54802:8564:1874266701204864:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787440156.742859:0:8564:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440156.742903:0:8564:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee06e7c76c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787440156.743651:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701204864 00000100:00100000:0.0:1787440156.743659:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701204864 00000100:00100000:0.0:1787440156.743706:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1787440156.743716:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee05d266450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:168176ea-29d1-49de-a254-317e90d54802+19:8564:x1874266701204864:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787440156.743948:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee05d266450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:168176ea-29d1-49de-a254-317e90d54802+19:8564:x1874266701204864:12345-0@lo:502:llog_process_th.0 Request processed in 233us (1088us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440156.743956:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1787440156.744565:0:8564:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee049047800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:168176ea-29d1-49de-a254-317e90d54802:8564:1874266701204864:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787440156.744601:0:8564:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787440156.744611:0:8564:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787440156.744613:0:8564:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1787440156.744620:0:8564:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8ee045f41000 00000020:00000080:3.0:1787440156.744623:0:8564:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787440156.745085:0:8564:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee049047800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:168176ea-29d1-49de-a254-317e90d54802:8564:1874266701204992:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787440156.745143:0:8564:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440156.745175:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701204992 00000100:00100000:3.0:1787440156.745180:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701204992 00000100:00100000:3.0:1787440156.745216:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:3.0:1787440156.745224:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee047a42850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:168176ea-29d1-49de-a254-317e90d54802+19:8564:x1874266701204992:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787440156.745388:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee047a42850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:168176ea-29d1-49de-a254-317e90d54802+19:8564:x1874266701204992:12345-0@lo:502:llog_process_th.0 Request processed in 164us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440156.745395:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:3.0:1787440156.749174:0:8564:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee06e7c76c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787440156.749232:0:8564:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee049047800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:168176ea-29d1-49de-a254-317e90d54802:8564:1874266701204992:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787440156.749271:0:8564:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787440156.749280:0:8564:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787440156.749282:0:8564:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1787440156.749288:0:8564:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1787440156.749763:0:5847:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1787440156.749784:0:5847:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.158@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787440156.749796:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.158@tcp lock: ffff8ee041664c00/0x85f5fa77adf3c31e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3c325 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440156.749808:0:5847:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.158@tcp lock: ffff8ee041664c00/0x85f5fa77adf3c31e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3c325 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440156.767521:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787440157.241561:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440157.241799:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681252352 00000100:00100000:0.0:1787440157.241809:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681252352 00000100:00100000:0.0:1787440157.241876:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 193 00000100:00100000:0.0:1787440157.241888:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee047a40c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+10:2363:x1874266681252352:12345-192.168.206.58@tcp:400:kworker.0 00000100:00100000:0.0:1787440157.241957:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee047a40c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+10:2363:x1874266681252352:12345-192.168.206.58@tcp:400:kworker.0 Request processed in 71us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440157.241965:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 193 00000100:00100000:0.0:1787440157.253627:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440157.253668:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440157.253695:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440157.253722:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681252608 00000100:00100000:0.0:1787440157.253731:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681252608 00000100:00100000:0.0:1787440157.253803:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681252736 00000100:00100000:0.0:1787440157.253807:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681252736 00000100:00100000:0.0:1787440157.253839:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 17 00000100:00100000:0.0:1787440157.253850:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee080b05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+5:2363:x1874266681252608:12345-192.168.206.58@tcp:400:kworker.0 00000100:00100000:0.0:1787440157.253919:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee080b05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+5:2363:x1874266681252608:12345-192.168.206.58@tcp:400:kworker.0 Request processed in 71us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440157.253926:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681252480 00000100:00100000:0.0:1787440157.253929:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 17 00000100:00100000:1.0:1787440157.253933:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681252480 00000100:00100000:0.0:1787440157.253950:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 18 00000100:00100000:0.0:1787440157.253959:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee080b04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+5:2363:x1874266681252736:12345-192.168.206.58@tcp:400:kworker.0 00000100:00100000:0.0:1787440157.253982:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee080b04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+5:2363:x1874266681252736:12345-192.168.206.58@tcp:400:kworker.0 Request processed in 26us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440157.253988:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 18 00000100:00080000:0.0:1787440157.254007:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787440157.254011:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787440157.254101:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 31 00000100:00100000:1.0:1787440157.254111:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee080b06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+6:2363:x1874266681252480:12345-192.168.206.58@tcp:400:kworker.0 00000100:00080000:0.0:1787440157.254115:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787440157.254164:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee080b06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+6:2363:x1874266681252480:12345-192.168.206.58@tcp:400:kworker.0 Request processed in 55us (544us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440157.254171:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 31 00010000:00010000:0.0:1787440157.789710:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787440158.813776:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787440159.837041:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787440160.156930:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee047a21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1874266701205120:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787440160.156999:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440160.157105:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701205120 00000100:00100000:1.0:1787440160.157113:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701205120 00000100:00100000:1.0:1787440160.157178:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787440160.157189:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee047a20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874266701205120:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787440160.157224:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787440160.157281:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee047a20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874266701205120:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440160.157288:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:1.0:1787440160.157309:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787440160.157337:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ee047a21180 x1874266701205120/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787440176 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787440160.157355:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee047a21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1874266701205120:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787440160.862855:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787440161.185661:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee049047800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:168176ea-29d1-49de-a254-317e90d54802:3309:1874266701205248:0@lo:400:kworker.0 00000100:00100000:3.0:1787440161.185683:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee049047480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874266701205376:0@lo:400:kworker.0 00000100:00100000:3.0:1787440161.187583:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440161.187640:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee05fb63100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1874266701205888:0@lo:400:kworker.0 00000100:00100000:3.0:1787440161.187690:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440161.187726:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787440161.187732:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee05fb62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3310:1874266701205760:0@lo:400:kworker.0 00000100:00100000:3.0:1787440161.187752:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440161.187777:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee05fb62680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1874266701205504:0@lo:400:kworker.0 00000100:00100000:3.0:1787440161.187809:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440161.187827:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787440161.187832:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee05fb61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874266701205632:0@lo:400:kworker.0 00000100:00100000:3.0:1787440161.187851:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440161.188043:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701205888 00000100:00100000:3.0:1787440161.188051:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701205888 00000100:00100000:3.0:1787440161.188097:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701205632 00000100:00100000:3.0:1787440161.188100:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701205632 00000100:00100000:3.0:1787440161.188117:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787440161.188125:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04a658000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1874266701205888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440161.188176:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04a658000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1874266701205888:12345-0@lo:400:kworker.0 Request processed in 51us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440161.188192:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787440161.188260:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787440161.188267:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04a659880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1874266701205632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440161.188301:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04a659880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1874266701205632:12345-0@lo:400:kworker.0 Request processed in 34us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440161.188306:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787440161.188323:0:6892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701205376 00000100:00100000:3.0:1787440161.188327:0:6892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701205376 00000100:00100000:1.0:1787440161.188506:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701205760 00000100:00100000:1.0:1787440161.188511:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701205760 00000100:00100000:1.0:1787440161.188531:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701205504 00000100:00100000:1.0:1787440161.188533:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701205504 00000100:00100000:1.0:1787440161.188548:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787440161.188554:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee05fb60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874266701205376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440161.188605:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee05fb60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874266701205376:12345-0@lo:400:kworker.0 Request processed in 51us (1026us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440161.188611:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787440161.188623:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787440161.188629:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04a65ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874266701205760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440161.188667:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04a65ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874266701205760:12345-0@lo:400:kworker.0 Request processed in 38us (913us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440161.188673:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787440161.188685:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787440161.188692:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04a659c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874266701205504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440161.188717:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04a659c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874266701205504:12345-0@lo:400:kworker.0 Request processed in 26us (908us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440161.188723:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:3.0:1787440161.189070:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787440161.189074:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1787440161.189108:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ee05fb61500 x1874266701205632/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787440177 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787440161.189121:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee05fb61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874266701205632:0@lo:400:kworker.0 00000100:00100000:3.0:1787440161.189133:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee05fb62680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1874266701205504:0@lo:400:kworker.0 00000100:00100000:3.0:1787440161.189162:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee05fb62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3310:1874266701205760:0@lo:400:kworker.0 00000100:00100000:3.0:1787440161.189173:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee049047480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874266701205376:0@lo:400:kworker.0 00010000:00080000:3.0:1787440161.189182:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ee05fb63100 x1874266701205888/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787440177 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787440161.189190:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee05fb63100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1874266701205888:0@lo:400:kworker.0 00000100:00100000:2.0:1787440161.190683:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440161.190860:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701205248 00000100:00100000:0.0:1787440161.190868:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701205248 00000100:00100000:0.0:1787440161.190905:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1787440161.190914:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee047a43450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:168176ea-29d1-49de-a254-317e90d54802+19:3309:x1874266701205248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787440161.191756:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee047a43450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:168176ea-29d1-49de-a254-317e90d54802+19:3309:x1874266701205248:12345-0@lo:400:kworker.0 Request processed in 839us (1075us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440161.191765:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:2.0:1787440161.196902:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee049047800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:168176ea-29d1-49de-a254-317e90d54802:3309:1874266701205248:0@lo:400:kworker.0 00000001:02000400:3.0:1787440161.685995:0:8801:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg658-server.virtnet: executing check_logdir /tmp/testlogs/ 00000100:00100000:3.0:1787440161.702612:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee080b07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874266701206016:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787440161.702685:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440161.705849:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701206016 00000100:00100000:1.0:1787440161.705925:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701206016 00000100:00100000:1.0:1787440161.706076:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787440161.706087:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04a658a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874266701206016:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787440161.706127:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787440161.706438:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04a658a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874266701206016:12345-0@lo:13:osp-pre-1-0.0 Request processed in 353us (3752us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440161.706447:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:3.0:1787440161.708285:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ee080b07480 x1874266701206016/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787440177 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787440161.708316:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee080b07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874266701206016:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787440161.890050:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787440162.361881:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440162.361928:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440162.361968:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440162.361999:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440162.362027:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681252992 00000100:00100000:0.0:1787440162.362036:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681252992 00000100:00100000:0.0:1787440162.362094:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 35 00000100:00100000:0.0:1787440162.362104:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee080b04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+6:2361:x1874266681252992:12345-192.168.206.58@tcp:400:kworker.0 00000100:00100000:0.0:1787440162.362177:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee080b04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+6:2361:x1874266681252992:12345-192.168.206.58@tcp:400:kworker.0 Request processed in 74us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440162.362185:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 35 00000100:00100000:0.0:1787440162.362207:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681253120 00000100:00100000:0.0:1787440162.362211:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681253120 00000100:00100000:0.0:1787440162.362235:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681253248 00000100:00100000:0.0:1787440162.362237:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681253248 00000100:00100000:0.0:1787440162.362253:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 21 00000100:00100000:0.0:1787440162.362258:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee080b05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+5:2361:x1874266681253120:12345-192.168.206.58@tcp:400:kworker.0 00000100:00100000:0.0:1787440162.362283:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee080b05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+5:2361:x1874266681253120:12345-192.168.206.58@tcp:400:kworker.0 Request processed in 24us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440162.362288:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 21 00000100:00100000:0.0:1787440162.362299:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 22 00000100:00100000:0.0:1787440162.362304:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee080b07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+5:2361:x1874266681253248:12345-192.168.206.58@tcp:400:kworker.0 00000100:00100000:0.0:1787440162.362324:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee080b07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+5:2361:x1874266681253248:12345-192.168.206.58@tcp:400:kworker.0 Request processed in 20us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440162.362329:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 22 00000100:00080000:0.0:1787440162.362361:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787440162.362365:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787440162.362367:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787440162.363827:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681252864 00000100:00100000:1.0:1787440162.363838:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681252864 00000100:00100000:1.0:1787440162.363890:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 195 00000100:00100000:1.0:1787440162.363898:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04ca1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+10:2361:x1874266681252864:12345-192.168.206.58@tcp:400:kworker.0 00000100:00100000:1.0:1787440162.363957:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04ca1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+10:2361:x1874266681252864:12345-192.168.206.58@tcp:400:kworker.0 Request processed in 60us (2084us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440162.363964:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 195 00010000:00010000:1.0:1787440162.912126:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787440163.936938:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787440164.956988:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787440165.276657:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787440165.276679:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee047a21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874266701206144:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787440165.276758:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440165.276841:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701206144 00000100:00100000:1.0:1787440165.276848:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701206144 00000100:00100000:1.0:1787440165.276905:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787440165.276913:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee047a23100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874266701206144:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787440165.276948:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787440165.276992:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee047a23100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874266701206144:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440165.276999:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:1.0:1787440165.277021:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787440165.277051:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ee047a21180 x1874266701206144/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787440181 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787440165.277069:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee047a21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874266701206144:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787440165.983115:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787440166.307827:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee047a21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:168176ea-29d1-49de-a254-317e90d54802:3309:1874266701206272:0@lo:400:kworker.0 00000100:00100000:2.0:1787440166.307899:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440166.308019:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701206272 00000100:00100000:3.0:1787440166.308027:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701206272 00000100:00100000:3.0:1787440166.308074:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:3.0:1787440166.308081:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04ca1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:168176ea-29d1-49de-a254-317e90d54802+19:3309:x1874266701206272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440166.311840:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee047a20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1874266701206528:0@lo:400:kworker.0 00000100:00100000:1.0:1787440166.311904:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440166.311940:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787440166.311946:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee047a22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874266701206656:0@lo:400:kworker.0 00000100:00100000:1.0:1787440166.311971:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440166.312003:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701206656 00000100:00100000:1.0:1787440166.312011:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701206656 00000100:00100000:1.0:1787440166.312059:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787440166.312067:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee0806b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1874266701206656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440166.312110:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee0806b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1874266701206656:12345-0@lo:400:kworker.0 Request processed in 44us (138us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440166.312116:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:1.0:1787440166.312155:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ee047a22300 x1874266701206656/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787440182 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787440166.312176:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee047a22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874266701206656:0@lo:400:kworker.0 00000100:00100000:3.0:1787440166.312432:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04ca1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:168176ea-29d1-49de-a254-317e90d54802+19:3309:x1874266701206272:12345-0@lo:400:kworker.0 Request processed in 4349us (4530us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440166.312441:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:3.0:1787440166.312481:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee047a22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874266701206400:0@lo:400:kworker.0 00000100:00100000:3.0:1787440166.312524:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440166.312540:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee047a23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1874266701206912:0@lo:400:kworker.0 00000100:00100000:3.0:1787440166.312561:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440166.312579:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787440166.312584:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee047a21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3310:1874266701206784:0@lo:400:kworker.0 00000100:00100000:3.0:1787440166.312604:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440166.312633:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701206528 00000100:00100000:3.0:1787440166.312637:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701206528 00000100:00100000:3.0:1787440166.312669:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701206400 00000100:00100000:3.0:1787440166.312672:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701206400 00000100:00100000:3.0:1787440166.312684:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701206784 00000100:00100000:3.0:1787440166.312686:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701206784 00000100:00100000:3.0:1787440166.312715:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787440166.312721:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee0806b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874266701206528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440166.312756:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee0806b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874266701206528:12345-0@lo:400:kworker.0 Request processed in 34us (852us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440166.312781:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787440166.312796:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787440166.312801:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04a65b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874266701206400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440166.312830:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04a65b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874266701206400:12345-0@lo:400:kworker.0 Request processed in 29us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440166.312836:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787440166.312847:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787440166.312852:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04a658e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874266701206784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440166.312878:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04a658e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874266701206784:12345-0@lo:400:kworker.0 Request processed in 26us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440166.312883:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787440166.312902:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701206912 00000100:00100000:3.0:1787440166.312906:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701206912 00000100:00100000:3.0:1787440166.312929:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787440166.312935:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04a659180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1874266701206912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440166.312962:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04a659180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1874266701206912:12345-0@lo:400:kworker.0 Request processed in 28us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440166.312968:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:3.0:1787440166.312984:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787440166.312989:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787440166.313009:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee047a20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1874266701206528:0@lo:400:kworker.0 00000100:00100000:3.0:1787440166.313027:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee047a21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3310:1874266701206784:0@lo:400:kworker.0 00000100:00100000:3.0:1787440166.313035:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee047a22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874266701206400:0@lo:400:kworker.0 00010000:00080000:3.0:1787440166.313045:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ee047a23b80 x1874266701206912/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787440182 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787440166.313060:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee047a23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1874266701206912:0@lo:400:kworker.0 00000100:00100000:2.0:1787440166.315962:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee047a21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:168176ea-29d1-49de-a254-317e90d54802:3309:1874266701206272:0@lo:400:kworker.0 00000001:02000400:0.0:1787440166.808276:0:9045:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg658-server.virtnet: executing yml_node 00000100:00100000:1.0:1787440166.812923:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787440166.812947:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee0806b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1874266701207040:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787440166.813024:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440166.813081:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701207040 00000100:00100000:1.0:1787440166.813088:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701207040 00000100:00100000:1.0:1787440166.813129:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787440166.813137:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee0806b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874266701207040:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787440166.813168:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787440166.813209:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee0806b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874266701207040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440166.813217:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:1.0:1787440166.813255:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ee0806b6d80 x1874266701207040/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787440182 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787440166.813272:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee0806b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1874266701207040:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787440167.006224:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787440167.485749:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:2.0:1787440167.485807:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681253376 00000100:00100000:2.0:1787440167.485817:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681253376 00000100:00100000:2.0:1787440167.485865:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 197 00000100:00100000:2.0:1787440167.485874:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04ca1dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+10:2361:x1874266681253376:12345-192.168.206.58@tcp:400:kworker.0 00000100:00100000:2.0:1787440167.485942:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04ca1dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+10:2361:x1874266681253376:12345-192.168.206.58@tcp:400:kworker.0 Request processed in 69us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440167.485949:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 197 00000100:00100000:0.0:1787440167.486939:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440167.487051:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681253504 00000100:00100000:0.0:1787440167.487057:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681253504 00000100:00100000:0.0:1787440167.487214:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 39 00000100:00100000:0.0:1787440167.487224:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee080b05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+6:2361:x1874266681253504:12345-192.168.206.58@tcp:400:kworker.0 00000100:00100000:0.0:1787440167.487292:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee080b05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+6:2361:x1874266681253504:12345-192.168.206.58@tcp:400:kworker.0 Request processed in 70us (357us total) trans 0 rc 0/0 00000100:00080000:1.0:1787440167.487295:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787440167.487304:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 39 00000100:00100000:0.0:1787440167.504310:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440167.504435:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:1.0:1787440167.504598:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681253632 00000100:00100000:1.0:1787440167.504607:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681253632 00000100:00100000:1.0:1787440167.504687:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681253760 00000100:00100000:1.0:1787440167.504690:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681253760 00000100:00100000:1.0:1787440167.504712:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 10 00000100:00100000:1.0:1787440167.504722:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee080b06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+5:2359:x1874266681253632:12345-192.168.206.58@tcp:9:kworker.0 00000020:00000080:1.0:1787440167.504754:0:6698:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x85f5fa77adf3c261 00000100:00080000:1.0:1787440167.504782:0:6698:0:(import.c:65:import_set_state_nolock()) ffff8ee077fa7800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787440167.504843:0:6698:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00010000:00010000:2.0:1787440167.504880:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787440167.505206:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee080b06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+2:2359:x1874266681253632:12345-192.168.206.58@tcp:9:kworker.0 Request processed in 484us (904us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440167.505214:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 10 00000100:00100000:1.0:1787440167.505234:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 11 00000100:00100000:1.0:1787440167.505247:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee080b07b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+5:2359:x1874266681253760:12345-192.168.206.58@tcp:9:kworker.0 00000020:00000080:1.0:1787440167.505264:0:6698:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x85f5fa77adf3c268 00000100:00080000:1.0:1787440167.505271:0:6698:0:(import.c:65:import_set_state_nolock()) ffff8ee077fa5000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787440167.505300:0:6698:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1787440167.505801:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee080b07b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+2:2359:x1874266681253760:12345-192.168.206.58@tcp:9:kworker.0 Request processed in 557us (1363us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440167.505809:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 11 00010000:00010000:1.0:1787440167.505877:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787440167.507603:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787440167.507614:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787440168.031966:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787440168.928374:0:6723:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 792563a7-4c22-4ac7-ac25-d49ef7fb41a8 00000020:00000080:3.0:1787440168.928384:0:6723:0:(genops.c:885:class_export_put()) final put ffff8ee077fa5800/792563a7-4c22-4ac7-ac25-d49ef7fb41a8 00000020:00000080:0.0:1787440168.928590:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8ee077fa5800/792563a7-4c22-4ac7-ac25-d49ef7fb41a8 for lustre-OST0000 00000020:00000080:0.0:1787440168.928646:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ee077fa7800 for lustre-OST0000 00010000:00010000:1.0:1787440169.052712:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787440170.076793:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787440170.400390:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee0806b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1874266701207168:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787440170.400461:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440170.400687:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701207168 00000100:00100000:1.0:1787440170.400696:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701207168 00000100:00100000:1.0:1787440170.400766:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787440170.400777:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee080327800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874266701207168:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787440170.400811:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787440170.400869:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee080327800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874266701207168:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440170.400877:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:3.0:1787440170.400961:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ee0806b6d80 x1874266701207168/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787440186 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787440170.400981:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee0806b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1874266701207168:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787440170.402700:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787440171.110735:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787440171.421183:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee080b07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874266701207424:0@lo:400:kworker.0 00000100:00100000:0.0:1787440171.421247:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440171.421341:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee080b05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:168176ea-29d1-49de-a254-317e90d54802:3309:1874266701207296:0@lo:400:kworker.0 00000100:00100000:2.0:1787440171.421377:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440171.421415:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee080b06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1874266701207808:0@lo:400:kworker.0 00000100:00100000:2.0:1787440171.421448:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440171.421485:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701207296 00000100:00100000:2.0:1787440171.421518:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701207296 00000100:00100000:2.0:1787440171.421559:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:2.0:1787440171.421569:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04ca1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:168176ea-29d1-49de-a254-317e90d54802+19:3309:x1874266701207296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787440171.421615:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04ca1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:168176ea-29d1-49de-a254-317e90d54802+19:3309:x1874266701207296:12345-0@lo:400:kworker.0 Request processed in 48us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440171.421622:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:2.0:1787440171.421650:0:6892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701207424 00000100:00100000:2.0:1787440171.421654:0:6892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701207424 00000100:00100000:2.0:1787440171.421675:0:6892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701207808 00000100:00100000:2.0:1787440171.421678:0:6892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701207808 00000100:00100000:2.0:1787440171.421707:0:6892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787440171.421714:0:6892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee05d27ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874266701207424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787440171.421759:0:6892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee05d27ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874266701207424:12345-0@lo:400:kworker.0 Request processed in 45us (511us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440171.421765:0:6892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787440171.421779:0:6892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787440171.421785:0:6892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee080325180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1874266701207808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787440171.421813:0:6892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee080325180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1874266701207808:12345-0@lo:400:kworker.0 Request processed in 28us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440171.421819:0:6892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:2.0:1787440171.421858:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787440171.422166:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee080b05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:168176ea-29d1-49de-a254-317e90d54802:3309:1874266701207296:0@lo:400:kworker.0 00000100:00100000:2.0:1787440171.422191:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee080b06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1874266701207808:0@lo:400:kworker.0 00000100:00100000:0.0:1787440171.423514:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee080b07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874266701207424:0@lo:400:kworker.0 00000100:00100000:0.0:1787440171.423526:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee080b06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1874266701207936:0@lo:400:kworker.0 00000100:00100000:0.0:1787440171.423568:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440171.423613:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee080b04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1874266701207552:0@lo:400:kworker.0 00000100:00100000:0.0:1787440171.423640:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440171.423659:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787440171.423666:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee080b04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874266701207680:0@lo:400:kworker.0 00000100:00100000:0.0:1787440171.423696:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440171.423730:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701207552 00000100:00100000:0.0:1787440171.423736:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701207552 00000100:00100000:0.0:1787440171.423790:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787440171.423799:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee05d27fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874266701207552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787440171.423847:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee05d27fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874266701207552:12345-0@lo:400:kworker.0 Request processed in 49us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440171.423853:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787440171.423873:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701207936 00000100:00100000:0.0:1787440171.423877:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701207936 00000100:00100000:0.0:1787440171.423900:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701207680 00000100:00100000:0.0:1787440171.423903:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701207680 00000100:00100000:0.0:1787440171.423916:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787440171.423922:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee05d27df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1874266701207936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787440171.423957:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee05d27df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1874266701207936:12345-0@lo:400:kworker.0 Request processed in 35us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440171.424111:0:6697:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1787440171.424119:0:6697:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00080000:2.0:1787440171.424135:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787440171.424140:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787440171.424480:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787440171.424584:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787440171.424591:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee05d27e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1874266701207680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787440171.424624:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee05d27e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1874266701207680:12345-0@lo:400:kworker.0 Request processed in 34us (928us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440171.424629:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:0.0:1787440171.426378:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ee080b04380 x1874266701207680/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787440187 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787440171.426396:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee080b04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874266701207680:0@lo:400:kworker.0 00000100:00100000:0.0:1787440171.426409:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee080b04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1874266701207552:0@lo:400:kworker.0 00010000:00080000:0.0:1787440171.426457:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ee080b06a00 x1874266701207936/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787440187 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787440171.426467:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee080b06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1874266701207936:0@lo:400:kworker.0 00000001:02000400:3.0:1787440171.527155:0:9240:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.57.64 00000100:00100000:0.0:1787440171.932748:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee0806b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874266701208064:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787440171.932860:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440171.932964:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701208064 00000100:00100000:0.0:1787440171.932973:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701208064 00000100:00100000:0.0:1787440171.933030:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787440171.933040:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee05d27c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874266701208064:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787440171.933087:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787440171.933149:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee05d27c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874266701208064:12345-0@lo:13:osp-pre-1-0.0 Request processed in 110us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440171.933157:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:0.0:1787440171.933206:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ee0806b7b80 x1874266701208064/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787440187 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787440171.933229:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee0806b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874266701208064:0@lo:13:osp-pre-1-0.0 00000001:00100000:1.0:1787440171.988860:0:7640:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 792563a7-4c22-4ac7-ac25-d49ef7fb41a8 00000020:00000080:1.0:1787440171.988868:0:7640:0:(genops.c:885:class_export_put()) final put ffff8ee077fa2800/792563a7-4c22-4ac7-ac25-d49ef7fb41a8 00000020:00000080:1.0:1787440171.988898:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8ee077fa2800/792563a7-4c22-4ac7-ac25-d49ef7fb41a8 for lustre-OST0001 00000020:00000080:1.0:1787440171.988941:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ee077fa5000 for lustre-OST0001 00010000:00010000:0.0:1787440172.126448:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787440172.607336:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440172.607393:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440172.607576:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681253888 00000100:00100000:1.0:1787440172.607576:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681254016 00000100:00100000:3.0:1787440172.607589:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681253888 00000100:00100000:1.0:1787440172.607590:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681254016 00000100:00100000:1.0:1787440172.607663:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 43 00000100:00100000:3.0:1787440172.607664:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 199 00000100:00100000:3.0:1787440172.607679:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04ca1c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+10:2363:x1874266681253888:12345-192.168.206.58@tcp:400:kworker.0 00000100:00100000:1.0:1787440172.607682:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee05d27e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+6:2363:x1874266681254016:12345-192.168.206.58@tcp:400:kworker.0 00000100:00080000:0.0:1787440172.607786:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787440172.613435:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04ca1c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+10:2363:x1874266681253888:12345-192.168.206.58@tcp:400:kworker.0 Request processed in 5730us (6084us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440172.615791:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 199 00000100:00100000:1.0:1787440172.619598:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee05d27e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+6:2363:x1874266681254016:12345-192.168.206.58@tcp:400:kworker.0 Request processed in 11903us (12185us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440172.619618:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 43 00010000:00010000:1.0:1787440173.148993:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787440174.116919:0:9338:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.57.64 00010000:00010000:2.0:1787440174.177398:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787440175.197882:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787440175.517767:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787440175.517791:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee0806b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874266701208192:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787440175.517861:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440175.517978:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701208192 00000100:00100000:1.0:1787440175.517986:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701208192 00000100:00100000:1.0:1787440175.518051:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787440175.518060:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee077838000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874266701208192:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787440175.518092:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787440175.518139:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee077838000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874266701208192:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440175.518147:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:1.0:1787440175.518184:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ee0806b4e00 x1874266701208192/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787440191 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787440175.518201:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee0806b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874266701208192:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787440175.518301:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787440176.230217:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787440176.376820:0:9435:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.57.64 00000100:00100000:3.0:1787440176.540799:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee077839880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1874266701208576:0@lo:400:kworker.0 00000100:00100000:3.0:1787440176.540868:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440176.540939:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787440176.540945:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee07783b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874266701208704:0@lo:400:kworker.0 00000100:00100000:3.0:1787440176.540972:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440176.541008:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701208704 00000100:00100000:3.0:1787440176.541015:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701208704 00000100:00100000:3.0:1787440176.541060:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787440176.541069:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04a659500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1874266701208704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440176.541117:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04a659500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1874266701208704:12345-0@lo:400:kworker.0 Request processed in 49us (144us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440176.541138:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:3.0:1787440176.541180:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ee07783b800 x1874266701208704/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787440192 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787440176.541193:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee07783b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874266701208704:0@lo:400:kworker.0 00000100:00100000:1.0:1787440176.541261:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee077839c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874266701208448:0@lo:400:kworker.0 00000100:00100000:1.0:1787440176.541290:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440176.541315:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee077839180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1874266701208960:0@lo:400:kworker.0 00000100:00100000:1.0:1787440176.541333:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440176.541355:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1787440176.541360:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee07783ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:168176ea-29d1-49de-a254-317e90d54802:3310:1874266701208320:0@lo:400:kworker.0 00000100:00100000:1.0:1787440176.541415:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440176.541434:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee077838e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3310:1874266701208832:0@lo:400:kworker.0 00000100:00100000:1.0:1787440176.541455:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440176.541477:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701208960 00000100:00100000:1.0:1787440176.541481:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701208960 00000100:00100000:1.0:1787440176.541539:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787440176.541545:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee0806b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1874266701208960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440176.541577:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee0806b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1874266701208960:12345-0@lo:400:kworker.0 Request processed in 33us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440176.541583:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787440176.541601:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701208320 00000100:00100000:1.0:1787440176.541604:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701208320 00000100:00100000:1.0:1787440176.541626:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:1.0:1787440176.541632:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04ca1e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:168176ea-29d1-49de-a254-317e90d54802+19:3310:x1874266701208320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440176.541657:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04ca1e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:168176ea-29d1-49de-a254-317e90d54802+19:3310:x1874266701208320:12345-0@lo:400:kworker.0 Request processed in 25us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440176.541663:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:1.0:1787440176.541685:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701208576 00000100:00100000:1.0:1787440176.541687:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701208576 00000100:00100000:1.0:1787440176.541709:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701208448 00000100:00100000:1.0:1787440176.541723:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701208448 00000100:00100000:1.0:1787440176.541735:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701208832 00000100:00100000:1.0:1787440176.541737:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701208832 00000100:00100000:1.0:1787440176.541750:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787440176.541755:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04a65b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874266701208576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440176.541786:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04a65b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874266701208576:12345-0@lo:400:kworker.0 Request processed in 30us (918us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440176.541800:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787440176.541812:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787440176.541817:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee0806b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874266701208448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440176.541842:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee0806b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874266701208448:12345-0@lo:400:kworker.0 Request processed in 24us (551us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440176.541847:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787440176.541856:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787440176.541861:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee0806b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874266701208832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440176.541882:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee0806b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874266701208832:12345-0@lo:400:kworker.0 Request processed in 22us (427us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440176.541887:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:1.0:1787440176.541900:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787440176.541904:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787440176.541923:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee07783ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:168176ea-29d1-49de-a254-317e90d54802:3310:1874266701208320:0@lo:400:kworker.0 00000100:00100000:1.0:1787440176.541933:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee077838e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3310:1874266701208832:0@lo:400:kworker.0 00000100:00100000:1.0:1787440176.541940:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee077839c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874266701208448:0@lo:400:kworker.0 00010000:00080000:1.0:1787440176.541949:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ee077839180 x1874266701208960/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787440192 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787440176.541957:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee077839180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1874266701208960:0@lo:400:kworker.0 00000100:00100000:1.0:1787440176.541985:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee077839880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1874266701208576:0@lo:400:kworker.0 00000100:00100000:1.0:1787440177.053137:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787440177.053158:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee0806b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1874266701209088:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787440177.053218:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440177.053294:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701209088 00000100:00100000:1.0:1787440177.053301:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701209088 00000100:00100000:1.0:1787440177.053342:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787440177.053350:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee047a21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874266701209088:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787440177.053380:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787440177.053436:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee047a21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874266701209088:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440177.053443:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:1.0:1787440177.053479:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ee0806b6d80 x1874266701209088/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787440193 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787440177.053514:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee0806b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1874266701209088:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787440177.245287:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787440177.727785:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:2.0:1787440177.727828:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440177.727886:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681254272 00000100:00100000:3.0:1787440177.727894:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681254272 00000100:00100000:3.0:1787440177.728008:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 47 00000100:00100000:3.0:1787440177.728019:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee080324e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+6:2360:x1874266681254272:12345-192.168.206.58@tcp:400:kworker.0 00000100:00100000:3.0:1787440177.728165:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee080324e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+6:2360:x1874266681254272:12345-192.168.206.58@tcp:400:kworker.0 Request processed in 147us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440177.728173:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 47 00000100:00100000:3.0:1787440177.728200:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681254144 00000100:00100000:3.0:1787440177.728203:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681254144 00000100:00100000:3.0:1787440177.728309:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 201 00000100:00100000:3.0:1787440177.728316:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04ca1f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+10:2360:x1874266681254144:12345-192.168.206.58@tcp:400:kworker.0 00000100:00100000:3.0:1787440177.728343:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04ca1f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+10:2360:x1874266681254144:12345-192.168.206.58@tcp:400:kworker.0 Request processed in 27us (514us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440177.728349:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 201 00000100:00080000:2.0:1787440177.731742:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:0.0:1787440178.112648:0:9485:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Sat Aug 22 19:09:36 EDT 2026 00010000:00010000:2.0:1787440178.268829:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787440179.295594:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787440180.321778:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787440180.639991:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787440180.640026:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee077838a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874266701209216:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787440180.640425:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440180.640872:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701209216 00000100:00100000:3.0:1787440180.640885:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701209216 00000100:00100000:3.0:1787440180.640977:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00080000:2.0:1787440180.640981:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787440180.640992:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee07783a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874266701209216:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787440180.641047:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787440180.644434:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee07783a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874266701209216:12345-0@lo:13:osp-pre-0-0.0 Request processed in 3434us (3997us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440180.644468:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:0.0:1787440180.644600:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ee077838a80 x1874266701209216/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787440196 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787440180.644643:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee077838a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874266701209216:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787440181.341564:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787440181.662884:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee04a65a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:168176ea-29d1-49de-a254-317e90d54802:3309:1874266701209344:0@lo:400:kworker.0 00000100:00100000:3.0:1787440181.662987:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440181.663045:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee04a658700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1874266701209856:0@lo:400:kworker.0 00000100:00100000:3.0:1787440181.663078:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440181.663111:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787440181.663117:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee04a65bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874266701209472:0@lo:400:kworker.0 00000100:00100000:3.0:1787440181.663141:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440181.663159:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee04a65a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874266701209984:0@lo:400:kworker.0 00000100:00100000:3.0:1787440181.663182:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440181.663215:0:6892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701209856 00000100:00100000:3.0:1787440181.663224:0:6892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701209856 00000100:00100000:3.0:1787440181.663284:0:6892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701209472 00000100:00100000:3.0:1787440181.663287:0:6892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701209472 00000100:00100000:3.0:1787440181.663308:0:6892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787440181.663316:0:6892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04a658380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1874266701209856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787440181.663542:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee04a659f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1874266701209600:0@lo:400:kworker.0 00000100:00100000:1.0:1787440181.663782:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701209344 00000100:00100000:1.0:1787440181.663787:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701209344 00000100:00100000:1.0:1787440181.663824:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:1.0:1787440181.663832:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04ca1d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:168176ea-29d1-49de-a254-317e90d54802+19:3309:x1874266701209344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787440181.663935:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee04a65aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1874266701209728:0@lo:400:kworker.0 00000100:00100000:0.0:1787440181.664075:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440181.664112:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701209600 00000100:00100000:0.0:1787440181.664116:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701209600 00000100:00100000:0.0:1787440181.664142:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787440181.664150:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04a65b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874266701209472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787440181.664187:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04a65b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874266701209472:12345-0@lo:400:kworker.0 Request processed in 38us (1045us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440181.664195:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787440181.664214:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787440181.664221:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee077838a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874266701209600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787440181.664252:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee077838a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874266701209600:12345-0@lo:400:kworker.0 Request processed in 31us (177us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440181.664259:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787440181.664302:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee04a659f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1874266701209600:0@lo:400:kworker.0 00000100:00100000:1.0:1787440181.664393:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04ca1d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:168176ea-29d1-49de-a254-317e90d54802+19:3309:x1874266701209344:12345-0@lo:400:kworker.0 Request processed in 561us (1406us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440181.664400:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:2.0:1787440181.664960:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787440181.665008:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787440181.665024:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701209984 00000100:00100000:2.0:1787440181.665030:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701209984 00000100:00100000:2.0:1787440181.665069:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701209728 00000100:00100000:2.0:1787440181.665072:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701209728 00000100:00100000:2.0:1787440181.665093:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787440181.665101:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee049047800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1874266701209984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787440181.665146:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee049047800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1874266701209984:12345-0@lo:400:kworker.0 Request processed in 46us (1962us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440181.665153:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787440181.665169:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787440181.665175:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee080327100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1874266701209728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787440181.665211:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee080327100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1874266701209728:12345-0@lo:400:kworker.0 Request processed in 37us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440181.665237:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:2.0:1787440181.665254:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1787440181.665286:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ee04a65aa00 x1874266701209728/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787440197 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787440181.665299:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee04a65aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1874266701209728:0@lo:400:kworker.0 00000100:00100000:3.0:1787440181.671257:0:6892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04a658380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1874266701209856:12345-0@lo:400:kworker.0 Request processed in 7927us (8163us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440181.671274:0:6892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787440181.671390:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee04a65bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874266701209472:0@lo:400:kworker.0 00010000:00080000:2.0:1787440181.671411:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ee04a65a680 x1874266701209984/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787440197 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787440181.671423:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee04a65a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874266701209984:0@lo:400:kworker.0 00000100:00100000:2.0:1787440181.671435:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee04a65a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:168176ea-29d1-49de-a254-317e90d54802:3309:1874266701209344:0@lo:400:kworker.0 00000100:00100000:2.0:1787440181.671447:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee04a658700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1874266701209856:0@lo:400:kworker.0 00000100:00100000:3.0:1787440182.177140:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787440182.177183:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee077839880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1874266701210112:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787440182.178326:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440182.178595:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701210112 00000100:00100000:0.0:1787440182.178625:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701210112 00000100:00100000:0.0:1787440182.178702:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787440182.178714:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee049047480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874266701210112:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787440182.178764:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787440182.178831:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee049047480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874266701210112:12345-0@lo:13:osp-pre-1-0.0 Request processed in 119us (1250us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440182.178839:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:3.0:1787440182.179231:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ee077839880 x1874266701210112/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787440198 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787440182.181807:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee077839880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1874266701210112:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787440182.365771:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787440182.841204:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:2.0:1787440182.841274:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:1.0:1787440182.841667:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681254400 00000100:00100000:1.0:1787440182.841686:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681254400 00000100:00100000:1.0:1787440182.841745:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 203 00000100:00100000:1.0:1787440182.841756:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04ca1e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+10:2362:x1874266681254400:12345-192.168.206.58@tcp:400:kworker.0 00000100:00100000:1.0:1787440182.841837:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04ca1e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+10:2362:x1874266681254400:12345-192.168.206.58@tcp:400:kworker.0 Request processed in 83us (573us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440182.841860:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 203 00000100:00100000:0.0:1787440182.843332:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681254528 00000100:00100000:0.0:1787440182.843344:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681254528 00000100:00100000:0.0:1787440182.843434:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 51 00000100:00100000:0.0:1787440182.843443:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee080325500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+6:2362:x1874266681254528:12345-192.168.206.58@tcp:400:kworker.0 00000100:00100000:0.0:1787440182.843555:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee080325500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+6:2362:x1874266681254528:12345-192.168.206.58@tcp:400:kworker.0 Request processed in 113us (2363us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440182.843564:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 51 00000100:00080000:2.0:1787440182.844084:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787440183.397988:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787440184.412816:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787440185.436784:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787440185.762329:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee047a23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1874266701210240:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787440185.762426:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440185.762586:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701210240 00000100:00100000:1.0:1787440185.762595:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701210240 00000100:00100000:1.0:1787440185.762672:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787440185.762684:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee080326300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874266701210240:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787440185.762732:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787440185.762785:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee080326300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874266701210240:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440185.762793:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:2.0:1787440185.763125:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787440185.763169:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ee047a23b80 x1874266701210240/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787440201 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787440185.763195:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee047a23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1874266701210240:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787440186.461731:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787440186.788779:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee047a21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874266701210496:0@lo:400:kworker.0 00000100:00100000:1.0:1787440186.788866:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440186.788924:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee0806b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1874266701211008:0@lo:400:kworker.0 00000100:00100000:1.0:1787440186.788950:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440186.788983:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1787440186.788989:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee047a22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:168176ea-29d1-49de-a254-317e90d54802:3310:1874266701210368:0@lo:400:kworker.0 00000100:00100000:1.0:1787440186.789033:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440186.789053:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee047a23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3310:1874266701210880:0@lo:400:kworker.0 00000100:00100000:1.0:1787440186.789075:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440186.789101:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee047a20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1874266701210624:0@lo:400:kworker.0 00000100:00100000:1.0:1787440186.789124:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440186.789143:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787440186.789148:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee047a22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874266701210752:0@lo:400:kworker.0 00000100:00100000:1.0:1787440186.789171:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440186.789204:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701210496 00000100:00100000:1.0:1787440186.789212:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701210496 00000100:00100000:1.0:1787440186.789278:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701210880 00000100:00100000:1.0:1787440186.789282:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701210880 00000100:00100000:1.0:1787440186.789304:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701210624 00000100:00100000:1.0:1787440186.789307:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701210624 00000100:00100000:1.0:1787440186.789324:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787440186.789332:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee0800a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874266701210496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440186.789383:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee0800a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874266701210496:12345-0@lo:400:kworker.0 Request processed in 51us (517us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440186.789391:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787440186.789410:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787440186.789416:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee0800a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874266701210880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440186.789442:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee0800a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874266701210880:12345-0@lo:400:kworker.0 Request processed in 27us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440186.789447:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787440186.789459:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787440186.789465:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee0800a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874266701210624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440186.789533:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee0800a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874266701210624:12345-0@lo:400:kworker.0 Request processed in 68us (408us total) trans 0 rc 0/0 00000100:00080000:2.0:1787440186.791477:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787440186.791526:0:9225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701211008 00000100:00100000:2.0:1787440186.791547:0:9225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701211008 00000100:00100000:2.0:1787440186.791592:0:9225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701210752 00000100:00100000:2.0:1787440186.791595:0:9225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701210752 00000100:00100000:2.0:1787440186.791626:0:9225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787440186.791634:0:9225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee0800a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1874266701211008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787440186.791716:0:9225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee0800a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1874266701211008:12345-0@lo:400:kworker.0 Request processed in 83us (2765us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440186.791723:0:9225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787440186.792038:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787440186.792070:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787440186.792079:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee0800a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1874266701210752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440186.792114:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee0800a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1874266701210752:12345-0@lo:400:kworker.0 Request processed in 38us (2943us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440186.792120:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787440186.792487:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701210368 00000100:00100000:2.0:1787440186.792511:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701210368 00000100:00100000:2.0:1787440186.792551:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1787440186.792558:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04ca1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:168176ea-29d1-49de-a254-317e90d54802+19:3310:x1874266701210368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787440186.792595:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04ca1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:168176ea-29d1-49de-a254-317e90d54802+19:3310:x1874266701210368:12345-0@lo:400:kworker.0 Request processed in 38us (3562us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440186.792602:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00080000:2.0:1787440186.792629:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1787440186.792680:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ee047a22300 x1874266701210752/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787440202 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787440186.792695:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee047a22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874266701210752:0@lo:400:kworker.0 00000100:00100000:2.0:1787440186.792709:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee047a20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1874266701210624:0@lo:400:kworker.0 00000100:00100000:2.0:1787440186.796430:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee047a22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:168176ea-29d1-49de-a254-317e90d54802:3310:1874266701210368:0@lo:400:kworker.0 00000100:00100000:2.0:1787440186.796452:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee047a23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3310:1874266701210880:0@lo:400:kworker.0 00000100:00100000:2.0:1787440186.796464:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee047a21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874266701210496:0@lo:400:kworker.0 00010000:00080000:2.0:1787440186.796477:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ee0806b6d80 x1874266701211008/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787440202 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787440186.798886:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee0806b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1874266701211008:0@lo:400:kworker.0 00000100:00100000:3.0:1787440187.294723:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee080327b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874266701211136:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787440187.294818:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440187.295597:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701211136 00000100:00100000:2.0:1787440187.295611:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701211136 00000100:00100000:2.0:1787440187.295799:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787440187.295813:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee05fb63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874266701211136:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787440187.295859:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787440187.299505:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee05fb63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874266701211136:12345-0@lo:13:osp-pre-1-0.0 Request processed in 3668us (4658us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440187.299525:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:3.0:1787440187.302630:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ee080327b80 x1874266701211136/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787440203 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787440187.302680:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee080327b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874266701211136:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787440187.486755:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787440187.961372:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:2.0:1787440187.961430:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:1.0:1787440187.961545:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681254656 00000100:00100000:1.0:1787440187.961560:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681254656 00000100:00100000:3.0:1787440187.961607:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681254784 00000100:00100000:3.0:1787440187.961614:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681254784 00000100:00100000:1.0:1787440187.961646:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 205 00000100:00100000:1.0:1787440187.961669:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04ca1f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+10:2361:x1874266681254656:12345-192.168.206.58@tcp:400:kworker.0 00000100:00100000:3.0:1787440187.961699:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 55 00000100:00100000:3.0:1787440187.961710:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee080327b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+6:2361:x1874266681254784:12345-192.168.206.58@tcp:400:kworker.0 00000100:00100000:1.0:1787440187.961766:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04ca1f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+10:2361:x1874266681254656:12345-192.168.206.58@tcp:400:kworker.0 Request processed in 101us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440187.961776:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 205 00000100:00080000:2.0:1787440187.962931:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787440187.963573:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee080327b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+6:2361:x1874266681254784:12345-192.168.206.58@tcp:400:kworker.0 Request processed in 1855us (2131us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440187.963587:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 55 00010000:00010000:1.0:1787440188.511722:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787440189.534150:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787440190.558082:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787440190.892866:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787440190.892888:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee0800a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874266701211264:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787440190.892950:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440190.893029:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701211264 00000100:00100000:1.0:1787440190.893036:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701211264 00000100:00100000:1.0:1787440190.893087:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787440190.893096:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee0800a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874266701211264:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787440190.893130:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787440190.893174:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee0800a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874266701211264:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440190.893182:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:1.0:1787440190.893203:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787440190.893232:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ee0800a7b80 x1874266701211264/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787440206 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787440190.893249:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee0800a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874266701211264:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787440191.581005:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787440191.900763:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee05fb61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1874266701211648:0@lo:400:kworker.0 00000100:00100000:3.0:1787440191.900829:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440191.900886:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787440191.900888:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee05fb62680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874266701211520:0@lo:400:kworker.0 00000100:00100000:3.0:1787440191.900891:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee047a7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874266701211776:0@lo:400:kworker.0 00000100:00100000:3.0:1787440191.900916:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440191.900916:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440191.900932:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee047a7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1874266701212032:0@lo:400:kworker.0 00000100:00100000:1.0:1787440191.900965:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440191.900996:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1787440191.901001:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee05fb62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:168176ea-29d1-49de-a254-317e90d54802:3310:1874266701211392:0@lo:400:kworker.0 00000100:00100000:1.0:1787440191.901027:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440191.901084:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701211648 00000100:00100000:2.0:1787440191.901093:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701211648 00000100:00100000:1.0:1787440191.901122:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee047a78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3310:1874266701211904:0@lo:400:kworker.0 00000100:00100000:2.0:1787440191.901144:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701211520 00000100:00100000:1.0:1787440191.901144:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440191.901147:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701211520 00000100:00100000:2.0:1787440191.901159:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701211904 00000100:00100000:2.0:1787440191.901161:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701211904 00000100:00100000:1.0:1787440191.901167:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701211776 00000100:00100000:1.0:1787440191.901169:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701211776 00000100:00100000:2.0:1787440191.901177:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787440191.901185:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee047a78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874266701211648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440191.901189:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701212032 00000100:00100000:1.0:1787440191.901191:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701212032 00000100:00100000:1.0:1787440191.901207:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787440191.901212:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee047a7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1874266701211776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787440191.901234:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee047a78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874266701211648:12345-0@lo:400:kworker.0 Request processed in 49us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440191.901238:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee047a7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1874266701211776:12345-0@lo:400:kworker.0 Request processed in 26us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440191.901241:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787440191.901244:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787440191.901257:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787440191.901257:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787440191.901262:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee0800a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1874266701212032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787440191.901263:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee0800a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874266701211520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440191.901290:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee0800a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1874266701212032:12345-0@lo:400:kworker.0 Request processed in 28us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440191.901296:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787440191.901313:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701211392 00000100:00100000:1.0:1787440191.901316:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701211392 00000100:00100000:3.0:1787440191.901319:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787440191.901327:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee0800a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874266701211904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440191.901338:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1787440191.901344:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04ca1f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:168176ea-29d1-49de-a254-317e90d54802+19:3310:x1874266701211392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787440191.907409:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee0800a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874266701211520:12345-0@lo:400:kworker.0 Request processed in 6137us (6483us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440191.907444:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:2.0:1787440191.907525:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787440191.907531:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1787440191.907960:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ee047a7aa00 x1874266701211776/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787440207 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787440191.907975:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee047a7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874266701211776:0@lo:400:kworker.0 00000100:00100000:2.0:1787440191.907990:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee05fb61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1874266701211648:0@lo:400:kworker.0 00000100:00100000:3.0:1787440191.914023:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee0800a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874266701211904:12345-0@lo:400:kworker.0 Request processed in 12690us (12870us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440191.914048:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787440191.916189:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04ca1f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:168176ea-29d1-49de-a254-317e90d54802+19:3310:x1874266701211392:12345-0@lo:400:kworker.0 Request processed in 14835us (15152us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440191.916219:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1787440191.916929:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee05fb62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:168176ea-29d1-49de-a254-317e90d54802:3310:1874266701211392:0@lo:400:kworker.0 00000100:00100000:0.0:1787440191.916950:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee047a78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3310:1874266701211904:0@lo:400:kworker.0 00000100:00100000:0.0:1787440191.916963:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee05fb62680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874266701211520:0@lo:400:kworker.0 00010000:00080000:0.0:1787440191.916977:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ee047a7a680 x1874266701212032/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787440207 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787440191.916988:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee047a7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1874266701212032:0@lo:400:kworker.0 00000100:00100000:0.0:1787440192.425824:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787440192.425846:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee077839180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1874266701212160:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787440192.425924:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440192.426680:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701212160 00000100:00100000:0.0:1787440192.426689:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701212160 00000100:00100000:0.0:1787440192.426745:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787440192.426754:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee077839c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874266701212160:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787440192.426788:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787440192.426836:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee077839c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874266701212160:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (912us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440192.426843:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:0.0:1787440192.426877:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ee077839180 x1874266701212160/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787440208 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787440192.426895:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee077839180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1874266701212160:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787440192.604861:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787440193.094863:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440193.094914:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:1.0:1787440193.095019:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681254912 00000100:00100000:1.0:1787440193.095029:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681254912 00000100:00100000:1.0:1787440193.095089:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 207 00000100:00100000:1.0:1787440193.095099:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04ca1d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+10:2363:x1874266681254912:12345-192.168.206.58@tcp:400:kworker.0 00000100:00100000:1.0:1787440193.095184:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04ca1d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+10:2363:x1874266681254912:12345-192.168.206.58@tcp:400:kworker.0 Request processed in 87us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440193.095191:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 207 00000100:00100000:2.0:1787440193.101116:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681255040 00000100:00100000:2.0:1787440193.101131:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681255040 00000100:00100000:2.0:1787440193.101228:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 59 00000100:00100000:2.0:1787440193.101239:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee047a78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+6:2363:x1874266681255040:12345-192.168.206.58@tcp:400:kworker.0 00000100:00100000:2.0:1787440193.101334:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee047a78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+6:2363:x1874266681255040:12345-192.168.206.58@tcp:400:kworker.0 Request processed in 97us (6418us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440193.101342:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 59 00000100:00080000:1.0:1787440193.103252:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787440193.629368:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787440194.653268:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787440195.109319:0:10115:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 19:09:53 (1787440193) === 00000100:00100000:2.0:1787440195.478324:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:1.0:1787440195.478548:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681255168 00000100:00100000:1.0:1787440195.478558:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681255168 00000100:00100000:1.0:1787440195.478627:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 208 00000100:00100000:1.0:1787440195.478637:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04ca1d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+10:8138:x1874266681255168:12345-192.168.206.58@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787440195.478653:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440195.478670:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ee059185c00/0x85f5fa77adf3c32c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fab14535dc6209d expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440195.478697:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ee059185c00/0x85f5fa77adf3c32c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6209d expref: 11 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440195.478708:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ee059185c00/0x85f5fa77adf3c32c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6209d expref: 11 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440195.478717:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee059185c00, rc 0) 00000100:00100000:1.0:1787440195.478778:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04ca1d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+11:8138:x1874266681255168:12345-192.168.206.58@tcp:101:mount.lustre.0 Request processed in 143us (475us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440195.478785:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 208 00000100:00100000:3.0:1787440195.490668:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:2.0:1787440195.491204:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681255296 00000100:00100000:2.0:1787440195.491218:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681255296 00000100:00100000:2.0:1787440195.491303:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 209 00000100:00100000:2.0:1787440195.491315:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04ca1c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+11:8138:x1874266681255296:12345-192.168.206.58@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787440195.498661:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04ca1c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+11:8138:x1874266681255296:12345-192.168.206.58@tcp:501:mount.lustre.0 Request processed in 7337us (7999us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440195.498675:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 209 00000100:00100000:0.0:1787440195.518242:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:2.0:1787440195.518461:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681255424 00000100:00100000:2.0:1787440195.518471:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681255424 00000100:00100000:2.0:1787440195.518582:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 210 00000100:00100000:2.0:1787440195.518593:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04ca1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+11:8138:x1874266681255424:12345-192.168.206.58@tcp:503:mount.lustre.0 00000100:00100000:2.0:1787440195.518830:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04ca1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+11:8138:x1874266681255424:12345-192.168.206.58@tcp:503:mount.lustre.0 Request processed in 238us (596us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440195.518840:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 210 00000100:00100000:3.0:1787440195.523143:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440195.523220:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681255552 00000100:00100000:0.0:1787440195.523232:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681255552 00000100:00100000:0.0:1787440195.523292:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 211 00000100:00100000:0.0:1787440195.523302:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04a69a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+11:8142:x1874266681255552:12345-192.168.206.58@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787440195.523711:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04a69a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+11:8142:x1874266681255552:12345-192.168.206.58@tcp:502:llog_process_th.0 Request processed in 409us (581us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440195.523721:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 211 00000100:00100000:0.0:1787440195.547123:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440195.547240:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681255680 00000100:00100000:3.0:1787440195.547250:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681255680 00000100:00100000:3.0:1787440195.547305:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 212 00000100:00100000:3.0:1787440195.547313:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04a69b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+11:8142:x1874266681255680:12345-192.168.206.58@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787440195.547806:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04a69b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+11:8142:x1874266681255680:12345-192.168.206.58@tcp:502:llog_process_th.0 Request processed in 492us (690us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440195.547815:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 212 00000100:00100000:3.0:1787440195.555925:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:1.0:1787440195.559148:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681255808 00000100:00100000:1.0:1787440195.559164:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681255808 00000100:00100000:1.0:1787440195.559241:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 213 00000100:00100000:1.0:1787440195.559251:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04a699850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+11:8138:x1874266681255808:12345-192.168.206.58@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787440195.559268:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440195.559286:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ee059185200/0x85f5fa77adf3c333 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fab14535dc620c7 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440195.559324:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ee059185200/0x85f5fa77adf3c333 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc620c7 expref: 12 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440195.559336:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ee059185200/0x85f5fa77adf3c333 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc620c7 expref: 12 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440195.559344:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee059185200, rc 0) 00000100:00100000:1.0:1787440195.559411:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04a699850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+12:8138:x1874266681255808:12345-192.168.206.58@tcp:101:mount.lustre.0 Request processed in 162us (3495us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440195.559418:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 213 00000100:00100000:2.0:1787440195.578319:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440195.578540:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681255936 00000100:00100000:3.0:1787440195.578550:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681255936 00000100:00100000:3.0:1787440195.578624:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 214 00000100:00100000:3.0:1787440195.578635:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04a69a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+12:8138:x1874266681255936:12345-192.168.206.58@tcp:256:mount.lustre.0 20000000:01000000:3.0:1787440195.578662:0:5842:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1787440195.578685:0:5842:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1787440195.578690:0:5842:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1787440195.578693:0:5842:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1787440195.578696:0:5842:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:1.0:1787440195.587269:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04a69a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+12:8138:x1874266681255936:12345-192.168.206.58@tcp:256:mount.lustre.0 Request processed in 8626us (8949us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440195.587284:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 214 00000100:00100000:0.0:1787440195.594922:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:2.0:1787440195.595023:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681256064 00000100:00100000:2.0:1787440195.595034:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681256064 00000100:00100000:2.0:1787440195.595102:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 215 00000100:00100000:2.0:1787440195.595111:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04a698c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+12:8138:x1874266681256064:12345-192.168.206.58@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787440195.595131:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440195.595148:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ee07f86e600/0x85f5fa77adf3c33a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fab14535dc620ce expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440195.595182:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ee07f86e600/0x85f5fa77adf3c33a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc620ce expref: 13 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440195.595556:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ee07f86e600/0x85f5fa77adf3c33a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc620ce expref: 13 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440195.595567:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee07f86e600, rc 0) 00000100:00100000:2.0:1787440195.595654:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04a698c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+13:8138:x1874266681256064:12345-192.168.206.58@tcp:101:mount.lustre.0 Request processed in 544us (740us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440195.595662:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 215 00000100:00100000:2.0:1787440195.601259:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:1.0:1787440195.601364:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681256192 00000100:00100000:1.0:1787440195.601373:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681256192 00000100:00100000:1.0:1787440195.601433:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 216 00000100:00100000:1.0:1787440195.601441:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04a69b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+13:8138:x1874266681256192:12345-192.168.206.58@tcp:501:mount.lustre.0 00000100:00100000:1.0:1787440195.601777:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04a69b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+13:8138:x1874266681256192:12345-192.168.206.58@tcp:501:mount.lustre.0 Request processed in 335us (525us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440195.601796:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 216 00000100:00100000:3.0:1787440195.611232:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:2.0:1787440195.611379:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681256320 00000100:00100000:2.0:1787440195.611403:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681256320 00000100:00100000:2.0:1787440195.611487:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 217 00000100:00100000:2.0:1787440195.611541:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04a69b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+13:8138:x1874266681256320:12345-192.168.206.58@tcp:503:mount.lustre.0 00000100:00100000:2.0:1787440195.611784:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04a69b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+13:8138:x1874266681256320:12345-192.168.206.58@tcp:503:mount.lustre.0 Request processed in 245us (565us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440195.611792:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 217 00000100:00100000:0.0:1787440195.615202:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:2.0:1787440195.616946:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681256448 00000100:00100000:2.0:1787440195.616958:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681256448 00000100:00100000:2.0:1787440195.617025:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 218 00000100:00100000:2.0:1787440195.617035:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04a699450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+13:8146:x1874266681256448:12345-192.168.206.58@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787440195.617279:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04a699450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+13:8146:x1874266681256448:12345-192.168.206.58@tcp:502:llog_process_th.0 Request processed in 245us (2087us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440195.617288:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 218 00000100:00100000:3.0:1787440195.619026:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:1.0:1787440195.620698:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681256576 00000100:00100000:1.0:1787440195.620719:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681256576 00000100:00100000:1.0:1787440195.620819:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 219 00000100:00100000:1.0:1787440195.620831:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04a699050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+13:8146:x1874266681256576:12345-192.168.206.58@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787440195.622237:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04a699050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+13:8146:x1874266681256576:12345-192.168.206.58@tcp:502:llog_process_th.0 Request processed in 1397us (3214us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440195.622252:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 219 00000100:00100000:3.0:1787440195.630389:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:2.0:1787440195.631461:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681256704 00000100:00100000:2.0:1787440195.631477:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681256704 00000100:00100000:2.0:1787440195.631567:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 10 00000100:00100000:2.0:1787440195.631576:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee047a7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2359:x1874266681256704:12345-192.168.206.58@tcp:38:mount.lustre.0 00010000:00080000:2.0:1787440195.631624:0:5851:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from fde7b340-91f7-42a0-a1a3-5665ea2691c9@192.168.206.58@tcp t0 exp 0000000000000000 cur 294 last 0 00000020:00000080:2.0:1787440195.631670:0:5851:0:(genops.c:1385:class_connect()) connect: client fde7b340-91f7-42a0-a1a3-5665ea2691c9, cookie 0x85f5fa77adf3c341 00000004:00100000:2.0:1787440195.631708:0:5851:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00100000:0.0:1787440195.633825:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440195.633931:0:6892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681257088 00000100:00100000:3.0:1787440195.633943:0:6892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681257088 00000100:00100000:3.0:1787440195.634034:0:6892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 60 00000100:00100000:3.0:1787440195.634046:0:6892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee077839180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+6:2360:x1874266681257088:12345-192.168.206.58@tcp:400:kworker.0 00000100:00100000:3.0:1787440195.634138:0:6892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee077839180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+6:2360:x1874266681257088:12345-192.168.206.58@tcp:400:kworker.0 Request processed in 95us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440195.634146:0:6892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 60 00000100:00080000:1.0:1787440195.634567:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787440195.635154:0:5851:0:(import.c:65:import_set_state_nolock()) ffff8ee080787000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787440195.635323:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee047a7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fde7b340-91f7-42a0-a1a3-5665ea2691c9+6:2359:x1874266681256704:12345-192.168.206.58@tcp:38:mount.lustre.0 Request processed in 3745us (4961us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440195.635344:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 10 00000100:00100000:0.0:1787440195.647766:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440195.647866:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440195.648429:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681256832 00000100:00100000:3.0:1787440195.648439:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681256832 00000100:00100000:3.0:1787440195.648528:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681256960 00000100:00100000:3.0:1787440195.648533:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681256960 00000100:00100000:3.0:1787440195.648558:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 11 00000100:00100000:3.0:1787440195.648567:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee077838e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fde7b340-91f7-42a0-a1a3-5665ea2691c9+7:0:x1874266681256832:12345-192.168.206.58@tcp:41:mount.lustre.0 00000004:00000024:3.0:1787440195.648619:0:5849:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1787440195.648708:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee077838e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fde7b340-91f7-42a0-a1a3-5665ea2691c9+7:0:x1874266681256832:12345-192.168.206.58@tcp:41:mount.lustre.0 Request processed in 141us (951us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440195.648716:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 11 00000100:00100000:3.0:1787440195.648734:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 12 00000100:00100000:3.0:1787440195.648741:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee07783ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fde7b340-91f7-42a0-a1a3-5665ea2691c9+6:8138:x1874266681256960:12345-192.168.206.58@tcp:41:mount.lustre.0 00000004:00000024:3.0:1787440195.648752:0:5849:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1787440195.648773:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee07783ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fde7b340-91f7-42a0-a1a3-5665ea2691c9+6:8138:x1874266681256960:12345-192.168.206.58@tcp:41:mount.lustre.0 Request processed in 34us (908us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440195.648779:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 12 00000100:00080000:1.0:1787440195.649229:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787440195.653280:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440195.654334:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681257216 00000100:00100000:0.0:1787440195.654347:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681257216 00000100:00100000:0.0:1787440195.654403:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 13 00000100:00100000:0.0:1787440195.654412:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee047a79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fde7b340-91f7-42a0-a1a3-5665ea2691c9+6:8138:x1874266681257216:12345-192.168.206.58@tcp:40:mount.lustre.0 00000100:00100000:0.0:1787440195.654520:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee047a79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fde7b340-91f7-42a0-a1a3-5665ea2691c9+6:8138:x1874266681257216:12345-192.168.206.58@tcp:40:mount.lustre.0 Request processed in 109us (1250us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440195.654528:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 13 00000100:00100000:3.0:1787440195.660167:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440195.660211:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440195.660259:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:2.0:1787440195.660414:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681257600 00000100:00100000:2.0:1787440195.660423:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681257600 00000100:00100000:2.0:1787440195.660480:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 1 00000100:00100000:2.0:1787440195.660518:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee047a79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fde7b340-91f7-42a0-a1a3-5665ea2691c9+6:8138:x1874266681257600:12345-192.168.206.58@tcp:33:mount.lustre.0 00000004:00200000:2.0:1787440195.660781:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:2.0:1787440195.660926:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee047a79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fde7b340-91f7-42a0-a1a3-5665ea2691c9+6:8138:x1874266681257600:12345-192.168.206.58@tcp:33:mount.lustre.0 Request processed in 436us (769us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440195.660934:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 1 00000100:00100000:1.0:1787440195.661273:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681257344 00000100:00100000:1.0:1787440195.661280:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681257344 00000100:00100000:1.0:1787440195.661323:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681257472 00000100:00100000:1.0:1787440195.661327:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681257472 00000100:00100000:1.0:1787440195.661354:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 12 00000100:00100000:1.0:1787440195.661360:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee047a78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2359:x1874266681257344:12345-192.168.206.58@tcp:8:mount.lustre.0 00010000:00080000:1.0:1787440195.661385:0:6697:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from fde7b340-91f7-42a0-a1a3-5665ea2691c9@192.168.206.58@tcp t0 exp 0000000000000000 cur 294 last 0 00000020:00000080:1.0:1787440195.661416:0:6697:0:(genops.c:1385:class_connect()) connect: client fde7b340-91f7-42a0-a1a3-5665ea2691c9, cookie 0x85f5fa77adf3c348 00002000:00100000:1.0:1787440195.661427:0:6697:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli fde7b340-91f7-42a0-a1a3-5665ea2691c9/ffff8ee077845000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113940 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787440195.661450:0:6697:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787440195.661835:0:6697:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1787440195.661863:0:6697:0:(import.c:65:import_set_state_nolock()) ffff8ee077847000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787440195.661912:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee047a78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fde7b340-91f7-42a0-a1a3-5665ea2691c9+6:2359:x1874266681257344:12345-192.168.206.58@tcp:8:mount.lustre.0 Request processed in 550us (1700us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440195.661930:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 12 00000100:00100000:1.0:1787440195.661949:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 13 00000100:00100000:1.0:1787440195.661954:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee047a7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2359:x1874266681257472:12345-192.168.206.58@tcp:8:mount.lustre.0 00010000:00080000:1.0:1787440195.661970:0:6697:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from fde7b340-91f7-42a0-a1a3-5665ea2691c9@192.168.206.58@tcp t0 exp 0000000000000000 cur 294 last 0 00000020:00000080:1.0:1787440195.661989:0:6697:0:(genops.c:1385:class_connect()) connect: client fde7b340-91f7-42a0-a1a3-5665ea2691c9, cookie 0x85f5fa77adf3c34f 00002000:00100000:1.0:1787440195.661995:0:6697:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli fde7b340-91f7-42a0-a1a3-5665ea2691c9/ffff8ee077843000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113940 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787440195.662011:0:6697:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787440195.662197:0:6697:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1787440195.662213:0:6697:0:(import.c:65:import_set_state_nolock()) ffff8ee077841000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787440195.662240:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee047a7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fde7b340-91f7-42a0-a1a3-5665ea2691c9+6:2359:x1874266681257472:12345-192.168.206.58@tcp:8:mount.lustre.0 Request processed in 284us (1981us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440195.662248:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 13 00010000:00010000:3.0:1787440195.676796:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787440195.997914:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee0800a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1874266701212288:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787440195.997979:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440195.998192:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701212288 00000100:00100000:1.0:1787440195.998200:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701212288 00000100:00100000:1.0:1787440195.998263:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787440195.998272:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee07783b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874266701212288:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787440195.998292:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787440195.998338:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee07783b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874266701212288:12345-0@lo:13:osp-pre-0-0.0 Request processed in 67us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440195.998344:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:3.0:1787440195.998406:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787440195.998424:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ee0800a6680 x1874266701212288/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787440211 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787440195.998446:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee0800a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1874266701212288:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787440196.703778:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787440197.023968:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee077839880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:168176ea-29d1-49de-a254-317e90d54802:3309:1874266701212416:0@lo:400:kworker.0 00000100:00100000:0.0:1787440197.024090:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440197.024162:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee04a65bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1874266701212928:0@lo:400:kworker.0 00000100:00100000:0.0:1787440197.024193:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440197.024224:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1787440197.024230:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee04a658700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874266701212544:0@lo:400:kworker.0 00000100:00100000:0.0:1787440197.024283:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440197.024306:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee04a65aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874266701213056:0@lo:400:kworker.0 00000100:00100000:0.0:1787440197.024333:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440197.024365:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee04a65a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1874266701212672:0@lo:400:kworker.0 00000100:00100000:0.0:1787440197.024391:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440197.024411:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787440197.024416:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee04a65a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874266701212800:0@lo:400:kworker.0 00000100:00100000:0.0:1787440197.024440:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440197.024477:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701212416 00000100:00100000:0.0:1787440197.024486:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701212416 00000100:00100000:0.0:1787440197.024584:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:0.0:1787440197.024595:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04a698050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:168176ea-29d1-49de-a254-317e90d54802+19:3309:x1874266701212416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787440197.024668:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04a698050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:168176ea-29d1-49de-a254-317e90d54802+19:3309:x1874266701212416:12345-0@lo:400:kworker.0 Request processed in 75us (579us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440197.024676:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:0.0:1787440197.024719:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701212928 00000100:00100000:0.0:1787440197.024724:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701212928 00000100:00100000:0.0:1787440197.024762:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701212544 00000100:00100000:0.0:1787440197.024766:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701212544 00000100:00100000:0.0:1787440197.024781:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701212672 00000100:00100000:0.0:1787440197.024784:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701212672 00000100:00100000:0.0:1787440197.024801:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787440197.024809:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04a659f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1874266701212928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787440197.024843:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04a659f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1874266701212928:12345-0@lo:400:kworker.0 Request processed in 35us (649us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440197.024849:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787440197.024862:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787440197.024868:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee077d7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874266701212544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787440197.024898:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee077d7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874266701212544:12345-0@lo:400:kworker.0 Request processed in 31us (615us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440197.024905:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787440197.024916:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787440197.024922:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee077d7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874266701212672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787440197.024955:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee077d7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874266701212672:12345-0@lo:400:kworker.0 Request processed in 33us (563us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440197.024961:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787440197.024988:0:9225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701213056 00000100:00100000:0.0:1787440197.024998:0:9225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701213056 00000100:00100000:0.0:1787440197.025027:0:9225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701212800 00000100:00100000:0.0:1787440197.025030:0:9225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701212800 00000100:00100000:0.0:1787440197.025054:0:9225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787440197.025061:0:9225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee077d78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1874266701213056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787440197.025094:0:9225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee077d78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1874266701213056:12345-0@lo:400:kworker.0 Request processed in 34us (760us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440197.025100:0:9225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787440197.025111:0:9225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787440197.025120:0:9225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee077d78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1874266701212800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787440197.025146:0:9225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee077d78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1874266701212800:12345-0@lo:400:kworker.0 Request processed in 30us (704us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440197.025151:0:9225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:0.0:1787440197.025199:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ee04a65a680 x1874266701212800/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787440213 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787440197.025214:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee04a65a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874266701212800:0@lo:400:kworker.0 00000100:00100000:0.0:1787440197.025225:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee04a65a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1874266701212672:0@lo:400:kworker.0 00000100:00100000:0.0:1787440197.025255:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee04a658700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874266701212544:0@lo:400:kworker.0 00010000:00080000:0.0:1787440197.025265:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ee04a65aa00 x1874266701213056/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787440213 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787440197.025275:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee04a65aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874266701213056:0@lo:400:kworker.0 00000100:00100000:0.0:1787440197.025284:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee077839880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:168176ea-29d1-49de-a254-317e90d54802:3309:1874266701212416:0@lo:400:kworker.0 00000100:00100000:0.0:1787440197.025293:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee04a65bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1874266701212928:0@lo:400:kworker.0 00000100:00080000:3.0:1787440197.025728:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787440197.025734:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787440197.025737:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00100000:0.0:1787440197.106929:0:5871:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of fde7b340-91f7-42a0-a1a3-5665ea2691c9 00000100:00100000:0.0:1787440197.535487:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee0800a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874266701213184:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787440197.535623:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440197.545579:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701213184 00000100:00100000:3.0:1787440197.545731:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701213184 00000100:00100000:3.0:1787440197.545791:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787440197.545802:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee077d7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874266701213184:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787440197.545828:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787440197.545981:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee077d7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874266701213184:12345-0@lo:13:osp-pre-1-0.0 Request processed in 180us (10356us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440197.545988:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:3.0:1787440197.546052:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ee0800a4380 x1874266701213184/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787440213 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787440197.546073:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee0800a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874266701213184:0@lo:13:osp-pre-1-0.0 00000001:00100000:1.0:1787440197.652511:0:7640:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of fde7b340-91f7-42a0-a1a3-5665ea2691c9 00010000:00010000:3.0:1787440197.727572:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787440198.753530:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787440199.692376:0:6723:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of fde7b340-91f7-42a0-a1a3-5665ea2691c9 00010000:00010000:3.0:1787440199.772773:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787440200.767701:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440200.767752:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440200.767783:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440200.767820:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440200.767852:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440200.767877:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681257984 00000100:00100000:0.0:1787440200.767889:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681257984 00000100:00100000:3.0:1787440200.767899:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681257856 00000100:00100000:3.0:1787440200.767903:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681257856 00000100:00100000:2.0:1787440200.767965:0:9225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681258240 00000100:00100000:1.0:1787440200.767968:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681257728 00000100:00100000:2.0:1787440200.767972:0:9225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681258240 00000100:00100000:0.0:1787440200.767972:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 64 00000100:00100000:0.0:1787440200.767988:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee047a79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fde7b340-91f7-42a0-a1a3-5665ea2691c9+5:2362:x1874266681257984:12345-192.168.206.58@tcp:400:kworker.0 00000100:00100000:1.0:1787440200.767992:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681257728 00000100:00100000:1.0:1787440200.768032:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 221 00000100:00100000:1.0:1787440200.768039:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04a69ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+13:2362:x1874266681257728:12345-192.168.206.58@tcp:400:kworker.0 00000100:00100000:1.0:1787440200.768081:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04a69ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+13:2362:x1874266681257728:12345-192.168.206.58@tcp:400:kworker.0 Request processed in 41us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440200.768081:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee047a79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fde7b340-91f7-42a0-a1a3-5665ea2691c9+5:2362:x1874266681257984:12345-192.168.206.58@tcp:400:kworker.0 Request processed in 98us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440200.768090:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 221 00000100:00100000:0.0:1787440200.768102:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 64 00000100:00100000:0.0:1787440200.768122:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681258112 00000100:00100000:0.0:1787440200.768125:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681258112 00000100:00100000:3.0:1787440200.771718:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 65 00000100:00100000:3.0:1787440200.771757:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee047a7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+6:2362:x1874266681257856:12345-192.168.206.58@tcp:400:kworker.0 00000100:00100000:3.0:1787440200.771882:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee047a7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+6:2362:x1874266681257856:12345-192.168.206.58@tcp:400:kworker.0 Request processed in 131us (4059us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440200.771891:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 65 00000100:00100000:2.0:1787440200.772262:0:9225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 37 00000100:00100000:2.0:1787440200.772273:0:9225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee047a78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fde7b340-91f7-42a0-a1a3-5665ea2691c9+5:2362:x1874266681258240:12345-192.168.206.58@tcp:400:kworker.0 00000100:00100000:2.0:1787440200.772317:0:9225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee047a78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fde7b340-91f7-42a0-a1a3-5665ea2691c9+5:2362:x1874266681258240:12345-192.168.206.58@tcp:400:kworker.0 Request processed in 47us (4533us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440200.772325:0:9225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 37 00000100:00100000:0.0:1787440200.774357:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 38 00000100:00100000:0.0:1787440200.774382:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee047a79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fde7b340-91f7-42a0-a1a3-5665ea2691c9+5:2362:x1874266681258112:12345-192.168.206.58@tcp:400:kworker.0 00000100:00100000:0.0:1787440200.774487:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee047a79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fde7b340-91f7-42a0-a1a3-5665ea2691c9+5:2362:x1874266681258112:12345-192.168.206.58@tcp:400:kworker.0 Request processed in 114us (6633us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440200.774516:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 38 00000100:00080000:1.0:1787440200.775548:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787440200.775559:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787440200.775563:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787440200.797080:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787440201.118207:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787440201.118255:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee0800a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874266701213312:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787440201.118354:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440201.119052:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701213312 00000100:00100000:1.0:1787440201.119063:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701213312 00000100:00100000:1.0:1787440201.119154:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787440201.119166:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee047a7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874266701213312:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787440201.119358:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787440201.119435:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee047a7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874266701213312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 271us (1079us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440201.119443:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:3.0:1787440201.119516:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787440201.119543:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ee0800a7800 x1874266701213312/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787440217 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787440201.119567:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee0800a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874266701213312:0@lo:13:osp-pre-0-0.0 00000001:02000400:0.0:1787440201.695279:0:10312:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg658-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:3.0:1787440201.821710:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787440202.141332:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee047a7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1874266701213696:0@lo:400:kworker.0 00000100:00100000:3.0:1787440202.141431:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440202.141956:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787440202.141968:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee047a78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874266701213824:0@lo:400:kworker.0 00000100:00100000:3.0:1787440202.142012:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440202.142068:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701213696 00000100:00100000:3.0:1787440202.142078:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701213696 00000100:00100000:1.0:1787440202.142228:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee047a79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874266701213568:0@lo:400:kworker.0 00000100:00100000:1.0:1787440202.142265:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440202.142686:0:9225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701213824 00000100:00100000:2.0:1787440202.142693:0:9225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701213824 00000100:00100000:2.0:1787440202.142730:0:9225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787440202.142739:0:9225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee08032e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1874266701213824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787440202.142850:0:9225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee08032e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1874266701213824:12345-0@lo:400:kworker.0 Request processed in 112us (838us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440202.142858:0:9225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:2.0:1787440202.142907:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ee047a78700 x1874266701213824/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787440218 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787440202.142942:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee047a78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874266701213824:0@lo:400:kworker.0 00000100:00080000:2.0:1787440202.142982:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787440202.143647:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee047a7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:168176ea-29d1-49de-a254-317e90d54802:3309:1874266701213440:0@lo:400:kworker.0 00000100:00100000:0.0:1787440202.143700:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440202.143734:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee047a7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1874266701213952:0@lo:400:kworker.0 00000100:00100000:0.0:1787440202.143927:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701213440 00000100:00100000:0.0:1787440202.143941:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701213440 00000100:00100000:0.0:1787440202.143980:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:0.0:1787440202.143986:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04a69a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:168176ea-29d1-49de-a254-317e90d54802+19:3309:x1874266701213440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787440202.144032:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04a69a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:168176ea-29d1-49de-a254-317e90d54802+19:3309:x1874266701213440:12345-0@lo:400:kworker.0 Request processed in 46us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440202.144039:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:1.0:1787440202.144975:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440202.145012:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee08032f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1874266701214080:0@lo:400:kworker.0 00000100:00100000:3.0:1787440202.145039:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701213568 00000100:00100000:3.0:1787440202.145048:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701213568 00000100:00100000:0.0:1787440202.145066:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440202.145099:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787440202.145110:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee08032d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874266701213696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787440202.145118:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701214080 00000100:00100000:0.0:1787440202.145135:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701214080 00000100:00100000:0.0:1787440202.145174:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787440202.145181:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee077d78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1874266701214080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440202.145223:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee08032d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874266701213696:12345-0@lo:400:kworker.0 Request processed in 115us (3792us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440202.145231:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787440202.145242:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee077d78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1874266701214080:12345-0@lo:400:kworker.0 Request processed in 59us (175us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440202.145250:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787440202.145252:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787440202.145260:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee0800a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874266701213568:12345-0@lo:400:kworker.0 00010000:00080000:0.0:1787440202.145300:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ee08032f100 x1874266701214080/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787440218 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787440202.145314:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee08032f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1874266701214080:0@lo:400:kworker.0 00000100:00100000:0.0:1787440202.145377:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee047a7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1874266701213696:0@lo:400:kworker.0 00000100:00100000:3.0:1787440202.145401:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee0800a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874266701213568:12345-0@lo:400:kworker.0 Request processed in 142us (3134us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440202.145488:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:0.0:1787440202.145553:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787440202.145599:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee047a79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874266701213568:0@lo:400:kworker.0 00000100:00100000:1.0:1787440202.145695:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee047a7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:168176ea-29d1-49de-a254-317e90d54802:3309:1874266701213440:0@lo:400:kworker.0 00000100:00100000:2.0:1787440202.145752:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701213952 00000100:00100000:2.0:1787440202.145757:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701213952 00000100:00100000:2.0:1787440202.145853:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787440202.145894:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee0800a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1874266701213952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787440202.145945:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee0800a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1874266701213952:12345-0@lo:400:kworker.0 Request processed in 84us (975us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440202.145951:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:1.0:1787440202.146091:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787440202.146110:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee047a7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1874266701213952:0@lo:400:kworker.0 00000100:00100000:3.0:1787440202.652727:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787440202.652760:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee08032fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1874266701214208:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787440202.652855:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440202.652954:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701214208 00000100:00100000:3.0:1787440202.652964:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701214208 00000100:00100000:3.0:1787440202.653041:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787440202.653052:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee08032df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874266701214208:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787440202.653105:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787440202.653160:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee08032df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874266701214208:12345-0@lo:13:osp-pre-1-0.0 Request processed in 110us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440202.653169:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:3.0:1787440202.653222:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ee08032fb80 x1874266701214208/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787440218 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787440202.653246:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee08032fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1874266701214208:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787440202.845481:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787440203.868973:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787440204.893087:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787440205.880806:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440205.880850:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440205.880887:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440205.880917:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440205.880942:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440205.881041:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681258368 00000100:00100000:0.0:1787440205.881052:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681258368 00000100:00100000:0.0:1787440205.881127:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 223 00000100:00100000:0.0:1787440205.881138:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04a69bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+13:2360:x1874266681258368:12345-192.168.206.58@tcp:400:kworker.0 00000100:00100000:0.0:1787440205.881235:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04a69bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+13:2360:x1874266681258368:12345-192.168.206.58@tcp:400:kworker.0 Request processed in 98us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440205.881256:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 223 00000100:00100000:0.0:1787440205.881295:0:6892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681258624 00000100:00100000:0.0:1787440205.881299:0:6892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681258624 00000100:00100000:0.0:1787440205.881333:0:6892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681258496 00000100:00100000:0.0:1787440205.881336:0:6892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681258496 00000100:00100000:0.0:1787440205.881355:0:6892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 69 00000100:00100000:0.0:1787440205.881362:0:6892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee08032fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fde7b340-91f7-42a0-a1a3-5665ea2691c9+5:2360:x1874266681258624:12345-192.168.206.58@tcp:400:kworker.0 00000100:00100000:0.0:1787440205.881397:0:6892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee08032fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fde7b340-91f7-42a0-a1a3-5665ea2691c9+5:2360:x1874266681258624:12345-192.168.206.58@tcp:400:kworker.0 Request processed in 35us (546us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440205.881404:0:6892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 69 00000100:00100000:0.0:1787440205.881417:0:6892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 70 00000100:00100000:0.0:1787440205.881424:0:6892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee08032c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+6:2360:x1874266681258496:12345-192.168.206.58@tcp:400:kworker.0 00000100:00100000:0.0:1787440205.881462:0:6892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee08032c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+6:2360:x1874266681258496:12345-192.168.206.58@tcp:400:kworker.0 Request processed in 39us (544us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440205.881468:0:6892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 70 00000100:00080000:1.0:1787440205.882198:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787440205.882332:0:9225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681258880 00000100:00100000:2.0:1787440205.882338:0:9225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681258880 00000100:00100000:2.0:1787440205.882391:0:9225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681258752 00000100:00100000:2.0:1787440205.882393:0:9225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681258752 00000100:00100000:2.0:1787440205.882426:0:9225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 41 00000100:00100000:2.0:1787440205.882434:0:9225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee08032ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fde7b340-91f7-42a0-a1a3-5665ea2691c9+5:2360:x1874266681258880:12345-192.168.206.58@tcp:400:kworker.0 00000100:00100000:2.0:1787440205.882475:0:9225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee08032ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fde7b340-91f7-42a0-a1a3-5665ea2691c9+5:2360:x1874266681258880:12345-192.168.206.58@tcp:400:kworker.0 Request processed in 42us (1587us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440205.882482:0:9225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 41 00000100:00100000:2.0:1787440205.882540:0:9225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 42 00000100:00100000:2.0:1787440205.882547:0:9225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee0806df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fde7b340-91f7-42a0-a1a3-5665ea2691c9+5:2360:x1874266681258752:12345-192.168.206.58@tcp:400:kworker.0 00000100:00100000:2.0:1787440205.882583:0:9225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee0806df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fde7b340-91f7-42a0-a1a3-5665ea2691c9+5:2360:x1874266681258752:12345-192.168.206.58@tcp:400:kworker.0 Request processed in 37us (1640us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440205.882589:0:9225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 42 00000100:00080000:1.0:1787440205.883174:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787440205.883189:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1787440205.916680:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787440206.236879:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787440206.239369:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee0800a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874266701214336:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787440206.239444:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440206.239636:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701214336 00000100:00100000:3.0:1787440206.239644:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701214336 00000100:00080000:1.0:1787440206.239698:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787440206.239727:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787440206.239737:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee077d7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874266701214336:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787440206.239983:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787440206.240074:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee077d7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874266701214336:12345-0@lo:13:osp-pre-0-0.0 Request processed in 339us (630us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440206.240081:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:0.0:1787440206.240483:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ee0800a5c00 x1874266701214336/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787440222 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787440206.240537:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee0800a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874266701214336:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787440206.943137:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787440207.261006:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee080324000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1874266701214848:0@lo:400:kworker.0 00000100:00100000:2.0:1787440207.261086:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440207.261149:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787440207.261155:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee080325880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3312:1874266701214720:0@lo:400:kworker.0 00000100:00100000:2.0:1787440207.261178:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440207.261207:0:9225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701214848 00000100:00100000:2.0:1787440207.261214:0:9225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701214848 00000100:00100000:2.0:1787440207.261274:0:9225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787440207.261284:0:9225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee080325c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1874266701214848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787440207.261337:0:6892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701214720 00000100:00100000:0.0:1787440207.261342:0:6892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701214720 00000100:00100000:0.0:1787440207.261381:0:6892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787440207.261389:0:6892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee080324700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874266701214720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787440207.261405:0:9225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee080325c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1874266701214848:12345-0@lo:400:kworker.0 Request processed in 120us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440207.261413:0:9225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787440207.261429:0:6892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee080324700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874266701214720:12345-0@lo:400:kworker.0 Request processed in 41us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440207.261436:0:6892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:0.0:1787440207.261452:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787440207.261579:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee080327100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874266701214592:0@lo:400:kworker.0 00000100:00100000:1.0:1787440207.261813:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee080327480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:168176ea-29d1-49de-a254-317e90d54802:3309:1874266701214464:0@lo:400:kworker.0 00000100:00100000:0.0:1787440207.262015:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee080325880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3312:1874266701214720:0@lo:400:kworker.0 00010000:00080000:0.0:1787440207.262029:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ee080324000 x1874266701214848/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787440223 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787440207.262039:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee080324000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1874266701214848:0@lo:400:kworker.0 00000100:00100000:0.0:1787440207.262663:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440207.262707:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee080326d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1874266701214976:0@lo:400:kworker.0 00000100:00100000:1.0:1787440207.262708:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701214464 00000100:00100000:1.0:1787440207.262714:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701214464 00000100:00100000:0.0:1787440207.262736:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440207.262749:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:1.0:1787440207.262757:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04a698450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:168176ea-29d1-49de-a254-317e90d54802+19:3309:x1874266701214464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787440207.262781:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701214976 00000100:00100000:0.0:1787440207.262784:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701214976 00000100:00100000:1.0:1787440207.262805:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04a698450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:168176ea-29d1-49de-a254-317e90d54802+19:3309:x1874266701214464:12345-0@lo:400:kworker.0 Request processed in 49us (143us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440207.262812:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1787440207.262814:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787440207.262821:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee077d79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1874266701214976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440207.262828:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440207.262865:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee077d79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1874266701214976:12345-0@lo:400:kworker.0 Request processed in 43us (126us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440207.262867:0:6892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701214592 00000100:00100000:3.0:1787440207.262872:0:6892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701214592 00000100:00100000:0.0:1787440207.262874:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787440207.262876:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee080327480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:168176ea-29d1-49de-a254-317e90d54802:3309:1874266701214464:0@lo:400:kworker.0 00000100:00100000:1.0:1787440207.262889:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee080326d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1874266701214976:0@lo:400:kworker.0 00000100:00080000:0.0:1787440207.262892:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787440207.262910:0:6892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787440207.262924:0:6892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee08032e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874266701214592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440207.263701:0:6892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee08032e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874266701214592:12345-0@lo:400:kworker.0 Request processed in 782us (873us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440207.263710:0:6892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787440207.263891:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee080327100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874266701214592:0@lo:400:kworker.0 00000100:00100000:2.0:1787440207.263902:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee080324380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1874266701215104:0@lo:400:kworker.0 00000100:00100000:2.0:1787440207.263934:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440207.264100:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701215104 00000100:00100000:3.0:1787440207.264105:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701215104 00000100:00100000:3.0:1787440207.264147:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00080000:0.0:1787440207.264153:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787440207.264155:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee080326d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1874266701215104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440207.264255:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee080326d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1874266701215104:12345-0@lo:400:kworker.0 Request processed in 101us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440207.264261:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:2.0:1787440207.264403:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ee080324380 x1874266701215104/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787440223 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787440207.264414:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee080324380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1874266701215104:0@lo:400:kworker.0 00000100:00100000:1.0:1787440207.773218:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787440207.773240:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee0800a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1874266701215232:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787440207.773323:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440207.773394:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701215232 00000100:00100000:1.0:1787440207.773401:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701215232 00000100:00100000:1.0:1787440207.773449:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787440207.773463:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee0800a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874266701215232:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787440207.773520:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787440207.773585:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee0800a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874266701215232:12345-0@lo:13:osp-pre-1-0.0 Request processed in 128us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440207.773592:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:3.0:1787440207.773730:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ee0800a5880 x1874266701215232/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787440223 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787440207.773748:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee0800a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1874266701215232:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787440207.964664:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787440208.989439:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787440210.012676:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787440211.001941:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:1.0:1787440211.001984:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:1.0:1787440211.002024:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:1.0:1787440211.002049:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:1.0:1787440211.002080:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681259520 00000100:00100000:1.0:1787440211.002089:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681259520 00000100:00100000:1.0:1787440211.002148:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 45 00000100:00100000:1.0:1787440211.002158:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee0800a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fde7b340-91f7-42a0-a1a3-5665ea2691c9+5:2363:x1874266681259520:12345-192.168.206.58@tcp:400:kworker.0 00000100:00100000:1.0:1787440211.002239:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee0800a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fde7b340-91f7-42a0-a1a3-5665ea2691c9+5:2363:x1874266681259520:12345-192.168.206.58@tcp:400:kworker.0 Request processed in 82us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440211.002246:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 45 00000100:00100000:3.0:1787440211.002306:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681259008 00000100:00100000:3.0:1787440211.002316:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681259008 00000100:00100000:3.0:1787440211.002350:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 225 00000100:00100000:3.0:1787440211.002357:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04a698850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+13:2363:x1874266681259008:12345-192.168.206.58@tcp:400:kworker.0 00000100:00100000:3.0:1787440211.002385:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04a698850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+13:2363:x1874266681259008:12345-192.168.206.58@tcp:400:kworker.0 Request processed in 27us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440211.002391:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 225 00000100:00100000:0.0:1787440211.002930:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681259136 00000100:00100000:0.0:1787440211.002936:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681259136 00000100:00100000:0.0:1787440211.002972:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681259264 00000100:00100000:0.0:1787440211.002983:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681259264 00000100:00100000:0.0:1787440211.003020:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 74 00000100:00100000:0.0:1787440211.003027:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee0800a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+6:2362:x1874266681259136:12345-192.168.206.58@tcp:400:kworker.0 00000100:00100000:0.0:1787440211.003071:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee0800a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+6:2362:x1874266681259136:12345-192.168.206.58@tcp:400:kworker.0 Request processed in 45us (1138us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440211.003077:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 74 00000100:00100000:0.0:1787440211.003091:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 75 00000100:00100000:0.0:1787440211.003097:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee0800a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fde7b340-91f7-42a0-a1a3-5665ea2691c9+5:2363:x1874266681259264:12345-192.168.206.58@tcp:400:kworker.0 00000100:00100000:0.0:1787440211.003119:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee0800a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fde7b340-91f7-42a0-a1a3-5665ea2691c9+5:2363:x1874266681259264:12345-192.168.206.58@tcp:400:kworker.0 Request processed in 23us (1096us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440211.003125:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 75 00000100:00080000:0.0:1787440211.003144:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787440211.003148:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787440211.005828:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440211.005905:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681259392 00000100:00100000:0.0:1787440211.005914:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681259392 00000100:00100000:0.0:1787440211.005979:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 46 00000100:00100000:0.0:1787440211.005989:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee08032c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fde7b340-91f7-42a0-a1a3-5665ea2691c9+5:2362:x1874266681259392:12345-192.168.206.58@tcp:400:kworker.0 00000100:00100000:0.0:1787440211.006054:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee08032c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fde7b340-91f7-42a0-a1a3-5665ea2691c9+5:2362:x1874266681259392:12345-192.168.206.58@tcp:400:kworker.0 Request processed in 67us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440211.006061:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 46 00000100:00080000:3.0:1787440211.006629:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787440211.043021:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787440211.356846:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787440211.356884:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee0800a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874266701215360:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787440211.356957:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440211.357085:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701215360 00000100:00100000:1.0:1787440211.357092:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701215360 00000100:00100000:1.0:1787440211.357157:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787440211.357168:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee077d79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874266701215360:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787440211.357200:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787440211.357243:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee077d79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874266701215360:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440211.357250:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:0.0:1787440211.357375:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787440211.357406:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ee0800a6300 x1874266701215360/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787440227 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787440211.357443:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee0800a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874266701215360:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787440212.060750:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787440212.380959:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee077d79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1874266701215744:0@lo:400:kworker.0 00000100:00100000:0.0:1787440212.381022:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440212.381087:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787440212.381094:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee077d78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874266701215872:0@lo:400:kworker.0 00000100:00100000:0.0:1787440212.381124:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440212.381166:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701215744 00000100:00100000:0.0:1787440212.381173:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701215744 00000100:00100000:0.0:1787440212.381227:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787440212.381237:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee077d7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874266701215744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787440212.381291:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee077d7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874266701215744:12345-0@lo:400:kworker.0 Request processed in 56us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440212.381293:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701215872 00000100:00100000:1.0:1787440212.381300:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701215872 00000100:00100000:0.0:1787440212.381304:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:0.0:1787440212.381329:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787440212.381334:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787440212.381344:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee077d7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1874266701215872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787440212.381363:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee077d79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1874266701215744:0@lo:400:kworker.0 00000100:00100000:2.0:1787440212.381456:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee077d78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:168176ea-29d1-49de-a254-317e90d54802:3309:1874266701215488:0@lo:400:kworker.0 00000100:00100000:2.0:1787440212.381489:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440212.381549:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee077d7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1874266701216000:0@lo:400:kworker.0 00000100:00100000:2.0:1787440212.381572:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440212.381589:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787440212.381594:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee077d7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874266701215616:0@lo:400:kworker.0 00000100:00100000:2.0:1787440212.381614:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440212.381644:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee077d79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874266701216128:0@lo:400:kworker.0 00000100:00100000:2.0:1787440212.381665:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440212.381702:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701216128 00000100:00100000:2.0:1787440212.381706:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701216128 00000100:00100000:2.0:1787440212.381742:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787440212.381750:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee080327480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1874266701216128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787440212.381751:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701215488 00000100:00100000:0.0:1787440212.381755:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701215488 00000100:00100000:0.0:1787440212.381778:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:2.0:1787440212.381783:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee080327480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1874266701216128:12345-0@lo:400:kworker.0 Request processed in 35us (117us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440212.381788:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:2.0:1787440212.381805:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1787440212.381823:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ee077d79500 x1874266701216128/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787440228 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787440212.381834:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee077d79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874266701216128:0@lo:400:kworker.0 00000100:00100000:0.0:1787440212.381836:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee043b4b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:168176ea-29d1-49de-a254-317e90d54802+19:3309:x1874266701215488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787440212.381861:0:6892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701216000 00000100:00100000:2.0:1787440212.381864:0:6892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701216000 00000100:00100000:0.0:1787440212.381871:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee043b4b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:168176ea-29d1-49de-a254-317e90d54802+19:3309:x1874266701215488:12345-0@lo:400:kworker.0 Request processed in 87us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440212.381877:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:2.0:1787440212.381889:0:6892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701215616 00000100:00100000:2.0:1787440212.381892:0:6892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701215616 00000100:00100000:2.0:1787440212.381910:0:6892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787440212.381923:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1787440212.381932:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee077d7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1874266701215872:12345-0@lo:400:kworker.0 Request processed in 589us (805us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440212.381933:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee080327100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874266701215616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440212.381948:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:1.0:1787440212.381989:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ee077d78e00 x1874266701215872/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787440228 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787440212.381990:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee080327100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874266701215616:12345-0@lo:400:kworker.0 Request processed in 58us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440212.382006:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1787440212.382023:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee077d78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874266701215872:0@lo:400:kworker.0 00000100:00100000:2.0:1787440212.382150:0:6892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee080324380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1874266701216000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440212.382168:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee077d7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874266701215616:0@lo:400:kworker.0 00000100:00100000:3.0:1787440212.382177:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee077d78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:168176ea-29d1-49de-a254-317e90d54802:3309:1874266701215488:0@lo:400:kworker.0 00000100:00100000:2.0:1787440212.382183:0:6892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee080324380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1874266701216000:12345-0@lo:400:kworker.0 Request processed in 267us (610us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440212.382186:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee077d7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1874266701216000:0@lo:400:kworker.0 00000100:00100000:2.0:1787440212.382189:0:6892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:2.0:1787440212.382202:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787440212.893615:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787440212.893638:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee08032f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1874266701216256:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787440212.893702:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440212.893779:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701216256 00000100:00100000:3.0:1787440212.893785:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701216256 00000100:00100000:3.0:1787440212.893825:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787440212.893833:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee08032c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874266701216256:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787440212.893867:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787440212.893917:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee08032c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874266701216256:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440212.893924:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:3.0:1787440212.893963:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ee08032f800 x1874266701216256/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787440228 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787440212.893995:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee08032f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1874266701216256:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787440213.085696:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787440214.109104:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787440215.136128:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787440216.123865:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440216.123914:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440216.123940:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440216.123961:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440216.123983:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440216.124013:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681259904 00000100:00100000:0.0:1787440216.124021:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681259904 00000100:00100000:0.0:1787440216.124088:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681259776 00000100:00100000:0.0:1787440216.124091:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681259776 00000100:00100000:0.0:1787440216.124115:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 79 00000100:00100000:0.0:1787440216.124123:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee077d79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fde7b340-91f7-42a0-a1a3-5665ea2691c9+5:2362:x1874266681259904:12345-192.168.206.58@tcp:400:kworker.0 00000100:00100000:0.0:1787440216.124189:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee077d79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fde7b340-91f7-42a0-a1a3-5665ea2691c9+5:2362:x1874266681259904:12345-192.168.206.58@tcp:400:kworker.0 Request processed in 65us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440216.124197:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 79 00000100:00100000:0.0:1787440216.124212:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 80 00000100:00100000:0.0:1787440216.124219:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee077d79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+6:2362:x1874266681259776:12345-192.168.206.58@tcp:400:kworker.0 00000100:00100000:0.0:1787440216.124242:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee077d79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+6:2362:x1874266681259776:12345-192.168.206.58@tcp:400:kworker.0 Request processed in 25us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440216.124249:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 80 00000100:00100000:0.0:1787440216.124269:0:9225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681260032 00000100:00100000:0.0:1787440216.124272:0:9225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681260032 00000100:00100000:0.0:1787440216.124297:0:9225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681260160 00000100:00100000:0.0:1787440216.124299:0:9225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681260160 00000100:00100000:0.0:1787440216.124341:0:9225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 14 00000100:00100000:0.0:1787440216.124348:0:9225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee077d7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fde7b340-91f7-42a0-a1a3-5665ea2691c9+5:2359:x1874266681260032:12345-192.168.206.58@tcp:9:kworker.0 00000020:00000080:0.0:1787440216.124365:0:9225:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x85f5fa77adf3c348 00000100:00080000:0.0:1787440216.124373:0:9225:0:(import.c:65:import_set_state_nolock()) ffff8ee077847000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787440216.124410:0:9225:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1787440216.124586:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681259648 00000100:00100000:3.0:1787440216.124590:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681259648 00000100:00100000:3.0:1787440216.124619:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 227 00000100:00100000:3.0:1787440216.124626:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee043b48450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+13:2362:x1874266681259648:12345-192.168.206.58@tcp:400:kworker.0 00000100:00100000:3.0:1787440216.124654:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee043b48450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+13:2362:x1874266681259648:12345-192.168.206.58@tcp:400:kworker.0 Request processed in 29us (797us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440216.124660:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 227 00000100:00100000:1.0:1787440216.127036:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 15 00000100:00100000:1.0:1787440216.127056:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee077d78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fde7b340-91f7-42a0-a1a3-5665ea2691c9+5:2359:x1874266681260160:12345-192.168.206.58@tcp:9:kworker.0 00000020:00000080:1.0:1787440216.127085:0:6697:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x85f5fa77adf3c34f 00000100:00080000:1.0:1787440216.127095:0:6697:0:(import.c:65:import_set_state_nolock()) ffff8ee077841000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787440216.127144:0:6697:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00010000:00010000:3.0:1787440216.127346:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787440216.127572:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee077d78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fde7b340-91f7-42a0-a1a3-5665ea2691c9+2:2359:x1874266681260160:12345-192.168.206.58@tcp:9:kworker.0 Request processed in 525us (3586us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440216.127580:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 15 00000100:00100000:0.0:1787440216.127622:0:9225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee077d7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fde7b340-91f7-42a0-a1a3-5665ea2691c9+2:2359:x1874266681260032:12345-192.168.206.58@tcp:9:kworker.0 Request processed in 3273us (3658us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440216.127629:0:9225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 14 00000100:00080000:0.0:1787440216.127650:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787440216.127658:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787440216.127661:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787440216.127794:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787440216.159273:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787440216.478722:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee0800a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1874266701216384:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787440216.478787:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440216.478932:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701216384 00000100:00100000:1.0:1787440216.478940:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701216384 00000100:00100000:1.0:1787440216.478997:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787440216.479006:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee08032f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874266701216384:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787440216.479038:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787440216.479079:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee08032f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874266701216384:12345-0@lo:13:osp-pre-0-0.0 Request processed in 74us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440216.479086:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:1.0:1787440216.479119:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ee0800a4e00 x1874266701216384/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787440232 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787440216.479135:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee0800a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1874266701216384:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787440216.479191:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787440217.184950:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787440217.507085:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee0800a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874266701216640:0@lo:400:kworker.0 00000100:00100000:1.0:1787440217.507163:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440217.507210:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee0800a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1874266701217152:0@lo:400:kworker.0 00000100:00100000:1.0:1787440217.507235:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440217.507266:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1787440217.507272:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee0800a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:168176ea-29d1-49de-a254-317e90d54802:3310:1874266701216512:0@lo:400:kworker.0 00000100:00100000:1.0:1787440217.507298:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440217.507319:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee0800a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3310:1874266701217024:0@lo:400:kworker.0 00000100:00100000:1.0:1787440217.507339:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440217.507363:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee0800a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1874266701216768:0@lo:400:kworker.0 00000100:00100000:1.0:1787440217.507384:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440217.507401:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787440217.507407:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee0800a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874266701216896:0@lo:400:kworker.0 00000100:00100000:1.0:1787440217.507427:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440217.507457:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701216640 00000100:00100000:1.0:1787440217.507464:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701216640 00000100:00100000:1.0:1787440217.507533:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701217024 00000100:00100000:1.0:1787440217.507537:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701217024 00000100:00100000:1.0:1787440217.507560:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701216768 00000100:00100000:1.0:1787440217.507563:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701216768 00000100:00100000:1.0:1787440217.507581:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1787440217.507589:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee077f40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874266701216640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440217.507639:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee077f40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874266701216640:12345-0@lo:400:kworker.0 Request processed in 49us (476us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440217.507646:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1787440217.507663:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1787440217.507669:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee077f41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874266701217024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440217.507706:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee077f41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874266701217024:12345-0@lo:400:kworker.0 Request processed in 37us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440217.507712:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1787440217.507725:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1787440217.507730:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee077f40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874266701216768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440217.507760:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee077f40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874266701216768:12345-0@lo:400:kworker.0 Request processed in 30us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440217.507765:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1787440217.507782:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701217152 00000100:00100000:1.0:1787440217.507785:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701217152 00000100:00100000:1.0:1787440217.507807:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701216896 00000100:00100000:1.0:1787440217.507809:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701216896 00000100:00100000:1.0:1787440217.507824:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787440217.507829:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee077f43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1874266701217152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440217.507936:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee077f43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1874266701217152:12345-0@lo:400:kworker.0 Request processed in 106us (699us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440217.507942:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787440217.507954:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787440217.507959:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee077f43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1874266701216896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440217.507985:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee077f43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1874266701216896:12345-0@lo:400:kworker.0 Request processed in 26us (558us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440217.507991:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787440217.508008:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701216512 00000100:00100000:1.0:1787440217.508011:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701216512 00000100:00100000:1.0:1787440217.508033:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1787440217.508038:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee06d270050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:168176ea-29d1-49de-a254-317e90d54802+19:3310:x1874266701216512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440217.508073:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee06d270050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:168176ea-29d1-49de-a254-317e90d54802+19:3310:x1874266701216512:12345-0@lo:400:kworker.0 Request processed in 35us (774us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440217.508079:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00080000:1.0:1787440217.508109:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787440217.508115:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787440217.508143:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ee0800a4380 x1874266701216896/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787440233 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787440217.508157:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee0800a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874266701216896:0@lo:400:kworker.0 00000100:00100000:1.0:1787440217.508167:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee0800a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1874266701216768:0@lo:400:kworker.0 00000100:00100000:1.0:1787440217.508193:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee0800a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:168176ea-29d1-49de-a254-317e90d54802:3310:1874266701216512:0@lo:400:kworker.0 00000100:00100000:1.0:1787440217.508202:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee0800a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3310:1874266701217024:0@lo:400:kworker.0 00000100:00100000:1.0:1787440217.508211:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee0800a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874266701216640:0@lo:400:kworker.0 00010000:00080000:1.0:1787440217.508219:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ee0800a6300 x1874266701217152/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787440233 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787440217.508227:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee0800a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1874266701217152:0@lo:400:kworker.0 00000100:00100000:1.0:1787440218.013100:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787440218.013123:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee077f41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1874266701217280:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787440218.013188:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440218.013258:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701217280 00000100:00100000:1.0:1787440218.013265:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701217280 00000100:00100000:1.0:1787440218.013310:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787440218.013319:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee077f42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874266701217280:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787440218.013356:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787440218.013413:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee077f42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874266701217280:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440218.013421:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:1.0:1787440218.013471:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ee077f41500 x1874266701217280/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787440234 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787440218.013521:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee077f41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1874266701217280:0@lo:13:osp-pre-1-0.0 00000001:00100000:1.0:1787440218.065530:0:7640:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of fde7b340-91f7-42a0-a1a3-5665ea2691c9 00000020:00000080:1.0:1787440218.065539:0:7640:0:(genops.c:885:class_export_put()) final put ffff8ee077843000/fde7b340-91f7-42a0-a1a3-5665ea2691c9 00000020:00000080:1.0:1787440218.065572:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8ee077843000/fde7b340-91f7-42a0-a1a3-5665ea2691c9 for lustre-OST0001 00000020:00000080:1.0:1787440218.065615:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ee077841000 for lustre-OST0001 00010000:00010000:1.0:1787440218.211890:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787440219.229285:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787440220.143951:0:6723:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of fde7b340-91f7-42a0-a1a3-5665ea2691c9 00000020:00000080:2.0:1787440220.143962:0:6723:0:(genops.c:885:class_export_put()) final put ffff8ee077845000/fde7b340-91f7-42a0-a1a3-5665ea2691c9 00000020:00000080:3.0:1787440220.145900:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8ee077845000/fde7b340-91f7-42a0-a1a3-5665ea2691c9 for lustre-OST0000 00000020:00000080:3.0:1787440220.145970:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ee077847000 for lustre-OST0000 00010000:00010000:1.0:1787440220.254972:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787440221.175366:0:11016:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:0.0:1787440221.241903:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440221.241950:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440221.241978:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440221.242005:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681260544 00000100:00100000:0.0:1787440221.242014:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681260544 00000100:00100000:0.0:1787440221.242071:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681260416 00000100:00100000:0.0:1787440221.242074:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681260416 00000100:00100000:0.0:1787440221.242099:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 84 00000100:00100000:0.0:1787440221.242108:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee077d7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fde7b340-91f7-42a0-a1a3-5665ea2691c9+5:2363:x1874266681260544:12345-192.168.206.58@tcp:400:kworker.0 00000100:00100000:0.0:1787440221.242183:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee077d7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fde7b340-91f7-42a0-a1a3-5665ea2691c9+5:2363:x1874266681260544:12345-192.168.206.58@tcp:400:kworker.0 Request processed in 75us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440221.242192:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 84 00000100:00100000:0.0:1787440221.242225:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 85 00000100:00100000:0.0:1787440221.242231:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee077d78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+6:2363:x1874266681260416:12345-192.168.206.58@tcp:400:kworker.0 00000100:00100000:1.0:1787440221.242335:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681260288 00000100:00100000:1.0:1787440221.242340:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681260288 00000100:00100000:1.0:1787440221.242369:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 229 00000100:00100000:1.0:1787440221.242376:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee06d273850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+13:2363:x1874266681260288:12345-192.168.206.58@tcp:400:kworker.0 00000100:00100000:1.0:1787440221.242402:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee06d273850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+13:2363:x1874266681260288:12345-192.168.206.58@tcp:400:kworker.0 Request processed in 27us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440221.242419:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 229 00000100:00100000:0.0:1787440221.242562:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee077d78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+6:2363:x1874266681260416:12345-192.168.206.58@tcp:400:kworker.0 Request processed in 330us (582us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440221.242569:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 85 00000100:00080000:0.0:1787440221.242590:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787440221.278522:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787440221.597225:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee077f41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1874266701217408:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787440221.597308:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440221.597485:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701217408 00000100:00100000:1.0:1787440221.597509:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701217408 00000100:00100000:1.0:1787440221.597582:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787440221.597591:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee080324000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874266701217408:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787440221.597622:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787440221.597675:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee080324000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874266701217408:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440221.597688:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:0.0:1787440221.597845:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787440221.598161:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ee077f41500 x1874266701217408/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787440237 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787440221.598180:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee077f41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1874266701217408:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787440222.301513:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787440222.625788:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee077f43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:168176ea-29d1-49de-a254-317e90d54802:3309:1874266701217536:0@lo:400:kworker.0 00000100:00100000:1.0:1787440222.625884:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440222.625944:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee077f42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1874266701218048:0@lo:400:kworker.0 00000100:00100000:1.0:1787440222.625974:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440222.626005:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1787440222.626010:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee077f41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874266701217664:0@lo:400:kworker.0 00000100:00100000:1.0:1787440222.626033:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440222.626052:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee077f40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874266701218176:0@lo:400:kworker.0 00000100:00100000:1.0:1787440222.626077:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440222.626106:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee077f42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1874266701217792:0@lo:400:kworker.0 00000100:00100000:1.0:1787440222.626131:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440222.626151:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787440222.626156:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee077f40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874266701217920:0@lo:400:kworker.0 00000100:00100000:1.0:1787440222.626179:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440222.626215:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701217536 00000100:00100000:1.0:1787440222.626223:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701217536 00000100:00100000:1.0:1787440222.626276:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1787440222.626285:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04a699c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:168176ea-29d1-49de-a254-317e90d54802+19:3309:x1874266701217536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440222.626338:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04a699c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:168176ea-29d1-49de-a254-317e90d54802+19:3309:x1874266701217536:12345-0@lo:400:kworker.0 Request processed in 54us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440222.626346:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1787440222.626391:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701218048 00000100:00100000:1.0:1787440222.626394:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701218048 00000100:00100000:1.0:1787440222.626443:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701217664 00000100:00100000:1.0:1787440222.626446:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701217664 00000100:00100000:1.0:1787440222.626458:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701217792 00000100:00100000:1.0:1787440222.626460:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701217792 00000100:00100000:1.0:1787440222.626488:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1787440222.626527:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee077f43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1874266701218048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440222.626562:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee077f43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1874266701218048:12345-0@lo:400:kworker.0 Request processed in 37us (587us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440222.626569:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1787440222.626582:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1787440222.626587:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee077f40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874266701217664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440222.626613:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee077f40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874266701217664:12345-0@lo:400:kworker.0 Request processed in 26us (579us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440222.626619:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1787440222.626630:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1787440222.626635:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee077f41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874266701217792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440222.626666:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee077f41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874266701217792:12345-0@lo:400:kworker.0 Request processed in 31us (535us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440222.626671:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1787440222.626693:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701218176 00000100:00100000:1.0:1787440222.626697:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701218176 00000100:00100000:1.0:1787440222.626721:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701217920 00000100:00100000:1.0:1787440222.626724:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701217920 00000100:00100000:1.0:1787440222.626740:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787440222.626747:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee077f42d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1874266701218176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440222.626777:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee077f42d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1874266701218176:12345-0@lo:400:kworker.0 Request processed in 31us (700us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440222.626793:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787440222.626805:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787440222.626810:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee077f41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1874266701217920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440222.626842:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee077f41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1874266701217920:12345-0@lo:400:kworker.0 Request processed in 33us (663us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440222.626848:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:1.0:1787440222.626899:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ee077f40700 x1874266701217920/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787440238 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787440222.626917:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee077f40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874266701217920:0@lo:400:kworker.0 00000100:00100000:1.0:1787440222.626928:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee077f42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1874266701217792:0@lo:400:kworker.0 00000100:00100000:1.0:1787440222.626955:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee077f41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874266701217664:0@lo:400:kworker.0 00010000:00080000:1.0:1787440222.626965:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ee077f40380 x1874266701218176/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787440238 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787440222.626973:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee077f40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874266701218176:0@lo:400:kworker.0 00000100:00100000:1.0:1787440222.626982:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee077f43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:168176ea-29d1-49de-a254-317e90d54802:3309:1874266701217536:0@lo:400:kworker.0 00000100:00100000:1.0:1787440222.626991:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee077f42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1874266701218048:0@lo:400:kworker.0 00000100:00080000:0.0:1787440222.628091:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787440222.628100:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787440223.145770:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee08032ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874266701218304:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787440223.145982:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440223.146077:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701218304 00000100:00100000:1.0:1787440223.146086:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701218304 00000100:00100000:1.0:1787440223.146266:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787440223.146280:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee077f42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874266701218304:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787440223.146339:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787440223.146525:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee077f42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874266701218304:12345-0@lo:13:osp-pre-1-0.0 Request processed in 169us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440223.146534:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:3.0:1787440223.152390:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ee08032ed80 x1874266701218304/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787440239 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787440223.152636:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee08032ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874266701218304:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787440223.332792:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787440224.354298:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787440225.374239:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787440225.834706:0:11163:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc877198e0 20000000:00000080:1.0:1787440225.834724:0:11163:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8ee07743f000 uarg=0000000000000000 20000000:01000000:1.0:1787440225.834761:0:11163:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1787440225.834766:0:11163:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1787440225.834770:0:11163:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1787440225.839888:0:11164:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:0.0:1787440225.840033:0:11163:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1787440225.864399:0:11163:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1787440225.864577:0:11163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8ee07fb9fe00/0x85f5fa77adf3c356 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440225.864606:0:11163:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ee04cbcfc00/0x85f5fa77adf3c2fb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62096 expref: 12 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440225.864616:0:11163:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ee04cbcee00/0x85f5fa77adf3c309 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f5fa77adf3c302 expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440225.864623:0:11163:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ee041665a00/0x85f5fa77adf3c317 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f5fa77adf3c310 expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440225.864629:0:11163:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ee041664200/0x85f5fa77adf3c325 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f5fa77adf3c31e expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440225.864635:0:11163:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ee07f86e600/0x85f5fa77adf3c33a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc620ce expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440225.864643:0:11163:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8ee07fb9fe00/0x85f5fa77adf3c356 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440225.864707:0:11163:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ee07f86e600/0x85f5fa77adf3c33a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc620ce expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440225.864721:0:11163:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ee07f86e600/0x85f5fa77adf3c33a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc620ce expref: 12 pid: 5844 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440225.864739:0:11163:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee077f43b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11163:1874266701218432:192.168.206.58@tcp:104: 00010000:00010000:1.0:1787440225.864864:0:11163:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ee041664200/0x85f5fa77adf3c325 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x85f5fa77adf3c31e expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440225.864872:0:11163:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ee041664200/0x85f5fa77adf3c325 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x85f5fa77adf3c31e expref: 18 pid: 5844 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440225.864881:0:11163:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee077f40380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11163:1874266701218560:0@lo:104: 00000100:00100000:1.0:1787440225.864923:0:11163:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787440225.864966:0:11163:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ee041665a00/0x85f5fa77adf3c317 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x85f5fa77adf3c310 expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440225.864974:0:11163:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ee041665a00/0x85f5fa77adf3c317 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x85f5fa77adf3c310 expref: 18 pid: 5843 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440225.864982:0:11163:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee077f42a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11163:1874266701218688:0@lo:104: 00000100:00100000:1.0:1787440225.865002:0:11163:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787440225.865036:0:11163:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ee04cbcee00/0x85f5fa77adf3c309 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x85f5fa77adf3c302 expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440225.865043:0:11163:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ee04cbcee00/0x85f5fa77adf3c309 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x85f5fa77adf3c302 expref: 18 pid: 5843 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440225.865055:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701218560 00000100:00100000:3.0:1787440225.865061:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701218560 00000100:00100000:1.0:1787440225.865062:0:11163:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee077f41500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11163:1874266701218816:0@lo:104: 00000100:00100000:1.0:1787440225.865084:0:11163:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787440225.865107:0:11163:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ee04cbcfc00/0x85f5fa77adf3c2fb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62096 expref: 12 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440225.865116:0:11163:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ee04cbcfc00/0x85f5fa77adf3c2fb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62096 expref: 12 pid: 5843 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440225.865124:0:11163:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee0800a6a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11163:1874266701218944:192.168.206.58@tcp:104: 00000100:00100000:1.0:1787440225.865148:0:11163:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee0807a9480 going to sleep for 11 seconds 00000100:00100000:3.0:1787440225.865167:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701218688 00000100:00100000:3.0:1787440225.865180:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701218688 00000100:00100000:3.0:1787440225.865194:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701218816 00000100:00100000:3.0:1787440225.865197:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701218816 00000100:00100000:3.0:1787440225.865209:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787440225.865217:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee077f41f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:168176ea-29d1-49de-a254-317e90d54802+5:11163:x1874266701218560:12345-0@lo:104: 00010000:00010000:3.0:1787440225.865234:0:5833:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.158@tcp lock: ffff8ee041664c00/0x85f5fa77adf3c31e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x85f5fa77adf3c325 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440225.865293:0:5833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787440225.865299:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee077f41f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:168176ea-29d1-49de-a254-317e90d54802+5:11163:x1874266701218560:12345-0@lo:104: Request processed in 82us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440225.865306:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787440225.865324:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787440225.865330:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee077f40700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:168176ea-29d1-49de-a254-317e90d54802+4:11163:x1874266701218688:12345-0@lo:104: 00010000:00010000:3.0:1787440225.865336:0:5833:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.158@tcp lock: ffff8ee04cbcfa00/0x85f5fa77adf3c310 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x85f5fa77adf3c317 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440225.865343:0:11163:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee077f40380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11163:1874266701218560:0@lo:104: 00010000:00010000:3.0:1787440225.865369:0:5833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787440225.865373:0:11163:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee077f42a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11163:1874266701218688:0@lo:104: 00000100:00100000:3.0:1787440225.865374:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee077f40700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:168176ea-29d1-49de-a254-317e90d54802+4:11163:x1874266701218688:12345-0@lo:104: Request processed in 46us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440225.865380:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787440225.865393:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787440225.865398:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee0800a6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:168176ea-29d1-49de-a254-317e90d54802+3:11163:x1874266701218816:12345-0@lo:104: 00010000:00010000:3.0:1787440225.865406:0:5833:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.158@tcp lock: ffff8ee041664a00/0x85f5fa77adf3c302 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x85f5fa77adf3c309 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440225.865456:0:5833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1787440225.865467:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee0800a6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:168176ea-29d1-49de-a254-317e90d54802+3:11163:x1874266701218816:12345-0@lo:104: Request processed in 63us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440225.865473:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787440225.865481:0:11163:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee077f41500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11163:1874266701218816:0@lo:104: 00010000:00010000:3.0:1787440225.865489:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787440225.865512:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.158@tcp lock: ffff8ee041664c00/0x85f5fa77adf3c31e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x85f5fa77adf3c325 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440225.865534:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee041664c00 already unused, calling callback (ffffffffc1bd2c20) 10000000:00010000:3.0:1787440225.865538:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.158@tcp lock: ffff8ee041664c00/0x85f5fa77adf3c31e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x85f5fa77adf3c325 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440225.865546:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.158@tcp lock: ffff8ee041664c00/0x85f5fa77adf3c31e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x85f5fa77adf3c325 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787440225.865553:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.158@tcp lock: ffff8ee041664c00/0x85f5fa77adf3c31e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x85f5fa77adf3c325 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787440225.865558:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787440225.865591:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.158@tcp lock: ffff8ee041664c00/0x85f5fa77adf3c31e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x85f5fa77adf3c325 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440225.865598:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787440225.865617:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.158@tcp lock: ffff8ee041664c00/0x85f5fa77adf3c31e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x85f5fa77adf3c325 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440225.865625:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.158@tcp lock: ffff8ee041664c00/0x85f5fa77adf3c31e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x85f5fa77adf3c325 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440225.865636:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787440225.865639:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.158@tcp lock: ffff8ee04cbcfa00/0x85f5fa77adf3c310 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x85f5fa77adf3c317 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440225.865645:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee04cbcfa00 already unused, calling callback (ffffffffc1bd2c20) 10000000:00010000:3.0:1787440225.865648:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.158@tcp lock: ffff8ee04cbcfa00/0x85f5fa77adf3c310 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x85f5fa77adf3c317 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440225.865664:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.158@tcp lock: ffff8ee04cbcfa00/0x85f5fa77adf3c310 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x85f5fa77adf3c317 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787440225.865670:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.158@tcp lock: ffff8ee04cbcfa00/0x85f5fa77adf3c310 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x85f5fa77adf3c317 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787440225.865674:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787440225.865697:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.158@tcp lock: ffff8ee04cbcfa00/0x85f5fa77adf3c310 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x85f5fa77adf3c317 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440225.865703:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787440225.865718:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.158@tcp lock: ffff8ee04cbcfa00/0x85f5fa77adf3c310 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x85f5fa77adf3c317 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440225.865723:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.158@tcp lock: ffff8ee04cbcfa00/0x85f5fa77adf3c310 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x85f5fa77adf3c317 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440225.865731:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787440225.865733:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.158@tcp lock: ffff8ee041664a00/0x85f5fa77adf3c302 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x85f5fa77adf3c309 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440225.865738:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee041664a00 already unused, calling callback (ffffffffc1bd2c20) 10000000:00010000:3.0:1787440225.865740:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.158@tcp lock: ffff8ee041664a00/0x85f5fa77adf3c302 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x85f5fa77adf3c309 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440225.865745:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.158@tcp lock: ffff8ee041664a00/0x85f5fa77adf3c302 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x85f5fa77adf3c309 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787440225.865751:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.158@tcp lock: ffff8ee041664a00/0x85f5fa77adf3c302 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x85f5fa77adf3c309 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787440225.865761:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787440225.865773:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.158@tcp lock: ffff8ee041664a00/0x85f5fa77adf3c302 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x85f5fa77adf3c309 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440225.865778:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787440225.865783:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.158@tcp lock: ffff8ee041664a00/0x85f5fa77adf3c302 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x85f5fa77adf3c309 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440225.865789:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.158@tcp lock: ffff8ee041664a00/0x85f5fa77adf3c302 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x85f5fa77adf3c309 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440225.865800:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787440225.865802:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787440225.865803:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787440225.865815:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee08032ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:168176ea-29d1-49de-a254-317e90d54802:3312:1874266701219072:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787440225.865842:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440225.865868:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee08032dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:168176ea-29d1-49de-a254-317e90d54802:3309:1874266701219200:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787440225.865872:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee08032d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:168176ea-29d1-49de-a254-317e90d54802:3310:1874266701219328:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787440225.865891:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440225.865907:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701219072 00000100:00100000:2.0:1787440225.865911:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701219072 00010000:00010000:2.0:1787440225.865929:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ee041664200/0x85f5fa77adf3c325 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x85f5fa77adf3c31e expref: 19 pid: 5844 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440225.865955:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701219328 00000100:00100000:2.0:1787440225.865958:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701219328 00010000:00010000:2.0:1787440225.865968:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ee04cbcee00/0x85f5fa77adf3c309 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x85f5fa77adf3c302 expref: 20 pid: 5843 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440225.865986:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787440225.865992:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee06e7e7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:168176ea-29d1-49de-a254-317e90d54802+20:3312:x1874266701219072:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787440225.866001:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787440225.866006:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ee041664200/0x85f5fa77adf3c325 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x85f5fa77adf3c31e expref: 20 pid: 5844 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440225.866015:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ee041664200/0x85f5fa77adf3c325 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x85f5fa77adf3c31e expref: 20 pid: 5844 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440225.866027:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ee041664200/0x85f5fa77adf3c325 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x85f5fa77adf3c31e expref: 20 pid: 5844 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440225.866038:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787440225.866074:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee06e7e7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:168176ea-29d1-49de-a254-317e90d54802+19:3312:x1874266701219072:12345-0@lo:103:ldlm_bl.0 Request processed in 81us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440225.866080:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787440225.866116:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787440225.866121:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee08032ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:168176ea-29d1-49de-a254-317e90d54802+18:3310:x1874266701219328:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787440225.866128:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787440225.866132:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ee04cbcee00/0x85f5fa77adf3c309 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x85f5fa77adf3c302 expref: 18 pid: 5843 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440225.866141:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ee04cbcee00/0x85f5fa77adf3c309 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x85f5fa77adf3c302 expref: 18 pid: 5843 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440225.866150:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ee04cbcee00/0x85f5fa77adf3c309 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x85f5fa77adf3c302 expref: 18 pid: 5843 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440225.866158:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787440225.866189:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee08032ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:168176ea-29d1-49de-a254-317e90d54802+17:3310:x1874266701219328:12345-0@lo:103:ldlm_bl.0 Request processed in 67us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440225.866194:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787440225.866215:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440225.866238:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701219200 00000100:00100000:2.0:1787440225.866241:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701219200 00010000:00010000:2.0:1787440225.866254:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ee041665a00/0x85f5fa77adf3c317 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x85f5fa77adf3c310 expref: 17 pid: 5843 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440225.866273:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787440225.866278:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee080325f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:168176ea-29d1-49de-a254-317e90d54802+17:3309:x1874266701219200:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787440225.866285:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787440225.866288:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ee041665a00/0x85f5fa77adf3c317 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x85f5fa77adf3c310 expref: 17 pid: 5843 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440225.866301:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ee041665a00/0x85f5fa77adf3c317 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x85f5fa77adf3c310 expref: 17 pid: 5843 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440225.866312:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ee041665a00/0x85f5fa77adf3c317 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x85f5fa77adf3c310 expref: 17 pid: 5843 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440225.866321:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787440225.866341:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee08032d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:168176ea-29d1-49de-a254-317e90d54802:3310:1874266701219328:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787440225.866347:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee080325f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:168176ea-29d1-49de-a254-317e90d54802+16:3309:x1874266701219200:12345-0@lo:103:ldlm_bl.0 Request processed in 70us (132us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440225.866352:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787440225.866372:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee08032dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:168176ea-29d1-49de-a254-317e90d54802:3309:1874266701219200:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787440225.866391:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee08032ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:168176ea-29d1-49de-a254-317e90d54802:3312:1874266701219072:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787440225.867614:0:11163:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee077f43b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11163:1874266701218432:192.168.206.58@tcp:104: 00010000:00010000:0.0:1787440225.868989:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787440225.874110:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440225.874230:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:2.0:1787440225.874319:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681260672 00000100:00100000:2.0:1787440225.874327:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681260672 00010000:00010000:2.0:1787440225.874365:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ee07f86e600/0x85f5fa77adf3c33a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc620ce expref: 13 pid: 5844 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440225.874400:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681260800 00000100:00100000:2.0:1787440225.874404:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681260800 00010000:00010000:2.0:1787440225.874417:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ee04cbcfc00/0x85f5fa77adf3c2fb lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62096 expref: 14 pid: 5843 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440225.874435:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 28 00000100:00100000:2.0:1787440225.874442:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee077d79500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+14:2362:x1874266681260672:12345-192.168.206.58@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787440225.874480:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787440225.874487:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ee07f86e600/0x85f5fa77adf3c33a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc620ce expref: 14 pid: 5844 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440225.874541:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ee07f86e600/0x85f5fa77adf3c33a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc620ce expref: 14 pid: 5844 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440225.874559:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ee07f86e600/0x85f5fa77adf3c33a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc620ce expref: 14 pid: 5844 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440225.874578:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787440225.874628:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee077d79500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+13:2362:x1874266681260672:12345-192.168.206.58@tcp:103:ldlm_bl.0 Request processed in 185us (526us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440225.874636:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 28 00000100:00100000:2.0:1787440225.874654:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 29 00000100:00100000:2.0:1787440225.874660:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee077d78700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+12:2363:x1874266681260800:12345-192.168.206.58@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787440225.874669:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787440225.874673:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ee04cbcfc00/0x85f5fa77adf3c2fb lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62096 expref: 12 pid: 5843 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440225.874683:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ee04cbcfc00/0x85f5fa77adf3c2fb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62096 expref: 12 pid: 5843 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440225.874695:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8ee07fb9fe00/0x85f5fa77adf3c356 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440225.874702:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ee07fb9fe00/0x85f5fa77adf3c356 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440225.874717:0:5836:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ee07fb9fe00/0x85f5fa77adf3c356 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440225.874734:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ee07fb9fe00/0x85f5fa77adf3c356 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440225.874742:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8ee07fb9fe00/0x85f5fa77adf3c356 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440225.874749:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8ee07fb9fe00/0x85f5fa77adf3c356 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440225.874755:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee07fb9fe00 already unused, calling callback (ffffffffc15b52a0) 00010000:00010000:2.0:1787440225.874760:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8ee07fb9fe00/0x85f5fa77adf3c356 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440225.874769:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8ee07fb9fe00/0x85f5fa77adf3c356 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440225.874778:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8ee07fb9fe00/0x85f5fa77adf3c356 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440225.874788:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787440225.874807:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee077d78700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+12:2363:x1874266681260800:12345-192.168.206.58@tcp:103:ldlm_bl.0 Request processed in 147us (577us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440225.874814:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 29 00010000:00010000:1.0:1787440225.875487:0:11163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ee04cbcfc00/0x85f5fa77adf3c2fb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62096 expref: 11 pid: 5843 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440225.875524:0:11163:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee0800a6a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11163:1874266701218944:192.168.206.58@tcp:104: 00010000:00010000:1.0:1787440225.875553:0:11163:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8ee07fb9fe00/0x85f5fa77adf3c356 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440225.875561:0:11163:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8ee07fb9fe00/0x85f5fa77adf3c356 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440225.875567:0:11163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8ee07fb9fe00/0x85f5fa77adf3c356 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440225.875583:0:11163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ee07fb9fe00/0x85f5fa77adf3c356 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440226.364098:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440226.364160:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440226.364308:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681260928 00000100:00100000:3.0:1787440226.364318:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681260928 00000100:00100000:3.0:1787440226.364384:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681261056 00000100:00100000:3.0:1787440226.364388:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681261056 00000100:00100000:3.0:1787440226.364412:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 89 00000100:00100000:3.0:1787440226.364420:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee077d78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+6:2361:x1874266681260928:12345-192.168.206.58@tcp:400:kworker.0 00000100:00100000:3.0:1787440226.364543:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee077d78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+6:2361:x1874266681260928:12345-192.168.206.58@tcp:400:kworker.0 Request processed in 123us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440226.364567:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 89 00000100:00100000:3.0:1787440226.364586:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 90 00000100:00100000:3.0:1787440226.364593:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee077d78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fde7b340-91f7-42a0-a1a3-5665ea2691c9+5:2361:x1874266681261056:12345-192.168.206.58@tcp:400:kworker.0 00000100:00100000:3.0:1787440226.364622:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee077d78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fde7b340-91f7-42a0-a1a3-5665ea2691c9+5:2361:x1874266681261056:12345-192.168.206.58@tcp:400:kworker.0 Request processed in 29us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440226.364628:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 90 00000100:00080000:0.0:1787440226.367545:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787440226.396723:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787440226.716792:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787440226.716815:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee0800a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1874266701219456:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787440226.716884:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440226.717048:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701219456 00000100:00100000:1.0:1787440226.717055:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701219456 00000100:00100000:1.0:1787440226.717120:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787440226.717129:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee08032d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874266701219456:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787440226.717161:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787440226.717208:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee08032d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874266701219456:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440226.717215:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:1.0:1787440226.717254:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ee0800a6a00 x1874266701219456/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787440242 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787440226.717271:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee0800a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1874266701219456:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787440226.717336:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 10000000:01000000:1.0:1787440226.972735:0:5847:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787440226.972745:0:5847:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8ee06db91000 from 7 10000000:01000000:1.0:1787440226.972749:0:5847:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787440226.972810:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.158@tcp lock: ffff8ee07fb9fe00/0x85f5fa77adf3c35d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440226.972822:0:5847:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.158@tcp lock: ffff8ee07fb9fe00/0x85f5fa77adf3c35d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440226.972833:0:5847:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.158@tcp lock: ffff8ee07fb9fe00/0x85f5fa77adf3c35d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440226.972859:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee0800a6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:168176ea-29d1-49de-a254-317e90d54802:5847:1874266701219584:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787440226.972944:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440226.973077:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee0807a9480 going to sleep for 11 seconds 00000100:00100000:2.0:1787440226.973084:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701219584 00000100:00100000:2.0:1787440226.973093:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701219584 00000100:00100000:2.0:1787440226.973148:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1787440226.973157:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee06d273450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:168176ea-29d1-49de-a254-317e90d54802+16:5847:x1874266701219584:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787440226.973170:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440226.973184:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ee07f86e600/0x85f5fa77adf3c364 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x85f5fa77adf3c35d expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440226.973212:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ee07f86e600/0x85f5fa77adf3c364 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x85f5fa77adf3c35d expref: 17 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440226.973233:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ee07f86e600/0x85f5fa77adf3c364 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f5fa77adf3c35d expref: 17 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440226.973253:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee07f86e600, rc 0) 00000100:00100000:2.0:1787440226.973298:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee06d273450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:168176ea-29d1-49de-a254-317e90d54802+17:5847:x1874266701219584:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 141us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440226.973306:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1787440226.973477:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee0800a6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:168176ea-29d1-49de-a254-317e90d54802:5847:1874266701219584:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787440226.973517:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.158@tcp lock: ffff8ee07fb9fe00/0x85f5fa77adf3c35d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3c364 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440226.973527:0:5847:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.158@tcp lock: ffff8ee07fb9fe00/0x85f5fa77adf3c35d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x85f5fa77adf3c364 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440226.973587:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee07783b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:168176ea-29d1-49de-a254-317e90d54802:5847:1874266701219712:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787440226.973615:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440226.973647:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee0512c3180 going to sleep for 11 seconds 00000100:00100000:1.0:1787440226.974208:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701219712 00000100:00100000:1.0:1787440226.974214:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701219712 00000100:00100000:1.0:1787440226.974266:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:1.0:1787440226.974274:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee06d270c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:168176ea-29d1-49de-a254-317e90d54802+17:5847:x1874266701219712:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787440226.974572:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee06d270c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:168176ea-29d1-49de-a254-317e90d54802+17:5847:x1874266701219712:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 298us (955us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440226.974581:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:0.0:1787440226.974856:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee07783b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:168176ea-29d1-49de-a254-317e90d54802:5847:1874266701219712:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787440226.974898:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee07783b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:168176ea-29d1-49de-a254-317e90d54802:5847:1874266701219840:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787440226.974940:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440226.974974:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee0512c3180 going to sleep for 11 seconds 00000100:00100000:2.0:1787440226.977012:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701219840 00000100:00100000:2.0:1787440226.977025:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701219840 00000100:00100000:2.0:1787440226.977104:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1787440226.977114:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee06d271c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:168176ea-29d1-49de-a254-317e90d54802+17:5847:x1874266701219840:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787440226.978651:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee06d271c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:168176ea-29d1-49de-a254-317e90d54802+17:5847:x1874266701219840:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1533us (3704us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440226.978662:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:0.0:1787440226.979366:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee07783b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:168176ea-29d1-49de-a254-317e90d54802:5847:1874266701219840:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787440226.983403:0:11176:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1787440226.984961:0:5847:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1787440226.984992:0:5847:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.158@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787440226.985004:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.158@tcp lock: ffff8ee07fb9fe00/0x85f5fa77adf3c35d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3c364 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440226.985015:0:5847:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.158@tcp lock: ffff8ee07fb9fe00/0x85f5fa77adf3c35d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3c364 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787440226.985026:0:5847:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787440226.985029:0:5847:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8ee045e4e000 from 7 10000000:01000000:1.0:1787440226.985032:0:5847:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787440226.985111:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.158@tcp lock: ffff8ee07fb9e400/0x85f5fa77adf3c36b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440226.985119:0:5847:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.158@tcp lock: ffff8ee07fb9e400/0x85f5fa77adf3c36b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440226.985129:0:5847:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.158@tcp lock: ffff8ee07fb9e400/0x85f5fa77adf3c36b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440226.985152:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee0800a6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:168176ea-29d1-49de-a254-317e90d54802:5847:1874266701219968:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787440226.985231:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440226.985283:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee0807a9900 going to sleep for 11 seconds 00000100:00100000:3.0:1787440226.985360:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701219968 00000100:00100000:3.0:1787440226.985367:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701219968 00000100:00100000:3.0:1787440226.985417:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1787440226.985426:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee06d273c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:168176ea-29d1-49de-a254-317e90d54802+17:5847:x1874266701219968:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787440226.985438:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440226.985460:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ee049e94e00/0x85f5fa77adf3c372 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x85f5fa77adf3c36b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440226.985483:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ee049e94e00/0x85f5fa77adf3c372 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x85f5fa77adf3c36b expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440226.985532:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ee049e94e00/0x85f5fa77adf3c372 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f5fa77adf3c36b expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440226.985540:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee049e94e00, rc 0) 00000100:00100000:3.0:1787440226.985593:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee06d273c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:168176ea-29d1-49de-a254-317e90d54802+18:5847:x1874266701219968:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 169us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440226.985606:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1787440226.985978:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee0800a6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:168176ea-29d1-49de-a254-317e90d54802:5847:1874266701219968:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787440226.985993:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.158@tcp lock: ffff8ee07fb9e400/0x85f5fa77adf3c36b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3c372 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440226.986003:0:5847:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.158@tcp lock: ffff8ee07fb9e400/0x85f5fa77adf3c36b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x85f5fa77adf3c372 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440226.986064:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee07783b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:168176ea-29d1-49de-a254-317e90d54802:5847:1874266701220096:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787440226.986094:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440226.986127:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee0512c3540 going to sleep for 11 seconds 00000100:00100000:2.0:1787440226.987270:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701220096 00000100:00100000:2.0:1787440226.987280:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701220096 00000100:00100000:2.0:1787440226.987336:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1787440226.987345:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee06d271850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:168176ea-29d1-49de-a254-317e90d54802+18:5847:x1874266701220096:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787440226.987648:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee06d271850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:168176ea-29d1-49de-a254-317e90d54802+18:5847:x1874266701220096:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 304us (1552us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440226.987655:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:0.0:1787440226.989374:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee07783b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:168176ea-29d1-49de-a254-317e90d54802:5847:1874266701220096:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787440226.989437:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee07783b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:168176ea-29d1-49de-a254-317e90d54802:5847:1874266701220224:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787440226.989537:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440226.989577:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee0512c3540 going to sleep for 11 seconds 00000100:00100000:1.0:1787440226.989762:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701220224 00000100:00100000:1.0:1787440226.989769:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701220224 00000100:00100000:1.0:1787440226.989828:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1787440226.989836:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee06d270850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:168176ea-29d1-49de-a254-317e90d54802+18:5847:x1874266701220224:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787440226.990023:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee06d270850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:168176ea-29d1-49de-a254-317e90d54802+18:5847:x1874266701220224:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 186us (486us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440226.990031:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:0.0:1787440226.990268:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee07783b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:168176ea-29d1-49de-a254-317e90d54802:5847:1874266701220224:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787440226.993137:0:11177:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1787440226.998042:0:5847:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1787440226.998079:0:5847:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.158@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787440226.998091:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.158@tcp lock: ffff8ee07fb9e400/0x85f5fa77adf3c36b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3c372 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440226.998120:0:5847:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.158@tcp lock: ffff8ee07fb9e400/0x85f5fa77adf3c36b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3c372 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787440226.998131:0:5847:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787440226.998134:0:5847:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8ee045f41000 from 7 10000000:01000000:0.0:1787440226.998137:0:5847:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787440226.998235:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.158@tcp lock: ffff8ee04cbcfc00/0x85f5fa77adf3c379 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440226.998244:0:5847:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.158@tcp lock: ffff8ee04cbcfc00/0x85f5fa77adf3c379 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440226.998256:0:5847:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.158@tcp lock: ffff8ee04cbcfc00/0x85f5fa77adf3c379 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440226.998279:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee07783b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:168176ea-29d1-49de-a254-317e90d54802:5847:1874266701220352:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787440226.998344:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440226.998422:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee06d3b2240 going to sleep for 11 seconds 00000100:00100000:3.0:1787440227.003414:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701220352 00000100:00100000:3.0:1787440227.003430:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701220352 00000100:00100000:3.0:1787440227.003818:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1787440227.003830:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee06d271050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:168176ea-29d1-49de-a254-317e90d54802+18:5847:x1874266701220352:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787440227.003846:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440227.003865:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ee049e95400/0x85f5fa77adf3c380 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x85f5fa77adf3c379 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440227.003891:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ee049e95400/0x85f5fa77adf3c380 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x85f5fa77adf3c379 expref: 19 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440227.003903:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ee049e95400/0x85f5fa77adf3c380 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f5fa77adf3c379 expref: 19 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440227.003911:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee049e95400, rc 0) 00000100:00100000:3.0:1787440227.003985:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee06d271050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:168176ea-29d1-49de-a254-317e90d54802+19:5847:x1874266701220352:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 158us (5640us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440227.003992:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1787440227.004082:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee07783b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:168176ea-29d1-49de-a254-317e90d54802:5847:1874266701220352:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787440227.004101:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.158@tcp lock: ffff8ee04cbcfc00/0x85f5fa77adf3c379 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3c380 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440227.004111:0:5847:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.158@tcp lock: ffff8ee04cbcfc00/0x85f5fa77adf3c379 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x85f5fa77adf3c380 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440227.004183:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee0800a4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:168176ea-29d1-49de-a254-317e90d54802:5847:1874266701220480:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787440227.004218:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440227.020452:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee0807a9900 going to sleep for 11 seconds 00000100:00100000:2.0:1787440227.022679:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701220480 00000100:00100000:2.0:1787440227.022694:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701220480 00000100:00100000:2.0:1787440227.022788:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1787440227.022798:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee06d271450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:168176ea-29d1-49de-a254-317e90d54802+19:5847:x1874266701220480:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787440227.023080:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee06d271450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:168176ea-29d1-49de-a254-317e90d54802+19:5847:x1874266701220480:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 283us (18860us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440227.023087:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:1.0:1787440227.023990:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee0800a4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:168176ea-29d1-49de-a254-317e90d54802:5847:1874266701220480:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787440227.024041:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee0800a4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:168176ea-29d1-49de-a254-317e90d54802:5847:1874266701220608:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787440227.024091:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440227.024128:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee0807a9900 going to sleep for 11 seconds 00000100:00100000:2.0:1787440227.027098:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701220608 00000100:00100000:2.0:1787440227.027113:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701220608 00000100:00100000:2.0:1787440227.027164:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1787440227.027174:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee06d272450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:168176ea-29d1-49de-a254-317e90d54802+19:5847:x1874266701220608:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787440227.027447:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee06d272450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:168176ea-29d1-49de-a254-317e90d54802+19:5847:x1874266701220608:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 263us (3344us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440227.027455:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1787440227.027639:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee0800a4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:168176ea-29d1-49de-a254-317e90d54802:5847:1874266701220608:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787440227.028341:0:11178:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1787440227.028407:0:5847:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1787440227.028421:0:5847:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.158@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787440227.028432:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.158@tcp lock: ffff8ee04cbcfc00/0x85f5fa77adf3c379 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3c380 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440227.028455:0:5847:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.158@tcp lock: ffff8ee04cbcfc00/0x85f5fa77adf3c379 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3c380 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440227.426656:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787440227.672552:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440227.672973:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681261184 00000100:00100000:3.0:1787440227.672982:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681261184 00000100:00100000:3.0:1787440227.673037:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 240 00000100:00100000:3.0:1787440227.673048:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee06d272850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+11:5603:x1874266681261184:12345-192.168.206.58@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787440227.673066:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440227.673086:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ee049e94c00/0x85f5fa77adf3c387 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fab14535dc620f8 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440227.673135:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ee049e94c00/0x85f5fa77adf3c387 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc620f8 expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440227.673148:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ee049e94c00/0x85f5fa77adf3c387 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc620f8 expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440227.673158:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee049e94c00, rc 0) 00000100:00100000:3.0:1787440227.673232:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee06d272850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+12:5603:x1874266681261184:12345-192.168.206.58@tcp:101:ll_cfg_requeue.0 Request processed in 186us (688us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440227.673240:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 240 00000100:00100000:2.0:1787440227.680996:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:1.0:1787440227.681199:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681261312 00000100:00100000:1.0:1787440227.681220:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681261312 00000100:00100000:1.0:1787440227.681279:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 241 00000100:00100000:1.0:1787440227.681290:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee06d270450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+12:5603:x1874266681261312:12345-192.168.206.58@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787440227.681623:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee06d270450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+12:5603:x1874266681261312:12345-192.168.206.58@tcp:501:ll_cfg_requeue.0 Request processed in 333us (634us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440227.681632:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 241 00000100:00100000:3.0:1787440227.689694:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:1.0:1787440227.691679:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681261440 00000100:00100000:1.0:1787440227.691694:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681261440 00000100:00100000:1.0:1787440227.691755:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 242 00000100:00100000:1.0:1787440227.691766:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee06d273050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+12:5603:x1874266681261440:12345-192.168.206.58@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787440227.692003:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee06d273050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+12:5603:x1874266681261440:12345-192.168.206.58@tcp:503:ll_cfg_requeue.0 Request processed in 238us (2318us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440227.692012:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 242 00000100:00100000:3.0:1787440227.710076:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:1.0:1787440227.712417:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681261568 00000100:00100000:1.0:1787440227.712431:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681261568 00000100:00100000:1.0:1787440227.712660:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 243 00000100:00100000:1.0:1787440227.712670:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee06d272c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+12:5603:x1874266681261568:12345-192.168.206.58@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787440227.712688:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440227.712720:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ee07fb9e600/0x85f5fa77adf3c38e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fab14535dc620ff expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440227.712751:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ee07fb9e600/0x85f5fa77adf3c38e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc620ff expref: 13 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440227.712764:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ee07fb9e600/0x85f5fa77adf3c38e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc620ff expref: 13 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440227.712773:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee07fb9e600, rc 0) 00000100:00100000:1.0:1787440227.712956:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee06d272c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+13:5603:x1874266681261568:12345-192.168.206.58@tcp:101:ll_cfg_requeue.0 Request processed in 287us (3774us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440227.712963:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 243 00000100:00100000:3.0:1787440227.743959:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee08032ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874266701221120:0@lo:400:kworker.0 00000100:00100000:3.0:1787440227.744037:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440227.744096:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787440227.744103:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee08032f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:168176ea-29d1-49de-a254-317e90d54802:3311:1874266701220736:0@lo:400:kworker.0 00000100:00100000:3.0:1787440227.744132:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440227.744153:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee08032dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1874266701221248:0@lo:400:kworker.0 00000100:00100000:1.0:1787440227.744413:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701221120 00000100:00100000:1.0:1787440227.744421:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701221120 00000100:00100000:1.0:1787440227.753690:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787440227.753815:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701220736 00000100:00100000:0.0:1787440227.753824:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701220736 00000100:00100000:0.0:1787440227.753862:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1787440227.753870:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee06d272050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:168176ea-29d1-49de-a254-317e90d54802+19:3311:x1874266701220736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440227.753899:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee08032ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1874266701221120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787440227.759456:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee08032d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874266701220864:0@lo:400:kworker.0 00000100:00100000:3.0:1787440227.759783:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440227.760344:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee06d272050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:168176ea-29d1-49de-a254-317e90d54802+19:3311:x1874266701220736:12345-0@lo:400:kworker.0 Request processed in 6472us (16208us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440227.760367:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1787440227.760592:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440227.760632:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681261696 00000100:00100000:0.0:1787440227.760651:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681261696 00000100:00100000:0.0:1787440227.760691:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 245 00000100:00100000:0.0:1787440227.760698:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee05d265050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+13:5603:x1874266681261696:12345-192.168.206.58@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787440227.760826:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee08032ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1874266701221120:12345-0@lo:400:kworker.0 Request processed in 7118us (16787us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440227.760836:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787440227.760977:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee05d265050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+13:5603:x1874266681261696:12345-192.168.206.58@tcp:501:ll_cfg_requeue.0 Request processed in 278us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440227.760984:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 245 00000100:00100000:0.0:1787440227.762607:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701221248 00000100:00100000:0.0:1787440227.762619:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701221248 00000100:00100000:0.0:1787440227.762707:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1787440227.762717:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee08032f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874266701221248:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1787440227.762964:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787440227.763053:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee08032f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874266701221248:12345-0@lo:400:kworker.0 Request processed in 75us (18610us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440227.763063:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1787440227.763094:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee08032ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3310:1874266701220992:0@lo:400:kworker.0 00000100:00100000:0.0:1787440227.763132:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440227.767470:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701220992 00000100:00100000:1.0:1787440227.767487:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701220992 00000100:00100000:1.0:1787440227.767575:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1787440227.767584:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee077839500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874266701220992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440227.767685:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee077839500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874266701220992:12345-0@lo:400:kworker.0 Request processed in 102us (4552us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440227.767692:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00080000:1.0:1787440227.769712:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787440227.769774:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee08032ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3310:1874266701220992:0@lo:400:kworker.0 00000100:00100000:2.0:1787440227.770681:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440227.770722:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee08032e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874266701221376:0@lo:400:kworker.0 00000100:00100000:2.0:1787440227.770761:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440227.770803:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701221376 00000100:00100000:2.0:1787440227.770809:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701221376 00000100:00100000:2.0:1787440227.770986:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787440227.770994:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee080326a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1874266701221376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787440227.771054:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee080326a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1874266701221376:12345-0@lo:400:kworker.0 Request processed in 62us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440227.771062:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:2.0:1787440227.771081:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1787440227.771115:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ee08032e300 x1874266701221376/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787440243 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787440227.771142:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee08032e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874266701221376:0@lo:400:kworker.0 00000100:00100000:2.0:1787440227.771160:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701220864 00000100:00100000:2.0:1787440227.771164:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701220864 00000100:00100000:2.0:1787440227.771614:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1787440227.771622:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee080326680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874266701220864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787440227.771664:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee080326680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874266701220864:12345-0@lo:400:kworker.0 Request processed in 43us (985us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440227.771670:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1787440227.771699:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee08032d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874266701220864:0@lo:400:kworker.0 00000100:00100000:3.0:1787440227.772536:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee08032dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1874266701221248:0@lo:400:kworker.0 00010000:00080000:3.0:1787440227.772570:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ee08032ed80 x1874266701221120/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787440243 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787440227.772580:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee08032ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874266701221120:0@lo:400:kworker.0 00000100:00100000:3.0:1787440227.772600:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee08032f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:168176ea-29d1-49de-a254-317e90d54802:3311:1874266701220736:0@lo:400:kworker.0 00000100:00100000:1.0:1787440227.775733:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440227.777728:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681261824 00000100:00100000:0.0:1787440227.777741:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681261824 00000100:00100000:1.0:1787440227.777875:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 246 00000100:00100000:1.0:1787440227.777887:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee05d264850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+13:5603:x1874266681261824:12345-192.168.206.58@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787440227.778124:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee05d264850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+13:5603:x1874266681261824:12345-192.168.206.58@tcp:503:ll_cfg_requeue.0 Request processed in 239us (2398us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440227.778133:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 246 00000100:00100000:0.0:1787440228.255158:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee07783aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1874266701221504:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787440228.255227:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440228.255301:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701221504 00000100:00100000:0.0:1787440228.255308:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701221504 00000100:00100000:0.0:1787440228.255353:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787440228.255362:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee077838700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874266701221504:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787440228.255408:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787440228.255464:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee077838700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874266701221504:12345-0@lo:13:osp-pre-1-0.0 Request processed in 102us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440228.255488:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:0.0:1787440228.255662:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ee07783aa00 x1874266701221504/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787440244 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787440228.255681:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee07783aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1874266701221504:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787440228.445859:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787440229.474252:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787440230.494306:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787440231.494971:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440231.495014:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440231.495042:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440231.495069:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681262208 00000100:00100000:3.0:1787440231.495077:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681262208 00000100:00100000:0.0:1787440231.495219:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681261952 00000100:00100000:0.0:1787440231.495224:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681261952 00000100:00100000:0.0:1787440231.495269:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 247 00000100:00100000:0.0:1787440231.495287:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee05d265c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+13:2362:x1874266681261952:12345-192.168.206.58@tcp:400:kworker.0 00000100:00100000:0.0:1787440231.495361:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee05d265c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+13:2362:x1874266681261952:12345-192.168.206.58@tcp:400:kworker.0 Request processed in 76us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440231.495370:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 247 00000100:00100000:3.0:1787440231.495560:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681262080 00000100:00100000:0.0:1787440231.495566:0:6892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 94 00000100:00100000:3.0:1787440231.495572:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681262080 00000100:00100000:0.0:1787440231.495580:0:6892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee08032f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fde7b340-91f7-42a0-a1a3-5665ea2691c9+5:2362:x1874266681262208:12345-192.168.206.58@tcp:400:kworker.0 00000100:00100000:3.0:1787440231.495623:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 95 00000100:00100000:0.0:1787440231.495632:0:6892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee08032f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fde7b340-91f7-42a0-a1a3-5665ea2691c9+5:2362:x1874266681262208:12345-192.168.206.58@tcp:400:kworker.0 Request processed in 54us (615us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440231.495642:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee08032ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+6:2362:x1874266681262080:12345-192.168.206.58@tcp:400:kworker.0 00000100:00100000:0.0:1787440231.495652:0:6892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 94 00000100:00100000:3.0:1787440231.495714:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee08032ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+6:2362:x1874266681262080:12345-192.168.206.58@tcp:400:kworker.0 Request processed in 80us (669us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440231.495723:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 95 00000100:00080000:3.0:1787440231.496187:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787440231.517718:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787440231.839565:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee07783aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874266701221632:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787440231.839635:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440231.840272:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701221632 00000100:00100000:0.0:1787440231.840281:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701221632 00000100:00080000:3.0:1787440231.840332:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787440231.840351:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787440231.840373:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee080325880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874266701221632:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787440231.845215:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787440231.845337:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee080325880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874266701221632:12345-0@lo:13:osp-pre-0-0.0 Request processed in 4972us (5697us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440231.845348:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:3.0:1787440231.845376:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ee07783aa00 x1874266701221632/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787440247 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787440231.845400:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee07783aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874266701221632:0@lo:13:osp-pre-0-0.0 00000001:02000400:3.0:1787440232.170377:0:11362:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg658-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1787440232.542862:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787440232.861190:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee050482a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:168176ea-29d1-49de-a254-317e90d54802:3312:1874266701221760:0@lo:400:kworker.0 00000100:00100000:0.0:1787440232.861261:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440232.861327:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee050482300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3310:1874266701222016:0@lo:400:kworker.0 00000100:00100000:1.0:1787440232.861359:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440232.861406:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1787440232.861424:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee050483b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874266701221888:0@lo:400:kworker.0 00000100:00100000:1.0:1787440232.861463:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440232.861480:0:6892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701222016 00000100:00100000:1.0:1787440232.861482:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee050481500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1874266701222400:0@lo:400:kworker.0 00000100:00100000:0.0:1787440232.861487:0:6892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701222016 00000100:00100000:1.0:1787440232.861526:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440232.861559:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701221888 00000100:00100000:1.0:1787440232.861563:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701221888 00000100:00100000:0.0:1787440232.861572:0:6892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1787440232.861581:0:6892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee0800a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874266701222016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440232.861587:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1787440232.861591:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee0800a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874266701221888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787440232.861633:0:6892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee0800a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874266701222016:12345-0@lo:400:kworker.0 Request processed in 53us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440232.861641:0:6892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00080000:0.0:1787440232.861672:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787440232.861684:0:9225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701222400 00000100:00100000:0.0:1787440232.861688:0:9225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701222400 00000100:00100000:0.0:1787440232.861719:0:9225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787440232.861737:0:9225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee0800a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1874266701222400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787440232.861805:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701221760 00000100:00100000:2.0:1787440232.861809:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701221760 00000100:00100000:2.0:1787440232.861837:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:2.0:1787440232.861844:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee05d265850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:168176ea-29d1-49de-a254-317e90d54802+19:3312:x1874266701221760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787440232.861877:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee05d265850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:168176ea-29d1-49de-a254-317e90d54802+19:3312:x1874266701221760:12345-0@lo:400:kworker.0 Request processed in 33us (615us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440232.861884:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:3.0:1787440232.862693:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee050483800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874266701222144:0@lo:400:kworker.0 00000100:00100000:3.0:1787440232.862746:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787440232.862805:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787440232.862845:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee050482a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:168176ea-29d1-49de-a254-317e90d54802:3312:1874266701221760:0@lo:400:kworker.0 00000100:00100000:3.0:1787440232.862854:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee050481180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3312:1874266701222272:0@lo:400:kworker.0 00000100:00100000:3.0:1787440232.862879:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440232.862916:0:6892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701222272 00000100:00100000:3.0:1787440232.862935:0:6892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701222272 00000100:00100000:3.0:1787440232.862973:0:6892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1787440232.862980:0:6892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee08032d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874266701222272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440232.863022:0:6892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee08032d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874266701222272:12345-0@lo:400:kworker.0 Request processed in 42us (142us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440232.863029:0:6892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00080000:3.0:1787440232.863047:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787440232.863065:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee050481180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3312:1874266701222272:0@lo:400:kworker.0 00000100:00100000:2.0:1787440232.863291:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701222144 00000100:00100000:2.0:1787440232.863295:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701222144 00000100:00100000:2.0:1787440232.863324:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787440232.863330:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee08032dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1874266701222144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787440232.863368:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee08032dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1874266701222144:12345-0@lo:400:kworker.0 Request processed in 38us (621us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440232.863381:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:2.0:1787440232.863425:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ee050483800 x1874266701222144/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787440248 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787440232.863436:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee050483800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874266701222144:0@lo:400:kworker.0 00000100:00100000:1.0:1787440232.863668:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee0800a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874266701221888:12345-0@lo:400:kworker.0 Request processed in 2073us (2218us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440232.863675:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1787440232.875352:0:9225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee0800a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1874266701222400:12345-0@lo:400:kworker.0 Request processed in 13605us (13814us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440232.875369:0:9225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787440232.882284:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee050483b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874266701221888:0@lo:400:kworker.0 00010000:00080000:3.0:1787440232.882307:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ee050481500 x1874266701222400/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787440248 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787440232.882318:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee050481500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1874266701222400:0@lo:400:kworker.0 00000100:00100000:3.0:1787440232.882329:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee050482300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3310:1874266701222016:0@lo:400:kworker.0 00000100:00100000:1.0:1787440233.375118:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee08032e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1874266701222528:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787440233.375246:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440233.376294:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701222528 00000100:00100000:0.0:1787440233.376305:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701222528 00000100:00100000:0.0:1787440233.376371:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787440233.376382:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee0800a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874266701222528:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787440233.376431:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787440233.379931:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee0800a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874266701222528:12345-0@lo:13:osp-pre-1-0.0 Request processed in 3541us (4675us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440233.379964:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:1.0:1787440233.382746:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ee08032e300 x1874266701222528/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787440249 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787440233.382786:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee08032e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1874266701222528:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787440233.564859:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787440234.596963:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787440235.613702:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787440236.602018:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440236.602080:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:1.0:1787440236.602318:0:6892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681262464 00000100:00100000:1.0:1787440236.602328:0:6892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681262464 00000100:00100000:3.0:1787440236.602350:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440236.602381:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681262592 00000100:00100000:3.0:1787440236.602386:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681262592 00000100:00100000:1.0:1787440236.602433:0:6892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 99 00000100:00100000:1.0:1787440236.602446:0:6892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee08032ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+6:2362:x1874266681262464:12345-192.168.206.58@tcp:400:kworker.0 00000100:00080000:0.0:1787440236.602456:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787440236.602551:0:6892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee08032ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+6:2362:x1874266681262464:12345-192.168.206.58@tcp:400:kworker.0 Request processed in 109us (541us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440236.602558:0:6892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 99 00000100:00100000:1.0:1787440236.602576:0:6892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 100 00000100:00100000:1.0:1787440236.602583:0:6892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee08032e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fde7b340-91f7-42a0-a1a3-5665ea2691c9+5:2362:x1874266681262592:12345-192.168.206.58@tcp:400:kworker.0 00000100:00100000:1.0:1787440236.602608:0:6892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee08032e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fde7b340-91f7-42a0-a1a3-5665ea2691c9+5:2362:x1874266681262592:12345-192.168.206.58@tcp:400:kworker.0 Request processed in 26us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440236.602614:0:6892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 100 00000100:00100000:2.0:1787440236.602674:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681262336 00000100:00100000:2.0:1787440236.602679:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681262336 00000100:00100000:2.0:1787440236.602709:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 249 00000100:00100000:2.0:1787440236.602716:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee05d267050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+13:2362:x1874266681262336:12345-192.168.206.58@tcp:400:kworker.0 00000100:00100000:2.0:1787440236.602743:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee05d267050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+13:2362:x1874266681262336:12345-192.168.206.58@tcp:400:kworker.0 Request processed in 27us (672us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440236.602748:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 249 00010000:00010000:2.0:1787440236.637132:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787440236.956902:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee079915c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874266701222656:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787440236.956989:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440236.957704:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701222656 00000100:00100000:3.0:1787440236.957713:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701222656 00000100:00100000:3.0:1787440236.957785:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787440236.957797:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee050483800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874266701222656:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787440236.957840:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787440236.957895:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee050483800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874266701222656:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (906us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440236.957912:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:2.0:1787440236.958106:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ee079915c00 x1874266701222656/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787440252 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787440236.958125:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee079915c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874266701222656:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787440236.958286:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787440237.660674:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787440237.981575:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee0800a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:168176ea-29d1-49de-a254-317e90d54802:3312:1874266701222784:0@lo:400:kworker.0 00000100:00100000:1.0:1787440237.981637:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440237.981676:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee077f40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3312:1874266701223296:0@lo:400:kworker.0 00000100:00100000:1.0:1787440237.981698:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440237.983923:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee077f42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874266701223168:0@lo:400:kworker.0 00000100:00100000:3.0:1787440237.984005:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440237.984067:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701223168 00000100:00100000:3.0:1787440237.984074:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701223168 00000100:00100000:3.0:1787440237.984117:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787440237.984125:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee079915880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1874266701223168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440237.984408:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee079915880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1874266701223168:12345-0@lo:400:kworker.0 Request processed in 282us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440237.984415:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:3.0:1787440237.984459:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ee077f42a00 x1874266701223168/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787440253 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787440237.984473:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee077f42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874266701223168:0@lo:400:kworker.0 00000100:00100000:2.0:1787440237.987015:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee077f43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874266701222912:0@lo:400:kworker.0 00000100:00100000:1.0:1787440237.987909:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee077f41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3310:1874266701223040:0@lo:400:kworker.0 00000100:00100000:1.0:1787440237.987943:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440237.987970:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701222784 00000100:00100000:1.0:1787440237.987976:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701222784 00000100:00100000:1.0:1787440237.988033:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:1.0:1787440237.988040:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee05d264450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:168176ea-29d1-49de-a254-317e90d54802+19:3312:x1874266701222784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440237.988083:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee05d264450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:168176ea-29d1-49de-a254-317e90d54802+19:3312:x1874266701222784:12345-0@lo:400:kworker.0 Request processed in 44us (6446us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440237.988090:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:1.0:1787440237.988129:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee0800a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:168176ea-29d1-49de-a254-317e90d54802:3312:1874266701222784:0@lo:400:kworker.0 00000100:00100000:3.0:1787440237.988320:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701223296 00000100:00100000:3.0:1787440237.988333:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701223296 00000100:00100000:3.0:1787440237.988371:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701223040 00000100:00100000:3.0:1787440237.988374:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701223040 00000100:00100000:3.0:1787440237.988406:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1787440237.988412:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee047a7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874266701223296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440237.988449:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee047a7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874266701223296:12345-0@lo:400:kworker.0 Request processed in 37us (6750us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440237.988455:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1787440237.988468:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1787440237.988474:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee047a7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874266701223040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440237.988525:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee047a7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874266701223040:12345-0@lo:400:kworker.0 Request processed in 51us (582us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440237.988537:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1787440237.988567:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee077f41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3310:1874266701223040:0@lo:400:kworker.0 00000100:00100000:3.0:1787440237.988586:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee077f40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3312:1874266701223296:0@lo:400:kworker.0 00000100:00080000:1.0:1787440237.988683:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787440237.990186:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440237.990228:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee047a7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874266701223424:0@lo:400:kworker.0 00000100:00100000:2.0:1787440237.990600:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440237.990648:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701222912 00000100:00100000:2.0:1787440237.990662:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701222912 00000100:00100000:2.0:1787440237.990700:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1787440237.990708:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee050482680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874266701222912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787440237.990756:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee050482680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874266701222912:12345-0@lo:400:kworker.0 Request processed in 49us (574us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440237.990763:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1787440237.990802:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee077f43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874266701222912:0@lo:400:kworker.0 00000100:00100000:1.0:1787440237.991428:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701223424 00000100:00100000:1.0:1787440237.991433:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701223424 00000100:00100000:1.0:1787440237.991480:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787440237.991488:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee050482300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1874266701223424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440237.991561:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee050482300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1874266701223424:12345-0@lo:400:kworker.0 Request processed in 74us (961us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440237.991568:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:1.0:1787440237.991585:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1787440237.991648:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ee047a7f480 x1874266701223424/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787440253 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787440237.991660:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee047a7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874266701223424:0@lo:400:kworker.0 00000001:02000400:0.0:1787440237.994792:0:11463:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 19:10:35 (1787440235) === 00000100:00100000:0.0:1787440238.211359:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440238.211419:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440238.211677:0:6892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681262720 00000100:00100000:3.0:1787440238.211687:0:6892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681262720 00000100:00100000:3.0:1787440238.211763:0:6892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 14 00000100:00100000:3.0:1787440238.211773:0:6892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee077839880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+6:2363:x1874266681262720:12345-192.168.206.58@tcp:41:mkdir.0 00000004:00000024:3.0:1787440238.211813:0:6892:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1787440238.211915:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681262848 00000100:00100000:2.0:1787440238.211919:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681262848 00000100:00100000:2.0:1787440238.212187:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 0 00000100:00100000:2.0:1787440238.212197:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee07783aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+7:9693:x1874266681262848:12345-192.168.206.58@tcp:700:mkdir.0 00000100:00080000:1.0:1787440238.212330:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787440238.212555:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee07783aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+7:9693:x1874266681262848:12345-192.168.206.58@tcp:700:mkdir.0 Request processed in 359us (1135us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440238.212563:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 0 00000100:00100000:0.0:1787440238.214403:0:6892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee077839880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+6:2363:x1874266681262720:12345-192.168.206.58@tcp:41:mkdir.0 Request processed in 2622us (3044us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440238.214416:0:6892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 14 00000100:00100000:0.0:1787440238.219043:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440238.219443:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681263104 00000100:00100000:3.0:1787440238.219453:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681263104 00000100:00100000:3.0:1787440238.219548:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 15 00000100:00100000:3.0:1787440238.219557:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee07783b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+6:9693:x1874266681263104:12345-192.168.206.58@tcp:36:mkdir.0 00010000:00010000:3.0:1787440238.219612:0:5850:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787440238.219732:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86ea00/0x85f5fa77adf3c276 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62081 expref: 6 pid: 6892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440238.219755:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ee054b3c900) 00010000:00010000:3.0:1787440238.219764:0:5850:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787440238.220117:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94800/0x85f5fa77adf3c395 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440238.220131:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94800/0x85f5fa77adf3c395 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440238.220141:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94800/0x85f5fa77adf3c395 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440238.220182:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95200/0x85f5fa77adf3c39c lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440238.220190:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95200/0x85f5fa77adf3c39c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440238.220198:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95200/0x85f5fa77adf3c39c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787440238.221462:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00010000:00010000:3.0:1787440238.221476:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94800/0x85f5fa77adf3c395 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440238.221485:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94800/0x85f5fa77adf3c395 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440238.221532:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94800/0x85f5fa77adf3c395 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440238.221539:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee049e94800 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:3.0:1787440238.221544:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94800/0x85f5fa77adf3c395 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440238.221552:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94800/0x85f5fa77adf3c395 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440238.221566:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ee0460cce00) 00010000:00010000:3.0:1787440238.221569:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440238.221573:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94800/0x85f5fa77adf3c395 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440238.221590:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94800/0x85f5fa77adf3c395 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787440238.221609:0:5850:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000032475c2c reply state 0000000099e4d676 transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95200/0x85f5fa77adf3c39c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440238.221618:0:5850:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787440238.221713:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee07783b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+7:9693:x1874266681263104:12345-192.168.206.58@tcp:36:mkdir.0 Request processed in 2153us (2675us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1787440238.221722:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 15 00010000:00010000:3.0:1787440238.227309:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95200/0x85f5fa77adf3c39c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440238.227326:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95200/0x85f5fa77adf3c39c lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440238.227333:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95200/0x85f5fa77adf3c39c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440238.227339:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee049e95200 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:3.0:1787440238.227343:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95200/0x85f5fa77adf3c39c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440238.227350:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95200/0x85f5fa77adf3c39c lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440238.227366:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8ee0460cc300) 00010000:00010000:3.0:1787440238.227370:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440238.227374:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95200/0x85f5fa77adf3c39c lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440238.227405:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95200/0x85f5fa77adf3c39c lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440238.246358:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:2.0:1787440238.246476:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681263232 00000100:00100000:2.0:1787440238.246485:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681263232 00000100:00100000:2.0:1787440238.250009:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 16 00000100:00100000:2.0:1787440238.250034:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04a658000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+6:9694:x1874266681263232:12345-192.168.206.58@tcp:101:chmod.0 00010000:00010000:2.0:1787440238.250056:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440238.250081:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86ea00/0x85f5fa77adf3c3a3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fab14535dc62106 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440238.250148:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86fe00/0x85f5fa77adf3c3aa lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440238.250175:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86fe00/0x85f5fa77adf3c3aa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440238.250187:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86fe00/0x85f5fa77adf3c3aa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787440238.250253:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1787440238.250256:0:5849:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1787440238.250299:0:5849:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86fe00/0x85f5fa77adf3c3aa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440238.250324:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86ea00/0x85f5fa77adf3c3a3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62106 expref: 8 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440238.250343:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86fe00/0x85f5fa77adf3c3aa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62106 expref: 7 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440238.250352:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ee054b3c200) 00010000:00010000:2.0:1787440238.250355:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787440238.250358:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee07f86fe00, rc 0) 00000100:00100000:2.0:1787440238.250641:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04a658000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+7:9694:x1874266681263232:12345-192.168.206.58@tcp:101:chmod.0 Request processed in 619us (4291us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440238.250649:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 16 00000100:00100000:2.0:1787440238.257074:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440238.257243:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681263488 00000100:00100000:3.0:1787440238.257253:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681263488 00000100:00100000:3.0:1787440238.257308:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 17 00000100:00100000:3.0:1787440238.257317:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee050481500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+7:9694:x1874266681263488:12345-192.168.206.58@tcp:36:chmod.0 00010000:00010000:3.0:1787440238.257373:0:5850:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787440238.257405:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86fe00/0x85f5fa77adf3c3aa lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62106 expref: 7 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440238.257422:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ee054b3c200) 00010000:00010000:3.0:1787440238.257432:0:5850:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787440238.257462:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95200/0x85f5fa77adf3c3b1 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440238.257474:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95200/0x85f5fa77adf3c3b1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440238.257484:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95200/0x85f5fa77adf3c3b1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787440238.257788:0:5850:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a384fec9 reply state 00000000e01c0ef0 transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95200/0x85f5fa77adf3c3b1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440238.257797:0:5850:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1787440238.257809:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:3.0:1787440238.257900:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee050481500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+8:9694:x1874266681263488:12345-192.168.206.58@tcp:36:chmod.0 Request processed in 583us (844us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1787440238.257918:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 17 00010000:00010000:0.0:1787440238.260002:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95200/0x85f5fa77adf3c3b1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440238.260017:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95200/0x85f5fa77adf3c3b1 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440238.260025:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95200/0x85f5fa77adf3c3b1 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440238.260031:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee049e95200 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:0.0:1787440238.260035:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95200/0x85f5fa77adf3c3b1 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440238.260043:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95200/0x85f5fa77adf3c3b1 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440238.260072:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ee0460cc300) 00010000:00010000:0.0:1787440238.260076:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787440238.260092:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95200/0x85f5fa77adf3c3b1 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440238.260099:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95200/0x85f5fa77adf3c3b1 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440238.304366:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440238.305196:0:6892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681263616 00000100:00100000:0.0:1787440238.305207:0:6892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681263616 00000100:00100000:0.0:1787440238.305349:0:6892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 18 00000100:00100000:0.0:1787440238.305362:0:6892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee050483b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+7:9695:x1874266681263616:12345-192.168.206.58@tcp:101:chown.0 00010000:00010000:0.0:1787440238.305405:0:6892:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440238.305428:0:6892:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf600/0x85f5fa77adf3c3b8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fab14535dc6210d expref: -99 pid: 6892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440238.305512:0:6892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfe00/0x85f5fa77adf3c3bf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440238.305525:0:6892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfe00/0x85f5fa77adf3c3bf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440238.305914:0:6892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfe00/0x85f5fa77adf3c3bf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787440238.305978:0:6892:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:0.0:1787440238.305983:0:6892:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1787440238.306026:0:6892:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfe00/0x85f5fa77adf3c3bf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440238.306055:0:6892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf600/0x85f5fa77adf3c3b8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6210d expref: 9 pid: 6892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440238.306073:0:6892:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfe00/0x85f5fa77adf3c3bf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6210d expref: 8 pid: 6892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440238.306157:0:6892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ee050ca1a00) 00010000:00010000:0.0:1787440238.306160:0:6892:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787440238.306163:0:6892:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee04cbcfe00, rc 0) 00000100:00100000:0.0:1787440238.306238:0:6892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee050483b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+8:9695:x1874266681263616:12345-192.168.206.58@tcp:101:chown.0 Request processed in 878us (1880us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440238.306246:0:6892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 18 00000100:00100000:3.0:1787440238.317483:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440238.319877:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681263744 00000100:00100000:0.0:1787440238.319903:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681263744 00000100:00100000:0.0:1787440238.320016:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 19 00000100:00100000:0.0:1787440238.320050:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee079914a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+8:9695:x1874266681263744:12345-192.168.206.58@tcp:101:chown.0 00010000:00010000:0.0:1787440238.320114:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440238.320146:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf600/0x85f5fa77adf3c3c6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fab14535dc62114 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440238.320210:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce200/0x85f5fa77adf3c3cd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440238.320225:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce200/0x85f5fa77adf3c3cd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440238.320236:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce200/0x85f5fa77adf3c3cd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440238.320250:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf400/0x85f5fa77adf3c3d4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440238.320258:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf400/0x85f5fa77adf3c3d4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440238.320283:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf400/0x85f5fa77adf3c3d4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440238.320388:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcec00/0x85f5fa77adf3c3db lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440238.320397:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcec00/0x85f5fa77adf3c3db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440238.320404:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcec00/0x85f5fa77adf3c3db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787440238.320442:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00000004:00200000:0.0:1787440238.320446:0:5850:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787440238.320469:0:5850:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcec00/0x85f5fa77adf3c3db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440238.320482:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce200/0x85f5fa77adf3c3cd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440238.320489:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce200/0x85f5fa77adf3c3cd lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440238.320597:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce200/0x85f5fa77adf3c3cd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440238.320603:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee04cbce200 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:0.0:1787440238.320607:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce200/0x85f5fa77adf3c3cd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440238.320614:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce200/0x85f5fa77adf3c3cd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440238.320633:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ee050ca1a00) 00010000:00010000:0.0:1787440238.320635:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440238.320639:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce200/0x85f5fa77adf3c3cd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440238.320646:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce200/0x85f5fa77adf3c3cd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440238.320681:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf400/0x85f5fa77adf3c3d4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440238.320947:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf400/0x85f5fa77adf3c3d4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440238.320976:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf400/0x85f5fa77adf3c3d4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440238.320980:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee04cbcf400 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:0.0:1787440238.320984:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf400/0x85f5fa77adf3c3d4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440238.320990:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf400/0x85f5fa77adf3c3d4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440238.320998:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8ee050ca1c00) 00010000:00010000:0.0:1787440238.321000:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440238.321003:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf400/0x85f5fa77adf3c3d4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440238.321008:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf400/0x85f5fa77adf3c3d4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440238.321057:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf600/0x85f5fa77adf3c3c6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62114 expref: 10 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440238.321070:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcec00/0x85f5fa77adf3c3db lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62114 expref: 9 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440238.321078:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8ee050ca1800) 00010000:00010000:0.0:1787440238.321080:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787440238.321083:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee04cbcec00, rc 0) 00000100:00100000:0.0:1787440238.321279:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee079914a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+9:9695:x1874266681263744:12345-192.168.206.58@tcp:101:chown.0 Request processed in 1245us (3796us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440238.321288:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 19 00000100:00100000:1.0:1787440238.335944:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440238.337992:0:6892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681264000 00000100:00100000:0.0:1787440238.338005:0:6892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681264000 00000100:00100000:0.0:1787440238.338076:0:6892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 20 00000100:00100000:0.0:1787440238.338087:0:6892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee047a7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+9:9695:x1874266681264000:12345-192.168.206.58@tcp:36:chown.0 00010000:00010000:0.0:1787440238.338135:0:6892:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787440238.338160:0:6892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcec00/0x85f5fa77adf3c3db lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62114 expref: 9 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440238.338178:0:6892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8ee050ca1800) 00010000:00010000:0.0:1787440238.338187:0:6892:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787440238.338208:0:6892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf600/0x85f5fa77adf3c3e2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440238.338220:0:6892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf600/0x85f5fa77adf3c3e2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440238.338243:0:6892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf600/0x85f5fa77adf3c3e2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787440238.472054:0:5871:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000004:00010000:3.0:1787440238.472263:0:6892:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c1a508ba reply state 000000008a9123b9 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf600/0x85f5fa77adf3c3e2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440238.472278:0:6892:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1787440238.472639:0:6892:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00080000:3.0:1787440238.472739:0:6892:0:(ldlm_lib.c:3482:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1787440238.472758:0:6892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee047a7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+10:9695:x1874266681264000:12345-192.168.206.58@tcp:36:chown.0 Request processed in 134670us (136820us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1787440238.472767:0:6892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 20 00010000:00010000:3.0:1787440238.472805:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf600/0x85f5fa77adf3c3e2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440238.472813:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf600/0x85f5fa77adf3c3e2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440238.472820:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf600/0x85f5fa77adf3c3e2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440238.472826:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee04cbcf600 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:3.0:1787440238.472830:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf600/0x85f5fa77adf3c3e2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440238.472837:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf600/0x85f5fa77adf3c3e2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440238.474956:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8ee050ca1c00) 00010000:00010000:3.0:1787440238.474965:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787440238.474974:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf600/0x85f5fa77adf3c3e2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440238.474994:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf600/0x85f5fa77adf3c3e2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440238.501303:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee079917480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1874266701223552:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787440238.501371:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440238.501635:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701223552 00000100:00100000:2.0:1787440238.501643:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701223552 00000100:00100000:2.0:1787440238.501690:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787440238.501699:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee047a7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874266701223552:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787440238.501758:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787440238.509814:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee047a7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874266701223552:12345-0@lo:13:osp-pre-1-0.0 Request processed in 8106us (8432us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440238.509828:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:1.0:1787440238.513030:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ee079917480 x1874266701223552/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787440254 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787440238.513057:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee079917480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1874266701223552:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787440238.515847:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440238.515979:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681264128 00000100:00100000:3.0:1787440238.515989:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681264128 00000100:00100000:3.0:1787440238.516046:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 21 00000100:00100000:3.0:1787440238.516055:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee050481180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+6:9696:x1874266681264128:12345-192.168.206.58@tcp:101:touch.500 00010000:00010000:3.0:1787440238.516088:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440238.516107:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94800/0x85f5fa77adf3c3e9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fab14535dc6211b expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787440238.517608:0:5851:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 1456us 00010000:00010000:0.0:1787440238.572616:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcec00/0x85f5fa77adf3c3f0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440238.572638:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcec00/0x85f5fa77adf3c3f0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440238.572650:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcec00/0x85f5fa77adf3c3f0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440238.572665:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf400/0x85f5fa77adf3c3f7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440238.572673:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf400/0x85f5fa77adf3c3f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440238.572680:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf400/0x85f5fa77adf3c3f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440238.573112:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce200/0x85f5fa77adf3c3fe lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440238.573121:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce200/0x85f5fa77adf3c3fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440238.573128:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce200/0x85f5fa77adf3c3fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787440238.573218:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1787440238.573223:0:5851:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787440238.573319:0:5851:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce200/0x85f5fa77adf3c3fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440238.573333:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcec00/0x85f5fa77adf3c3f0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440238.573339:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcec00/0x85f5fa77adf3c3f0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440238.573345:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcec00/0x85f5fa77adf3c3f0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440238.573350:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee04cbcec00 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:0.0:1787440238.573354:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcec00/0x85f5fa77adf3c3f0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440238.573361:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcec00/0x85f5fa77adf3c3f0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440238.573372:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ee050ca1a00) 00010000:00010000:0.0:1787440238.573375:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440238.573391:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcec00/0x85f5fa77adf3c3f0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440238.573397:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcec00/0x85f5fa77adf3c3f0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440238.573416:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf400/0x85f5fa77adf3c3f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440238.573433:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf400/0x85f5fa77adf3c3f7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440238.573439:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf400/0x85f5fa77adf3c3f7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440238.573444:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee04cbcf400 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:0.0:1787440238.573447:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf400/0x85f5fa77adf3c3f7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440238.573453:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf400/0x85f5fa77adf3c3f7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440238.573461:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8ee050ca1600) 00010000:00010000:0.0:1787440238.573464:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440238.573466:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf400/0x85f5fa77adf3c3f7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440238.573471:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf400/0x85f5fa77adf3c3f7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440238.573552:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94800/0x85f5fa77adf3c3e9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6211b expref: 8 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440238.573569:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce200/0x85f5fa77adf3c3fe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6211b expref: 7 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440238.573576:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8ee050ca1800) 00010000:00010000:0.0:1787440238.573578:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1787440238.573586:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee04cbce200, rc 0) 00000100:00100000:0.0:1787440238.573651:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee050481180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+7:9696:x1874266681264128:12345-192.168.206.58@tcp:101:touch.500 Request processed in 57594us (57810us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440238.573659:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 21 00000100:00100000:0.0:1787440238.582592:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:2.0:1787440238.584843:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681264384 00000100:00100000:2.0:1787440238.584868:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681264384 00000100:00100000:2.0:1787440238.584942:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 22 00000100:00100000:2.0:1787440238.584954:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04a659880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+7:9696:x1874266681264384:12345-192.168.206.58@tcp:101:touch.500 00010000:00010000:2.0:1787440238.584975:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440238.584995:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f600/0x85f5fa77adf3c405 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fab14535dc62122 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440238.585620:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f000/0x85f5fa77adf3c40c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440238.585635:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f000/0x85f5fa77adf3c40c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440238.585646:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f000/0x85f5fa77adf3c40c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440238.585700:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86ec00/0x85f5fa77adf3c413 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x7c3c31ce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440238.585708:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86ec00/0x85f5fa77adf3c413 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x7c3c31ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440238.585714:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86ec00/0x85f5fa77adf3c413 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x7c3c31ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787440238.589227:0:5849:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:2.0:1787440238.589783:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e400/0x85f5fa77adf3c41a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440238.589799:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e400/0x85f5fa77adf3c41a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440238.589811:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e400/0x85f5fa77adf3c41a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440238.589847:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f000/0x85f5fa77adf3c40c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440238.590107:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f000/0x85f5fa77adf3c40c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440238.590115:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f000/0x85f5fa77adf3c40c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440238.590120:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee07f86f000 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:2.0:1787440238.590124:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f000/0x85f5fa77adf3c40c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440238.590132:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f000/0x85f5fa77adf3c40c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440238.590145:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8ee050ca1800) 00010000:00010000:2.0:1787440238.590148:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440238.590152:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f000/0x85f5fa77adf3c40c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440238.590170:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f000/0x85f5fa77adf3c40c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787440238.590194:0:5849:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000019235f24 reply state 0000000019ec0f01 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86ec00/0x85f5fa77adf3c413 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x7c3c31ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440238.590203:0:5849:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787440238.590236:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f600/0x85f5fa77adf3c405 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62122 expref: 10 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440238.590260:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e400/0x85f5fa77adf3c41a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62122 expref: 9 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440238.590266:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8ee054b3c500) 00010000:00010000:2.0:1787440238.590269:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787440238.590271:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee07f86e400, rc 0) 00000100:00100000:2.0:1787440238.593767:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04a659880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+10:9696:x1874266681264384:12345-192.168.206.58@tcp:101:touch.500 Request processed in 8802us (11167us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1787440238.593779:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 22 00010000:00010000:3.0:1787440238.599118:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86ec00/0x85f5fa77adf3c413 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x7c3c31ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440238.599142:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86ec00/0x85f5fa77adf3c413 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x7c3c31ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440238.599144:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00010000:00010000:3.0:1787440238.599158:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86ec00/0x85f5fa77adf3c413 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x7c3c31ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440238.599166:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee07f86ec00 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:3.0:1787440238.599172:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86ec00/0x85f5fa77adf3c413 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x7c3c31ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440238.599182:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86ec00/0x85f5fa77adf3c413 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x7c3c31ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440238.599209:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x7c3c31ce (ffff8ee054b3c600) 00010000:00010000:3.0:1787440238.599212:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440238.599239:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86ec00/0x85f5fa77adf3c413 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x7c3c31ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440238.599247:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86ec00/0x85f5fa77adf3c413 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x7c3c31ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440238.599281:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681264640 00000100:00100000:0.0:1787440238.599292:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681264640 00000100:00100000:0.0:1787440238.599353:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 23 00000100:00100000:0.0:1787440238.599363:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee050482a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+9:9696:x1874266681264640:12345-192.168.206.58@tcp:36:touch.500 00010000:00010000:0.0:1787440238.599445:0:5850:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787440238.599471:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e400/0x85f5fa77adf3c41a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62122 expref: 9 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440238.599512:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8ee054b3c500) 00010000:00010000:0.0:1787440238.599523:0:5850:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787440238.599562:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf400/0x85f5fa77adf3c428 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440238.599575:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf400/0x85f5fa77adf3c428 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440238.599584:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf400/0x85f5fa77adf3c428 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787440238.599743:0:5850:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006b35d5f4 reply state 000000004c218074 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf400/0x85f5fa77adf3c428 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440238.599752:0:5850:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787440238.599847:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee050482a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+10:9696:x1874266681264640:12345-192.168.206.58@tcp:36:touch.500 Request processed in 485us (711us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1787440238.599868:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 23 00000100:00100000:0.0:1787440238.604027:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:1.0:1787440238.604099:0:6892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681264768 00000100:00100000:1.0:1787440238.604108:0:6892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681264768 00000100:00100000:1.0:1787440238.604169:0:6892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 24 00000100:00100000:1.0:1787440238.604210:0:6892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04a659180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+10:9696:x1874266681264768:12345-192.168.206.58@tcp:101:touch.500 00010000:00010000:3.0:1787440238.604218:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf400/0x85f5fa77adf3c428 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440238.604236:0:6892:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440238.604239:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf400/0x85f5fa77adf3c428 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440238.604250:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf400/0x85f5fa77adf3c428 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440238.604258:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee04cbcf400 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:3.0:1787440238.604267:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf400/0x85f5fa77adf3c428 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440238.604270:0:6892:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9ee00/0x85f5fa77adf3c42f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fab14535dc62129 expref: -99 pid: 6892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440238.604279:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf400/0x85f5fa77adf3c428 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440238.604305:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8ee050ca1600) 00010000:00010000:3.0:1787440238.604309:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440238.604315:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf400/0x85f5fa77adf3c428 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440238.604321:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf400/0x85f5fa77adf3c428 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440238.604336:0:6892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9ee00/0x85f5fa77adf3c42f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62129 expref: 11 pid: 6892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440238.604356:0:6892:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9ee00/0x85f5fa77adf3c42f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62129 expref: 10 pid: 6892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440238.604375:0:6892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8ee050ca1600) 00010000:00010000:1.0:1787440238.604393:0:6892:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787440238.604397:0:6892:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee07fb9ee00, rc 0) 00000100:00100000:1.0:1787440238.604453:0:6892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04a659180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+10:9696:x1874266681264768:12345-192.168.206.58@tcp:101:touch.500 Request processed in 250us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440238.604460:0:6892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 24 00000100:00100000:3.0:1787440238.608653:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:2.0:1787440238.608729:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681264896 00000100:00100000:2.0:1787440238.608743:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681264896 00000100:00100000:2.0:1787440238.608800:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 16 00000100:00100000:2.0:1787440238.608809:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee079915180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2359:x1874266681264896:12345-192.168.206.58@tcp:8:touch.500 00010000:00080000:2.0:1787440238.608843:0:6695:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 792563a7-4c22-4ac7-ac25-d49ef7fb41a8@192.168.206.58@tcp t0 exp 0000000000000000 cur 336 last 0 00000020:00000080:2.0:1787440238.608884:0:6695:0:(genops.c:1385:class_connect()) connect: client 792563a7-4c22-4ac7-ac25-d49ef7fb41a8, cookie 0x85f5fa77adf3c436 00002000:00100000:2.0:1787440238.608895:0:6695:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 792563a7-4c22-4ac7-ac25-d49ef7fb41a8/ffff8ee080785800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113940 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787440238.608919:0:6695:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787440238.609151:0:6695:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787440238.609181:0:6695:0:(import.c:65:import_set_state_nolock()) ffff8ee080786000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787440238.609966:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee079915180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+6:2359:x1874266681264896:12345-192.168.206.58@tcp:8:touch.500 Request processed in 1152us (1321us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440238.609977:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 16 00000100:00100000:3.0:1787440238.612912:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:1.0:1787440238.614651:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681265024 00000100:00100000:1.0:1787440238.614669:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681265024 00000100:00080000:3.0:1787440238.614810:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787440238.614912:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 17 00000100:00100000:1.0:1787440238.614924:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee079914e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+6:0:x1874266681265024:12345-192.168.206.58@tcp:2:touch.500 00000001:00080000:3.0:1787440238.680811:0:7640:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000001:00100000:3.0:1787440238.680830:0:7640:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 792563a7-4c22-4ac7-ac25-d49ef7fb41a8 00000100:00100000:1.0:1787440238.681033:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee079914e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+5:0:x1874266681265024:12345-192.168.206.58@tcp:2:touch.500 Request processed in 66105us (68131us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1787440238.681055:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 17 00000100:00100000:0.0:1787440238.690173:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00010000:00010000:2.0:1787440238.690697:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787440238.690830:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681265280 00000100:00100000:3.0:1787440238.690840:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681265280 00000100:00100000:3.0:1787440238.690901:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 2 00000100:00100000:3.0:1787440238.690912:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04a659500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+10:9696:x1874266681265280:12345-192.168.206.58@tcp:35:touch.500 00000100:00100000:3.0:1787440238.691566:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04a659500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+11:9696:x1874266681265280:12345-192.168.206.58@tcp:35:touch.500 Request processed in 653us (1399us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1787440238.691574:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 2 00000100:00100000:3.0:1787440238.720950:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440238.721234:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681265408 00000100:00100000:0.0:1787440238.721251:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681265408 00000100:00100000:0.0:1787440238.721327:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 25 00000100:00100000:0.0:1787440238.721339:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee079917100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+11:9697:x1874266681265408:12345-192.168.206.58@tcp:101:rm.0 00010000:00010000:0.0:1787440238.721365:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440238.721437:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce800/0x85f5fa77adf3c43d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fab14535dc62130 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440238.725297:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f000/0x85f5fa77adf3c444 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440238.725319:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f000/0x85f5fa77adf3c444 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440238.725331:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f000/0x85f5fa77adf3c444 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787440238.725451:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1787440238.725455:0:5851:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787440238.725582:0:5851:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f000/0x85f5fa77adf3c444 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440238.725622:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce800/0x85f5fa77adf3c43d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62130 expref: 13 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440238.725645:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f000/0x85f5fa77adf3c444 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62130 expref: 12 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440238.725654:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8ee050ca1800) 00010000:00010000:2.0:1787440238.725657:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787440238.725673:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee07f86f000, rc 0) 00000100:00100000:2.0:1787440238.725797:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee079917100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+12:9697:x1874266681265408:12345-192.168.206.58@tcp:101:rm.0 Request processed in 4459us (4861us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440238.725806:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 25 00000100:00100000:2.0:1787440238.733486:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:1.0:1787440238.733600:0:6892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681265664 00000100:00100000:1.0:1787440238.733610:0:6892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681265664 00000100:00100000:1.0:1787440238.733669:0:6892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 26 00000100:00100000:1.0:1787440238.733692:0:6892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee05d27dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+12:9697:x1874266681265664:12345-192.168.206.58@tcp:101:rm.0 00010000:00010000:1.0:1787440238.733714:0:6892:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440238.733734:0:6892:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f400/0x85f5fa77adf3c44b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fab14535dc62137 expref: -99 pid: 6892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787440238.733840:0:6892:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:1.0:1787440238.734014:0:6892:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f400/0x85f5fa77adf3c44b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62137 expref: 14 pid: 6892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440238.734029:0:6892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ee050ca1a00) 00010000:00010000:1.0:1787440238.734032:0:6892:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787440238.734037:0:6892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f400/0x85f5fa77adf3c44b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62137 expref: 14 pid: 6892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440238.734062:0:6892:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee07fb9f400, rc 0) 00000100:00100000:1.0:1787440238.734123:0:6892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee05d27dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+13:9697:x1874266681265664:12345-192.168.206.58@tcp:101:rm.0 Request processed in 433us (645us total) trans 4294967303 rc 301/301 00000100:00100000:1.0:1787440238.734131:0:6892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 26 00000100:00100000:0.0:1787440238.746539:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:2.0:1787440238.747539:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681265792 00000100:00100000:2.0:1787440238.747553:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681265792 00000100:00100000:2.0:1787440238.747619:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 3 00000100:00100000:2.0:1787440238.747630:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04a65bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+13:9697:x1874266681265792:12345-192.168.206.58@tcp:37:rm.0 00000100:00100000:2.0:1787440238.756158:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04a65bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+13:9697:x1874266681265792:12345-192.168.206.58@tcp:37:rm.0 Request processed in 8520us (9663us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440238.756171:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 3 00000100:00100000:3.0:1787440238.773482:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:2.0:1787440238.774313:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681266048 00000100:00100000:2.0:1787440238.774324:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681266048 00000100:00100000:2.0:1787440238.774397:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 4 00000100:00100000:2.0:1787440238.774416:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee079bafc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+13:9697:x1874266681266048:12345-192.168.206.58@tcp:35:rm.0 00000100:00100000:2.0:1787440238.774684:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee079bafc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+14:9697:x1874266681266048:12345-192.168.206.58@tcp:35:rm.0 Request processed in 277us (1209us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1787440238.774693:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 4 00000100:00100000:0.0:1787440238.789667:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440238.793616:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681266304 00000100:00100000:3.0:1787440238.793633:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681266304 00000100:00100000:3.0:1787440238.793703:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 27 00000100:00100000:3.0:1787440238.793713:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04a65aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+14:9697:x1874266681266304:12345-192.168.206.58@tcp:101:rm.0 00010000:00010000:3.0:1787440238.793738:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440238.793759:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94600/0x85f5fa77adf3c459 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fab14535dc6213e expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440238.793891:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95800/0x85f5fa77adf3c460 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440238.793906:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95800/0x85f5fa77adf3c460 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440238.793917:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95800/0x85f5fa77adf3c460 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787440238.793928:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:3.0:1787440238.794082:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94600/0x85f5fa77adf3c459 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6213e expref: 17 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440238.794103:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95800/0x85f5fa77adf3c460 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6213e expref: 16 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440238.794111:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8ee050ca1800) 00010000:00010000:3.0:1787440238.794114:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787440238.794117:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee049e95800, rc 0) 00000100:00100000:3.0:1787440238.794193:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04a65aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+16:9697:x1874266681266304:12345-192.168.206.58@tcp:101:rm.0 Request processed in 480us (4534us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1787440238.794200:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 27 00000100:00100000:0.0:1787440238.802241:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:1.0:1787440238.802343:0:6892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681266432 00000100:00100000:1.0:1787440238.802352:0:6892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681266432 00000100:00100000:1.0:1787440238.802437:0:6892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 28 00000100:00100000:1.0:1787440238.802448:0:6892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04a658700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+16:9697:x1874266681266432:12345-192.168.206.58@tcp:41:rm.0 00000004:00000024:1.0:1787440238.802554:0:6892:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:1.0:1787440238.802620:0:6892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04a658700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+16:9697:x1874266681266432:12345-192.168.206.58@tcp:41:rm.0 Request processed in 174us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440238.802628:0:6892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 28 00000100:00100000:0.0:1787440238.813876:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440238.813984:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681266560 00000100:00100000:3.0:1787440238.813998:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681266560 00000100:00100000:3.0:1787440238.814085:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 29 00000100:00100000:3.0:1787440238.814097:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04a65a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+16:9697:x1874266681266560:12345-192.168.206.58@tcp:101:rm.0 00010000:00010000:3.0:1787440238.814123:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440238.814147:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94600/0x85f5fa77adf3c46e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fab14535dc62145 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440238.814225:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95000/0x85f5fa77adf3c475 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440238.814242:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95000/0x85f5fa77adf3c475 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440238.814255:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95000/0x85f5fa77adf3c475 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440238.814293:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94400/0x85f5fa77adf3c47c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x7c3c31ce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440238.814301:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94400/0x85f5fa77adf3c47c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x7c3c31ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440238.814307:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94400/0x85f5fa77adf3c47c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x7c3c31ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440238.814688:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95600/0x85f5fa77adf3c483 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440238.814698:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95600/0x85f5fa77adf3c483 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440238.814706:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95600/0x85f5fa77adf3c483 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787440238.814743:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:3.0:1787440238.814750:0:5850:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787440238.814771:0:5850:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95600/0x85f5fa77adf3c483 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440238.814785:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95600/0x85f5fa77adf3c483 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440238.814794:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95000/0x85f5fa77adf3c475 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440238.814801:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95000/0x85f5fa77adf3c475 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440238.814820:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95000/0x85f5fa77adf3c475 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440238.814826:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee049e95000 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:3.0:1787440238.814830:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95000/0x85f5fa77adf3c475 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440238.814839:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95000/0x85f5fa77adf3c475 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440238.814853:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8ee050ca1800) 00010000:00010000:3.0:1787440238.814856:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440238.814861:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95000/0x85f5fa77adf3c475 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440238.814867:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95000/0x85f5fa77adf3c475 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440238.814883:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94400/0x85f5fa77adf3c47c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x7c3c31ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440238.814889:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94400/0x85f5fa77adf3c47c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x7c3c31ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440238.814896:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94400/0x85f5fa77adf3c47c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x7c3c31ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440238.814900:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee049e94400 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:3.0:1787440238.814903:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94400/0x85f5fa77adf3c47c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x7c3c31ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440238.814925:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94400/0x85f5fa77adf3c47c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x7c3c31ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440238.814934:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x7c3c31ce (ffff8ee0460ccd00) 00010000:00010000:3.0:1787440238.814936:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440238.814939:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94400/0x85f5fa77adf3c47c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x7c3c31ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440238.814944:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94400/0x85f5fa77adf3c47c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x7c3c31ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440238.814981:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94600/0x85f5fa77adf3c46e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62145 expref: 18 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440238.814995:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95600/0x85f5fa77adf3c483 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62145 expref: 17 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440238.815003:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8ee050ca1600) 00010000:00010000:3.0:1787440238.815005:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787440238.815910:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee049e95600, rc 0) 00000100:00100000:3.0:1787440238.816023:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04a65a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+17:9697:x1874266681266560:12345-192.168.206.58@tcp:101:rm.0 Request processed in 1916us (2151us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440238.816033:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 29 00000100:00100000:2.0:1787440238.829143:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:1.0:1787440238.829303:0:6892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681266816 00000100:00100000:1.0:1787440238.829343:0:6892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681266816 00000100:00100000:1.0:1787440238.829434:0:6892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 30 00000100:00100000:1.0:1787440238.829445:0:6892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee05d27ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+17:9697:x1874266681266816:12345-192.168.206.58@tcp:36:rm.0 00010000:00010000:1.0:1787440238.829559:0:6892:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1787440238.829594:0:6892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95600/0x85f5fa77adf3c483 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62145 expref: 17 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440238.829618:0:6892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9ee00/0x85f5fa77adf3c42f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62129 expref: 16 pid: 6892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440238.829631:0:6892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8ee050ca1600) 00010000:00010000:1.0:1787440238.829649:0:6892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f000/0x85f5fa77adf3c444 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62130 expref: 15 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440238.829659:0:6892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8ee050ca1800) 00010000:00010000:1.0:1787440238.829662:0:6892:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787440238.829688:0:6892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f400/0x85f5fa77adf3c48a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440238.829703:0:6892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f400/0x85f5fa77adf3c48a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440238.829714:0:6892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f400/0x85f5fa77adf3c48a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440238.829731:0:6892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e000/0x85f5fa77adf3c491 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x7c3c31ce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440238.829739:0:6892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e000/0x85f5fa77adf3c491 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x7c3c31ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440238.829759:0:6892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e000/0x85f5fa77adf3c491 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x7c3c31ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440238.829906:0:6892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fa00/0x85f5fa77adf3c498 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440238.829914:0:6892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fa00/0x85f5fa77adf3c498 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440238.829921:0:6892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fa00/0x85f5fa77adf3c498 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787440238.830820:0:6892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:1.0:1787440238.830834:0:6892:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 337201340454ns, next at 338201337219ns, rc = 0 00010000:00010000:1.0:1787440238.830908:0:6892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fc00/0x85f5fa77adf3c49f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440238.830920:0:6892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fc00/0x85f5fa77adf3c49f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440238.830932:0:6892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fc00/0x85f5fa77adf3c49f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440238.830940:0:6892:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fc00/0x85f5fa77adf3c49f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440238.830947:0:6892:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fc00/0x85f5fa77adf3c49f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440238.830953:0:6892:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fc00/0x85f5fa77adf3c49f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440238.830999:0:6892:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787440238.831025:0:6892:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fa00/0x85f5fa77adf3c498 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440238.831031:0:6892:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fa00/0x85f5fa77adf3c498 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440238.831037:0:6892:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fa00/0x85f5fa77adf3c498 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440238.831043:0:6892:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee07fb9fa00 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:1.0:1787440238.831048:0:6892:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fa00/0x85f5fa77adf3c498 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440238.831056:0:6892:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fa00/0x85f5fa77adf3c498 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440238.831068:0:6892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8ee05132e700) 00010000:00010000:1.0:1787440238.831071:0:6892:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1787440238.831077:0:6892:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fa00/0x85f5fa77adf3c498 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440238.831084:0:6892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fa00/0x85f5fa77adf3c498 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440238.831106:0:6892:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f400/0x85f5fa77adf3c48a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440238.831113:0:6892:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f400/0x85f5fa77adf3c48a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440238.831118:0:6892:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f400/0x85f5fa77adf3c48a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440238.831130:0:6892:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee07fb9f400 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:1.0:1787440238.831133:0:6892:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f400/0x85f5fa77adf3c48a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440238.831139:0:6892:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f400/0x85f5fa77adf3c48a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440238.831148:0:6892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8ee050ca1800) 00010000:00010000:1.0:1787440238.831151:0:6892:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440238.831154:0:6892:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f400/0x85f5fa77adf3c48a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440238.831160:0:6892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f400/0x85f5fa77adf3c48a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787440238.831171:0:6892:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000090483ea0 reply state 00000000b8fa545e transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e000/0x85f5fa77adf3c491 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x7c3c31ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440238.831182:0:6892:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787440238.831290:0:6892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee05d27ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+16:9697:x1874266681266816:12345-192.168.206.58@tcp:36:rm.0 Request processed in 1843us (2157us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1787440238.831299:0:6892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 30 00010000:00010000:2.0:1787440238.831822:0:5837:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787440238.831832:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fc00/0x85f5fa77adf3c49f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440238.831842:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee07fb9fc00 already unused, calling callback (ffffffffc15b52a0) 00010000:00010000:2.0:1787440238.831846:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fc00/0x85f5fa77adf3c49f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440238.831868:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fc00/0x85f5fa77adf3c49f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440238.831879:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8ee05132e700) 00010000:00010000:2.0:1787440238.831882:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787440238.831886:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fc00/0x85f5fa77adf3c49f lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440238.831892:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fc00/0x85f5fa77adf3c49f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440238.831910:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787440238.831912:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787440238.831914:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787440238.841420:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:2.0:1787440238.841585:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681267072 00000100:00100000:2.0:1787440238.841599:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681267072 00000100:00100000:2.0:1787440238.841689:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 5 00000100:00100000:2.0:1787440238.841701:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee047a7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+16:9697:x1874266681267072:12345-192.168.206.58@tcp:35:rm.0 00000100:00100000:2.0:1787440238.842054:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee047a7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+17:9697:x1874266681267072:12345-192.168.206.58@tcp:35:rm.0 Request processed in 354us (649us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1787440238.842069:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 5 00010000:00010000:3.0:1787440238.849707:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e000/0x85f5fa77adf3c491 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x7c3c31ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440238.849732:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e000/0x85f5fa77adf3c491 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x7c3c31ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440238.849767:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e000/0x85f5fa77adf3c491 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x7c3c31ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440238.849773:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee07fb9e000 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:3.0:1787440238.849778:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e000/0x85f5fa77adf3c491 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x7c3c31ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440238.849787:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e000/0x85f5fa77adf3c491 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x7c3c31ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440238.849806:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x7c3c31ce (ffff8ee05132e800) 00010000:00010000:3.0:1787440238.849809:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440238.849814:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e000/0x85f5fa77adf3c491 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x7c3c31ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440238.849819:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e000/0x85f5fa77adf3c491 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x7c3c31ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440238.851437:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:2.0:1787440238.851616:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681267328 00000100:00100000:2.0:1787440238.851629:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681267328 00000100:00100000:2.0:1787440238.851695:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 31 00000100:00100000:2.0:1787440238.851705:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee047a7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+16:9697:x1874266681267328:12345-192.168.206.58@tcp:36:rm.0 00010000:00010000:2.0:1787440238.851782:0:5851:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1787440238.851813:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95800/0x85f5fa77adf3c460 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6213e expref: 16 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440238.851859:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce200/0x85f5fa77adf3c3fe lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6211b expref: 15 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440238.851872:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8ee050ca1800) 00010000:00010000:2.0:1787440238.851899:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfe00/0x85f5fa77adf3c3bf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6210d expref: 14 pid: 6892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440238.851908:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ee050ca1a00) 00010000:00010000:2.0:1787440238.851915:0:5851:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787440238.851945:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86fc00/0x85f5fa77adf3c4a6 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440238.851961:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86fc00/0x85f5fa77adf3c4a6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440238.851972:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86fc00/0x85f5fa77adf3c4a6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440238.851987:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f000/0x85f5fa77adf3c4ad lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440238.851995:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f000/0x85f5fa77adf3c4ad lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440238.852001:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f000/0x85f5fa77adf3c4ad lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440238.852723:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86ee00/0x85f5fa77adf3c4b4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440238.852746:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86ee00/0x85f5fa77adf3c4b4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440238.852754:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86ee00/0x85f5fa77adf3c4b4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787440238.853529:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:2.0:1787440238.853549:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86ee00/0x85f5fa77adf3c4b4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440238.853559:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86ee00/0x85f5fa77adf3c4b4 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440238.853566:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86ee00/0x85f5fa77adf3c4b4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440238.853573:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee07f86ee00 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:2.0:1787440238.853578:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86ee00/0x85f5fa77adf3c4b4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440238.853586:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86ee00/0x85f5fa77adf3c4b4 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440238.853599:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8ee054b3c500) 00010000:00010000:2.0:1787440238.853602:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787440238.853607:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86ee00/0x85f5fa77adf3c4b4 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440238.853614:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86ee00/0x85f5fa77adf3c4b4 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440238.853638:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86fc00/0x85f5fa77adf3c4a6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440238.853651:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86fc00/0x85f5fa77adf3c4a6 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440238.853657:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86fc00/0x85f5fa77adf3c4a6 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440238.853662:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee07f86fc00 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:2.0:1787440238.853666:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86fc00/0x85f5fa77adf3c4a6 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440238.853672:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86fc00/0x85f5fa77adf3c4a6 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440238.853680:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ee054b3c000) 00010000:00010000:2.0:1787440238.853683:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440238.853686:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86fc00/0x85f5fa77adf3c4a6 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440238.853692:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86fc00/0x85f5fa77adf3c4a6 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787440238.853705:0:5851:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007bedf6d3 reply state 00000000acc1b8ad transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f000/0x85f5fa77adf3c4ad lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440238.853714:0:5851:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787440238.853813:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee047a7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+15:9697:x1874266681267328:12345-192.168.206.58@tcp:36:rm.0 Request processed in 2106us (2384us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1787440238.853821:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 31 00010000:00010000:3.0:1787440238.860193:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f000/0x85f5fa77adf3c4ad lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440238.860217:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f000/0x85f5fa77adf3c4ad lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440238.860225:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f000/0x85f5fa77adf3c4ad lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440238.860232:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee07f86f000 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:3.0:1787440238.860238:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f000/0x85f5fa77adf3c4ad lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440238.860271:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f000/0x85f5fa77adf3c4ad lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440238.860296:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8ee054b3cb00) 00010000:00010000:3.0:1787440238.860299:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440238.860304:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f000/0x85f5fa77adf3c4ad lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440238.860311:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f000/0x85f5fa77adf3c4ad lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440239.708832:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787440240.732881:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787440241.728932:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440241.728980:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440241.729008:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440241.729029:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440241.729055:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681267584 00000100:00100000:3.0:1787440241.729064:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681267584 00000100:00100000:3.0:1787440241.729114:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681267840 00000100:00100000:3.0:1787440241.729117:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681267840 00000100:00100000:3.0:1787440241.729140:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 104 00000100:00100000:3.0:1787440241.729149:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee079915500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+14:2360:x1874266681267584:12345-192.168.206.58@tcp:400:kworker.0 00000100:00100000:3.0:1787440241.729221:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee079915500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+14:2360:x1874266681267584:12345-192.168.206.58@tcp:400:kworker.0 Request processed in 73us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440241.729229:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 104 00000100:00100000:3.0:1787440241.729246:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 105 00000100:00100000:3.0:1787440241.729252:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee079916300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fde7b340-91f7-42a0-a1a3-5665ea2691c9+5:2360:x1874266681267840:12345-192.168.206.58@tcp:400:kworker.0 00000100:00100000:3.0:1787440241.729276:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee079916300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fde7b340-91f7-42a0-a1a3-5665ea2691c9+5:2360:x1874266681267840:12345-192.168.206.58@tcp:400:kworker.0 Request processed in 24us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440241.729289:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 105 00000100:00100000:3.0:1787440241.729309:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681267712 00000100:00100000:3.0:1787440241.729312:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681267712 00000100:00100000:3.0:1787440241.729336:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 59 00000100:00100000:3.0:1787440241.729342:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee079917b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+5:2360:x1874266681267712:12345-192.168.206.58@tcp:400:kworker.0 00000100:00100000:3.0:1787440241.729383:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee079917b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+5:2360:x1874266681267712:12345-192.168.206.58@tcp:400:kworker.0 Request processed in 40us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440241.729389:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 59 00000100:00080000:3.0:1787440241.729406:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787440241.729410:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787440241.729576:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681267456 00000100:00100000:2.0:1787440241.729580:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681267456 00000100:00100000:2.0:1787440241.729606:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 251 00000100:00100000:2.0:1787440241.729612:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee05d267c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+13:2360:x1874266681267456:12345-192.168.206.58@tcp:400:kworker.0 00000100:00100000:2.0:1787440241.729646:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee05d267c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+13:2360:x1874266681267456:12345-192.168.206.58@tcp:400:kworker.0 Request processed in 33us (637us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440241.729652:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 251 00010000:00010000:0.0:1787440241.762656:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787440242.076750:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee079915f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874266701223680:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787440242.076838:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440242.076945:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701223680 00000100:00100000:2.0:1787440242.076953:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701223680 00000100:00100000:2.0:1787440242.077011:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787440242.077021:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04a65a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874266701223680:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787440242.077054:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1787440242.078037:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787440242.080639:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04a65a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874266701223680:12345-0@lo:13:osp-pre-0-0.0 Request processed in 3611us (3792us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440242.080653:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:0.0:1787440242.081682:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ee079915f80 x1874266701223680/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787440258 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787440242.081706:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee079915f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874266701223680:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787440242.781412:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787440243.101923:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee05d27df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874266701223936:0@lo:400:kworker.0 00000100:00100000:2.0:1787440243.102002:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440243.102052:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee049044e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874266701224448:0@lo:400:kworker.0 00000100:00100000:2.0:1787440243.102093:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440243.102123:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787440243.102129:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee05d27e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1874266701224064:0@lo:400:kworker.0 00000100:00100000:2.0:1787440243.102151:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440243.102185:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701223936 00000100:00100000:2.0:1787440243.102191:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701223936 00000100:00100000:2.0:1787440243.102228:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701224064 00000100:00100000:2.0:1787440243.102231:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701224064 00000100:00100000:2.0:1787440243.102259:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1787440243.102280:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee049047100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874266701223936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787440243.102330:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee049047100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874266701223936:12345-0@lo:400:kworker.0 Request processed in 52us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440243.102337:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1787440243.102365:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1787440243.102372:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee049047800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1874266701224064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787440243.102398:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee049047800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1874266701224064:12345-0@lo:400:kworker.0 Request processed in 27us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440243.102405:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1787440243.102425:0:9225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701224448 00000100:00100000:2.0:1787440243.102428:0:9225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701224448 00000100:00100000:2.0:1787440243.102475:0:9225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787440243.102481:0:9225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee049045f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1874266701224448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787440243.102532:0:9225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee049045f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1874266701224448:12345-0@lo:400:kworker.0 Request processed in 51us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440243.102538:0:9225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:2.0:1787440243.102559:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787440243.102563:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787440243.102594:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee05d27e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1874266701224064:0@lo:400:kworker.0 00000100:00100000:2.0:1787440243.102603:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee05d27df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874266701223936:0@lo:400:kworker.0 00010000:00080000:2.0:1787440243.102614:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ee049044e00 x1874266701224448/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787440259 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787440243.102624:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee049044e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874266701224448:0@lo:400:kworker.0 00000100:00100000:1.0:1787440243.102992:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee049044000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874266701224192:0@lo:400:kworker.0 00000100:00100000:1.0:1787440243.103025:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440243.103059:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787440243.103065:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee05d27c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:168176ea-29d1-49de-a254-317e90d54802:3311:1874266701223808:0@lo:400:kworker.0 00000100:00100000:1.0:1787440243.103111:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440243.103134:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee049045c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1874266701224320:0@lo:400:kworker.0 00000100:00100000:1.0:1787440243.103156:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440243.103373:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701224192 00000100:00100000:2.0:1787440243.103378:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701224192 00000100:00100000:2.0:1787440243.103422:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787440243.103429:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee047a7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1874266701224192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787440243.103517:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee047a7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1874266701224192:12345-0@lo:400:kworker.0 Request processed in 60us (462us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440243.103524:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787440243.103544:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701223808 00000100:00100000:2.0:1787440243.103547:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701223808 00000100:00100000:2.0:1787440243.103567:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:2.0:1787440243.103573:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee05d266c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:168176ea-29d1-49de-a254-317e90d54802+19:3311:x1874266701223808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787440243.103602:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee05d266c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:168176ea-29d1-49de-a254-317e90d54802+19:3311:x1874266701223808:12345-0@lo:400:kworker.0 Request processed in 30us (491us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440243.103608:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:2.0:1787440243.103634:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701224320 00000100:00100000:2.0:1787440243.103637:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701224320 00000100:00100000:2.0:1787440243.103664:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1787440243.103670:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee047a7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874266701224320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787440243.103698:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee047a7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874266701224320:12345-0@lo:400:kworker.0 Request processed in 29us (541us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440243.103703:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00080000:2.0:1787440243.103719:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787440243.104029:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee05d27c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:168176ea-29d1-49de-a254-317e90d54802:3311:1874266701223808:0@lo:400:kworker.0 00000100:00100000:1.0:1787440243.104041:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee049045c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1874266701224320:0@lo:400:kworker.0 00010000:00080000:1.0:1787440243.104054:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ee049044000 x1874266701224192/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787440259 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787440243.104063:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee049044000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874266701224192:0@lo:400:kworker.0 00000001:02000400:3.0:1787440243.223865:0:11613:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00000004:00080000:3.0:1787440243.615668:0:8008:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 341986172957ns, next at 342986170778ns, rc = 0 00000100:00100000:0.0:1787440243.615753:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787440243.615770:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee079916a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874266701224576:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787440243.615828:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440243.616137:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701224576 00000100:00100000:3.0:1787440243.616144:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701224576 00000100:00100000:3.0:1787440243.616192:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787440243.616201:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04a659500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874266701224576:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787440243.616233:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787440243.616284:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04a659500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874266701224576:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440243.616292:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:0.0:1787440243.617475:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ee079916a00 x1874266701224576/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787440259 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787440243.617524:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee079916a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874266701224576:0@lo:13:osp-pre-1-0.0 00000001:00080000:1.0:1787440243.691206:0:5871:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967301 is committed 00000001:00080000:1.0:1787440243.691223:0:5871:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967306 is committed 00000004:00080000:1.0:1787440243.691227:0:5871:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:1.0:1787440243.691489:0:5871:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000100:00100000:2.0:1787440243.700829:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee04a65bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874266701224704:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1787440243.700915:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440243.709277:0:9225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701224704 00000100:00100000:0.0:1787440243.709294:0:9225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701224704 00000100:00100000:0.0:1787440243.709371:0:9225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787440243.709381:0:9225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee049044e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1874266701224704:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1787440243.709413:0:9225:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:0.0:1787440243.709448:0:9225:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x6a8a2c6e, atime: 0x6a8a2c6e, ctime: 0x6a8a2c6e, blocks: 0x1 00010000:00010000:0.0:1787440243.709456:0:9225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000103223a1/0x85f5fa77adf3c4bb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440243.709472:0:9225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=342s v=(0 0) 00010000:00010000:0.0:1787440243.709477:0:9225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787440243.709482:0:9225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000103223a1/0x85f5fa77adf3c4bb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440243.709516:0:9225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000103223a1/0x85f5fa77adf3c4bb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440243.709527:0:9225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000103223a1/0x85f5fa77adf3c4bb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440243.709534:0:9225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000103223a1/0x85f5fa77adf3c4bb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440243.709552:0:9225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787440243.710161:0:9225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee049044e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3311:x1874266701224704:12345-0@lo:6:osp-syn-1-0.0 Request processed in 780us (9245us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1787440243.710171:0:9225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:0.0:1787440243.710204:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787440243.710211:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000103223a1/0x85f5fa77adf3c4bb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440243.710220:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee04cbcec00 already unused, calling callback (ffffffffc15b52a0) 00010000:00010000:0.0:1787440243.710225:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000103223a1/0x85f5fa77adf3c4bb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440243.710233:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000103223a1/0x85f5fa77adf3c4bb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440243.710249:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000103223a1/0x85f5fa77adf3c4bb lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440243.710256:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000103223a1/0x85f5fa77adf3c4bb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440243.710271:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787440243.710273:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787440243.710274:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1787440243.710557:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8ee04a65bb80/2, rc 0, transno 4294967300 00000100:00100000:2.0:1787440243.710565:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee04a65bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874266701224704:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1787440243.804897:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787440244.213003:0:7640:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00000020:00000080:0.0:1787440244.576954:0:11665:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc91eabf70 20000000:00000080:0.0:1787440244.576971:0:11665:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8ee07f87a800 uarg=0000000000000000 20000000:01000000:0.0:1787440244.577007:0:11665:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1787440244.577013:0:11665:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1787440244.577018:0:11665:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:3.0:1787440244.579297:0:11666:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:0.0:1787440244.579473:0:11665:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:0.0:1787440244.591801:0:11665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:0.0:1787440244.591871:0:11665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:0.0:1787440244.591931:0:11665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:0.0:1787440244.591950:0:11665:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1787440244.591970:0:11665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8ee04cbcf600/0x85f5fa77adf3c4c2 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440244.591988:0:11665:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ee07f86e600/0x85f5fa77adf3c364 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f5fa77adf3c35d expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440244.591996:0:11665:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ee049e94e00/0x85f5fa77adf3c372 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f5fa77adf3c36b expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440244.592002:0:11665:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ee049e95400/0x85f5fa77adf3c380 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f5fa77adf3c379 expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440244.592012:0:11665:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ee049e94c00/0x85f5fa77adf3c387 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc620f8 expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440244.592019:0:11665:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ee07fb9e600/0x85f5fa77adf3c38e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc620ff expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440244.592028:0:11665:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8ee04cbcf600/0x85f5fa77adf3c4c2 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440244.592235:0:11665:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ee07fb9e600/0x85f5fa77adf3c38e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc620ff expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440244.592251:0:11665:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ee07fb9e600/0x85f5fa77adf3c38e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc620ff expref: 12 pid: 5844 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440244.592278:0:11665:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee0804c5f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11665:1874266701224832:192.168.206.58@tcp:104: 00010000:00010000:0.0:1787440244.592783:0:11665:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ee049e94c00/0x85f5fa77adf3c387 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc620f8 expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440244.592794:0:11665:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ee049e94c00/0x85f5fa77adf3c387 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc620f8 expref: 12 pid: 5844 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440244.592803:0:11665:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee0804c6a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11665:1874266701224960:192.168.206.58@tcp:104: 00010000:00010000:0.0:1787440244.592841:0:11665:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ee049e95400/0x85f5fa77adf3c380 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x85f5fa77adf3c379 expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440244.592850:0:11665:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ee049e95400/0x85f5fa77adf3c380 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x85f5fa77adf3c379 expref: 18 pid: 5842 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440244.592866:0:11665:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee0804c4700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11665:1874266701225088:0@lo:104: 00000100:00100000:0.0:1787440244.592907:0:11665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440244.594409:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701225088 00000100:00100000:2.0:1787440244.594431:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701225088 00000100:00100000:2.0:1787440244.594517:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787440244.594527:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee0804c6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:168176ea-29d1-49de-a254-317e90d54802+3:11665:x1874266701225088:12345-0@lo:104: 00010000:00010000:2.0:1787440244.594542:0:5832:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.158@tcp lock: ffff8ee04cbcfc00/0x85f5fa77adf3c379 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x85f5fa77adf3c380 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440244.594618:0:5832:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787440244.594624:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee0804c6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:168176ea-29d1-49de-a254-317e90d54802+3:11665:x1874266701225088:12345-0@lo:104: Request processed in 100us (1718us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440244.594631:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00010000:1.0:1787440244.594983:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787440244.594990:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.158@tcp lock: ffff8ee04cbcfc00/0x85f5fa77adf3c379 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x85f5fa77adf3c380 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440244.594998:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee04cbcfc00 already unused, calling callback (ffffffffc1bd2c20) 10000000:00010000:1.0:1787440244.595002:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.158@tcp lock: ffff8ee04cbcfc00/0x85f5fa77adf3c379 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x85f5fa77adf3c380 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440244.595012:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.158@tcp lock: ffff8ee04cbcfc00/0x85f5fa77adf3c379 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x85f5fa77adf3c380 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787440244.595018:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.158@tcp lock: ffff8ee04cbcfc00/0x85f5fa77adf3c379 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x85f5fa77adf3c380 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787440244.595036:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787440244.595077:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.158@tcp lock: ffff8ee04cbcfc00/0x85f5fa77adf3c379 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x85f5fa77adf3c380 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440244.595084:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787440244.595113:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.158@tcp lock: ffff8ee04cbcfc00/0x85f5fa77adf3c379 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x85f5fa77adf3c380 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440244.595119:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.158@tcp lock: ffff8ee04cbcfc00/0x85f5fa77adf3c379 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x85f5fa77adf3c380 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440244.595132:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787440244.595134:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787440244.595136:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787440244.595163:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee047a7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:168176ea-29d1-49de-a254-317e90d54802:3312:1874266701225216:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787440244.595166:0:11665:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ee049e94e00/0x85f5fa77adf3c372 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x85f5fa77adf3c36b expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440244.595175:0:11665:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ee049e94e00/0x85f5fa77adf3c372 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x85f5fa77adf3c36b expref: 18 pid: 5842 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440244.595185:0:11665:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee047a7e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11665:1874266701225344:0@lo:104: 00000100:00100000:3.0:1787440244.595201:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440244.595206:0:11665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440244.595227:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701225344 00000100:00100000:1.0:1787440244.595232:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701225344 00000100:00100000:3.0:1787440244.595237:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701225216 00000100:00100000:3.0:1787440244.595240:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701225216 00010000:00010000:3.0:1787440244.595255:0:6711:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ee049e95400/0x85f5fa77adf3c380 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x85f5fa77adf3c379 expref: 19 pid: 5842 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440244.595257:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787440244.595264:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee047a7c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:168176ea-29d1-49de-a254-317e90d54802+3:11665:x1874266701225344:12345-0@lo:104: 00010000:00010000:1.0:1787440244.595272:0:5833:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.158@tcp lock: ffff8ee07fb9e400/0x85f5fa77adf3c36b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x85f5fa77adf3c372 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440244.595282:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787440244.595288:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee079914700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:168176ea-29d1-49de-a254-317e90d54802+19:3312:x1874266701225216:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787440244.595309:0:6711:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787440244.595311:0:5833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:3.0:1787440244.595315:0:6711:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ee049e95400/0x85f5fa77adf3c380 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x85f5fa77adf3c379 expref: 19 pid: 5842 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440244.595316:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee047a7c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:168176ea-29d1-49de-a254-317e90d54802+3:11665:x1874266701225344:12345-0@lo:104: Request processed in 52us (108us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440244.595322:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:3.0:1787440244.595324:0:6711:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ee049e95400/0x85f5fa77adf3c380 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x85f5fa77adf3c379 expref: 19 pid: 5842 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440244.595340:0:6711:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787440244.595359:0:11665:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ee07f86e600/0x85f5fa77adf3c364 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x85f5fa77adf3c35d expref: 19 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440244.595368:0:11665:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ee07f86e600/0x85f5fa77adf3c364 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x85f5fa77adf3c35d expref: 19 pid: 5843 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440244.595377:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee079914700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:168176ea-29d1-49de-a254-317e90d54802+19:3312:x1874266701225216:12345-0@lo:103:ldlm_bl.0 Request processed in 89us (175us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440244.595377:0:11665:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee047a7f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11665:1874266701225472:0@lo:104: 00000100:00100000:3.0:1787440244.595384:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787440244.595400:0:11665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440244.595413:0:11665:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee045e47c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787440244.595417:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee047a7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:168176ea-29d1-49de-a254-317e90d54802:3312:1874266701225216:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787440244.595424:0:11665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ee049e95400/0x85f5fa77adf3c380 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x85f5fa77adf3c379 expref: 18 pid: 5842 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440244.595433:0:11665:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee0804c4700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11665:1874266701225088:0@lo:104: 00000100:00100000:1.0:1787440244.595441:0:11665:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee047a7e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11665:1874266701225344:0@lo:104: 00000100:00100000:3.0:1787440244.595444:0:8448:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1787440244.595452:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701225472 00000100:00100000:3.0:1787440244.595455:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701225472 00000100:00100000:3.0:1787440244.595483:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787440244.595518:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee080438050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:168176ea-29d1-49de-a254-317e90d54802+3:11665:x1874266701225472:12345-0@lo:104: 00010000:00010000:3.0:1787440244.595527:0:8448:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.158@tcp lock: ffff8ee07fb9fe00/0x85f5fa77adf3c35d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x85f5fa77adf3c364 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440244.595561:0:8448:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787440244.595565:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee080438050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:168176ea-29d1-49de-a254-317e90d54802+3:11665:x1874266701225472:12345-0@lo:104: Request processed in 77us (165us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440244.595570:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:3.0:1787440244.595606:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787440244.595610:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.158@tcp lock: ffff8ee07fb9e400/0x85f5fa77adf3c36b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x85f5fa77adf3c372 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440244.595616:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee07fb9e400 already unused, calling callback (ffffffffc1bd2c20) 10000000:00010000:3.0:1787440244.595618:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.158@tcp lock: ffff8ee07fb9e400/0x85f5fa77adf3c36b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x85f5fa77adf3c372 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440244.595625:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.158@tcp lock: ffff8ee07fb9e400/0x85f5fa77adf3c36b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x85f5fa77adf3c372 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787440244.595631:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.158@tcp lock: ffff8ee07fb9e400/0x85f5fa77adf3c36b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x85f5fa77adf3c372 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787440244.595636:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787440244.595649:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.158@tcp lock: ffff8ee07fb9e400/0x85f5fa77adf3c36b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x85f5fa77adf3c372 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440244.595654:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787440244.595674:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.158@tcp lock: ffff8ee07fb9e400/0x85f5fa77adf3c36b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x85f5fa77adf3c372 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440244.595680:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.158@tcp lock: ffff8ee07fb9e400/0x85f5fa77adf3c36b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x85f5fa77adf3c372 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440244.595701:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787440244.595704:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.158@tcp lock: ffff8ee07fb9fe00/0x85f5fa77adf3c35d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x85f5fa77adf3c364 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440244.595710:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee07fb9fe00 already unused, calling callback (ffffffffc1bd2c20) 10000000:00010000:3.0:1787440244.595713:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.158@tcp lock: ffff8ee07fb9fe00/0x85f5fa77adf3c35d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x85f5fa77adf3c364 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440244.595726:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.158@tcp lock: ffff8ee07fb9fe00/0x85f5fa77adf3c35d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x85f5fa77adf3c364 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787440244.595732:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.158@tcp lock: ffff8ee07fb9fe00/0x85f5fa77adf3c35d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x85f5fa77adf3c364 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787440244.595737:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787440244.595751:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.158@tcp lock: ffff8ee07fb9fe00/0x85f5fa77adf3c35d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x85f5fa77adf3c364 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440244.595757:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787440244.595763:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.158@tcp lock: ffff8ee07fb9fe00/0x85f5fa77adf3c35d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x85f5fa77adf3c364 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440244.595769:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.158@tcp lock: ffff8ee07fb9fe00/0x85f5fa77adf3c35d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x85f5fa77adf3c364 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440244.595784:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787440244.595786:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787440244.595788:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787440244.595798:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee079914380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:168176ea-29d1-49de-a254-317e90d54802:3310:1874266701225728:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787440244.595821:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440244.595839:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787440244.595845:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee079916680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:168176ea-29d1-49de-a254-317e90d54802:3310:1874266701225600:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787440244.595865:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440244.595887:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701225728 00000100:00100000:3.0:1787440244.595891:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701225728 00010000:00010000:3.0:1787440244.595905:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ee07f86e600/0x85f5fa77adf3c364 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x85f5fa77adf3c35d expref: 18 pid: 5843 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440244.595937:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701225600 00000100:00100000:3.0:1787440244.595940:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701225600 00010000:00010000:3.0:1787440244.595953:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ee049e94e00/0x85f5fa77adf3c372 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x85f5fa77adf3c36b expref: 19 pid: 5842 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440244.595982:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787440244.595988:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee079917800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:168176ea-29d1-49de-a254-317e90d54802+19:3310:x1874266701225728:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787440244.595995:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787440244.595999:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ee07f86e600/0x85f5fa77adf3c364 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x85f5fa77adf3c35d expref: 19 pid: 5843 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440244.596007:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ee07f86e600/0x85f5fa77adf3c364 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x85f5fa77adf3c35d expref: 19 pid: 5843 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440244.596017:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787440244.596056:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee079917800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:168176ea-29d1-49de-a254-317e90d54802+19:3310:x1874266701225728:12345-0@lo:103:ldlm_bl.0 Request processed in 68us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440244.596061:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787440244.596074:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787440244.596080:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee06e7e7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:168176ea-29d1-49de-a254-317e90d54802+18:3310:x1874266701225600:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787440244.596087:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787440244.596091:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ee049e94e00/0x85f5fa77adf3c372 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x85f5fa77adf3c36b expref: 18 pid: 5842 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440244.596099:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ee049e94e00/0x85f5fa77adf3c372 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x85f5fa77adf3c36b expref: 18 pid: 5842 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440244.596109:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ee049e94e00/0x85f5fa77adf3c372 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x85f5fa77adf3c36b expref: 18 pid: 5842 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440244.596125:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787440244.596146:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee06e7e7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:168176ea-29d1-49de-a254-317e90d54802+17:3310:x1874266701225600:12345-0@lo:103:ldlm_bl.0 Request processed in 66us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440244.596153:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787440244.596198:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee079916680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:168176ea-29d1-49de-a254-317e90d54802:3310:1874266701225600:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787440244.596206:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee079914380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:168176ea-29d1-49de-a254-317e90d54802:3310:1874266701225728:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787440244.596235:0:11665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ee07f86e600/0x85f5fa77adf3c364 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x85f5fa77adf3c35d expref: 16 pid: 5843 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440244.596246:0:11665:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee047a7f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11665:1874266701225472:0@lo:104: 00010000:00010000:2.0:1787440244.596661:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787440244.600626:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440244.600660:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440244.600824:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681267968 00000100:00100000:0.0:1787440244.600833:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681267968 00010000:00010000:0.0:1787440244.600870:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ee07fb9e600/0x85f5fa77adf3c38e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc620ff expref: 13 pid: 5844 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440244.600904:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681268096 00000100:00100000:0.0:1787440244.600907:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681268096 00010000:00010000:0.0:1787440244.600919:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ee049e94c00/0x85f5fa77adf3c387 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc620f8 expref: 14 pid: 5844 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440244.600941:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 33 00000100:00100000:0.0:1787440244.600950:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee079914380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+14:2362:x1874266681267968:12345-192.168.206.58@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1787440244.600962:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 34 00000100:00100000:2.0:1787440244.600970:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee079916680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+14:2362:x1874266681268096:12345-192.168.206.58@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787440244.600984:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787440244.600984:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787440244.600990:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ee049e94c00/0x85f5fa77adf3c387 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc620f8 expref: 14 pid: 5844 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440244.600990:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ee07fb9e600/0x85f5fa77adf3c38e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc620ff expref: 14 pid: 5844 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440244.601002:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ee049e94c00/0x85f5fa77adf3c387 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc620f8 expref: 14 pid: 5844 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440244.602678:0:11665:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee0804c5f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11665:1874266701224832:192.168.206.58@tcp:104: 00000100:00100000:1.0:1787440244.602715:0:11665:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee0804c6a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11665:1874266701224960:192.168.206.58@tcp:104: 00010000:00010000:0.0:1787440244.602865:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ee07fb9e600/0x85f5fa77adf3c38e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc620ff expref: 14 pid: 5844 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440244.602888:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ee07fb9e600/0x85f5fa77adf3c38e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc620ff expref: 14 pid: 5844 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440244.602905:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787440244.602985:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee079914380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+13:2362:x1874266681267968:12345-192.168.206.58@tcp:103:ldlm_bl.0 Request processed in 2036us (2368us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440244.602995:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 33 00010000:00010000:2.0:1787440244.603396:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ee049e94c00/0x85f5fa77adf3c387 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc620f8 expref: 12 pid: 5844 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440244.603411:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8ee04cbcf600/0x85f5fa77adf3c4c2 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440244.603419:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ee04cbcf600/0x85f5fa77adf3c4c2 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440244.603437:0:5835:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ee04cbcf600/0x85f5fa77adf3c4c2 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440244.603457:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ee04cbcf600/0x85f5fa77adf3c4c2 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440244.603464:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8ee04cbcf600/0x85f5fa77adf3c4c2 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440244.603469:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8ee04cbcf600/0x85f5fa77adf3c4c2 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440244.603475:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee04cbcf600 already unused, calling callback (ffffffffc15b52a0) 00010000:00010000:2.0:1787440244.603480:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8ee04cbcf600/0x85f5fa77adf3c4c2 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440244.603488:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8ee04cbcf600/0x85f5fa77adf3c4c2 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440244.603512:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8ee04cbcf600/0x85f5fa77adf3c4c2 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440244.603521:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787440244.603557:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee079916680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+11:2362:x1874266681268096:12345-192.168.206.58@tcp:103:ldlm_bl.0 Request processed in 2587us (2896us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440244.603565:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 34 00010000:00010000:1.0:1787440244.607188:0:11665:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8ee04cbcf600/0x85f5fa77adf3c4c2 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440244.607207:0:11665:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8ee04cbcf600/0x85f5fa77adf3c4c2 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440244.607213:0:11665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8ee04cbcf600/0x85f5fa77adf3c4c2 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440244.607235:0:11665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ee04cbcf600/0x85f5fa77adf3c4c2 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440244.829636:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787440245.852896:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787440245.955622:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:1.0:1787440245.958831:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681268224 00000100:00100000:1.0:1787440245.958846:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681268224 00000100:00100000:1.0:1787440245.958925:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 253 00000100:00100000:1.0:1787440245.958935:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee05d264050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+11:5603:x1874266681268224:12345-192.168.206.58@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787440245.958950:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440245.958966:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ee07fb9f400/0x85f5fa77adf3c4c9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fab14535dc6214c expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440245.958991:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ee07fb9f400/0x85f5fa77adf3c4c9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6214c expref: 12 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440245.959001:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ee07fb9f400/0x85f5fa77adf3c4c9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6214c expref: 12 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440245.959010:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee07fb9f400, rc 0) 00000100:00100000:1.0:1787440245.959073:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee05d264050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+12:5603:x1874266681268224:12345-192.168.206.58@tcp:101:ll_cfg_requeue.0 Request processed in 140us (3460us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440245.959080:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 253 00000100:00100000:3.0:1787440245.964643:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:2.0:1787440245.964789:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681268352 00000100:00100000:2.0:1787440245.964798:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681268352 00000100:00100000:2.0:1787440245.964853:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 254 00000100:00100000:2.0:1787440245.964864:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee05d266050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+12:5603:x1874266681268352:12345-192.168.206.58@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787440245.965162:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee05d266050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+12:5603:x1874266681268352:12345-192.168.206.58@tcp:501:ll_cfg_requeue.0 Request processed in 299us (527us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440245.965177:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 254 00000100:00100000:3.0:1787440245.977382:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:2.0:1787440245.980826:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681268480 00000100:00100000:2.0:1787440245.980840:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681268480 00000100:00100000:2.0:1787440245.980914:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 255 00000100:00100000:2.0:1787440245.980925:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee05d266450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+12:5603:x1874266681268480:12345-192.168.206.58@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787440245.981213:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee05d266450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+12:5603:x1874266681268480:12345-192.168.206.58@tcp:503:ll_cfg_requeue.0 Request processed in 288us (3841us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440245.981222:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 255 00000100:00100000:3.0:1787440245.994027:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:2.0:1787440245.994294:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681268608 00000100:00100000:2.0:1787440245.994304:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681268608 00000100:00100000:2.0:1787440245.994439:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 256 00000100:00100000:2.0:1787440245.994458:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee047a42850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+12:9967:x1874266681268608:12345-192.168.206.58@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787440245.994726:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee047a42850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+12:9967:x1874266681268608:12345-192.168.206.58@tcp:502:llog_process_th.0 Request processed in 270us (710us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440245.994734:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 256 00000100:00100000:3.0:1787440245.999260:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:1.0:1787440245.999469:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681268736 00000100:00100000:1.0:1787440245.999478:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681268736 00000100:00100000:1.0:1787440245.999765:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 257 00000100:00100000:1.0:1787440245.999775:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee047a40c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+12:9967:x1874266681268736:12345-192.168.206.58@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787440245.999991:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee047a40c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+12:9967:x1874266681268736:12345-192.168.206.58@tcp:502:llog_process_th.0 Request processed in 217us (738us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440246.000004:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 257 00000100:00100000:3.0:1787440246.006142:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:2.0:1787440246.006803:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681268864 00000100:00100000:2.0:1787440246.006814:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681268864 00000100:00100000:2.0:1787440246.006874:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 258 00000100:00100000:2.0:1787440246.006884:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee047a43450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+12:5603:x1874266681268864:12345-192.168.206.58@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787440246.006900:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440246.006916:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ee07f86ea00/0x85f5fa77adf3c4d0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fab14535dc62153 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440246.006943:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ee07f86ea00/0x85f5fa77adf3c4d0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62153 expref: 13 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440246.006973:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ee07f86ea00/0x85f5fa77adf3c4d0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62153 expref: 13 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440246.006983:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee07f86ea00, rc 0) 00000100:00100000:2.0:1787440246.007059:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee047a43450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+13:5603:x1874266681268864:12345-192.168.206.58@tcp:101:ll_cfg_requeue.0 Request processed in 176us (927us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440246.007066:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 258 00000100:00100000:3.0:1787440246.014991:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:1.0:1787440246.015699:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681268992 00000100:00100000:1.0:1787440246.015715:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681268992 00000100:00100000:1.0:1787440246.015797:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 259 00000100:00100000:1.0:1787440246.015809:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04ca1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+13:5603:x1874266681268992:12345-192.168.206.58@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787440246.016119:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04ca1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+13:5603:x1874266681268992:12345-192.168.206.58@tcp:501:ll_cfg_requeue.0 Request processed in 312us (1140us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440246.016128:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 259 00000100:00100000:1.0:1787440246.026167:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440246.027832:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681269120 00000100:00100000:0.0:1787440246.027853:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681269120 00000100:00100000:0.0:1787440246.027940:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 260 00000100:00100000:0.0:1787440246.027952:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04ca1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+13:5603:x1874266681269120:12345-192.168.206.58@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787440246.028252:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04ca1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+13:5603:x1874266681269120:12345-192.168.206.58@tcp:503:ll_cfg_requeue.0 Request processed in 302us (2395us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440246.028261:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 260 00000100:00100000:3.0:1787440246.031682:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:2.0:1787440246.034575:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681269248 00000100:00100000:2.0:1787440246.034597:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681269248 00000100:00100000:2.0:1787440246.034684:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 261 00000100:00100000:2.0:1787440246.034695:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04ca1dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+13:9970:x1874266681269248:12345-192.168.206.58@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787440246.035027:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04ca1dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+13:9970:x1874266681269248:12345-192.168.206.58@tcp:502:llog_process_th.0 Request processed in 324us (3349us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440246.035036:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 261 00000100:00100000:2.0:1787440246.041230:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440246.041546:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681269376 00000100:00100000:3.0:1787440246.041558:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681269376 00000100:00100000:3.0:1787440246.041628:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 262 00000100:00100000:3.0:1787440246.041640:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04ca1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+13:9970:x1874266681269376:12345-192.168.206.58@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787440246.041957:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04ca1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+13:9970:x1874266681269376:12345-192.168.206.58@tcp:502:llog_process_th.0 Request processed in 318us (739us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440246.041966:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 262 10000000:01000000:2.0:1787440246.623013:0:5847:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787440246.623023:0:5847:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8ee06db91000 from 7 10000000:01000000:2.0:1787440246.623029:0:5847:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787440246.623098:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.158@tcp lock: ffff8ee07f86e800/0x85f5fa77adf3c4d7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440246.623114:0:5847:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.158@tcp lock: ffff8ee07f86e800/0x85f5fa77adf3c4d7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440246.623129:0:5847:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.158@tcp lock: ffff8ee07f86e800/0x85f5fa77adf3c4d7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440246.623182:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee049046680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:168176ea-29d1-49de-a254-317e90d54802:5847:1874266701225856:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787440246.623278:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440246.623427:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee080ca4f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787440246.629913:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701225856 00000100:00100000:0.0:1787440246.629936:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701225856 00000100:00100000:0.0:1787440246.630110:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1787440246.630124:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04ca1c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:168176ea-29d1-49de-a254-317e90d54802+16:5847:x1874266701225856:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787440246.630147:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440246.630170:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ee04cbce400/0x85f5fa77adf3c4de lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x85f5fa77adf3c4d7 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440246.630225:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ee04cbce400/0x85f5fa77adf3c4de lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x85f5fa77adf3c4d7 expref: 17 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440246.630255:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ee04cbce400/0x85f5fa77adf3c4de lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f5fa77adf3c4d7 expref: 17 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440246.630266:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee04cbce400, rc 0) 00000100:00100000:0.0:1787440246.630396:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04ca1c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:168176ea-29d1-49de-a254-317e90d54802+17:5847:x1874266701225856:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 275us (7117us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440246.630404:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1787440246.630550:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee049046680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:168176ea-29d1-49de-a254-317e90d54802:5847:1874266701225856:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787440246.630574:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.158@tcp lock: ffff8ee07f86e800/0x85f5fa77adf3c4d7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3c4de expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440246.630585:0:5847:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.158@tcp lock: ffff8ee07f86e800/0x85f5fa77adf3c4d7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x85f5fa77adf3c4de expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440246.630679:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee049046680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:168176ea-29d1-49de-a254-317e90d54802:5847:1874266701225984:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787440246.630721:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440246.648601:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701225984 00000100:00100000:3.0:1787440246.648886:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701225984 00000100:00100000:0.0:1787440246.649403:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1787440246.649421:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04ca1e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:168176ea-29d1-49de-a254-317e90d54802+17:5847:x1874266701225984:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787440246.649997:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04ca1e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:168176ea-29d1-49de-a254-317e90d54802+17:5847:x1874266701225984:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 581us (19275us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440246.650007:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1787440246.650533:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee080ca4f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787440246.650565:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee049046680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:168176ea-29d1-49de-a254-317e90d54802:5847:1874266701225984:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787440246.650708:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee049046680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:168176ea-29d1-49de-a254-317e90d54802:5847:1874266701226112:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787440246.650839:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440246.650919:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee080ca4f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787440246.656298:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701226112 00000100:00100000:1.0:1787440246.656316:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701226112 00000100:00100000:1.0:1787440246.657642:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1787440246.657666:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04ca1f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:168176ea-29d1-49de-a254-317e90d54802+17:5847:x1874266701226112:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787440246.658119:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04ca1f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:168176ea-29d1-49de-a254-317e90d54802+17:5847:x1874266701226112:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 463us (7277us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440246.658127:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1787440246.661674:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee049046680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:168176ea-29d1-49de-a254-317e90d54802:5847:1874266701226112:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787440246.665650:0:11678:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee0804c4380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:168176ea-29d1-49de-a254-317e90d54802:11678:1874266701226240:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787440246.665912:0:11678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440246.665963:0:11678:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee045e47780 going to sleep for 11 seconds 00000100:00100000:1.0:1787440246.666715:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701226240 00000100:00100000:1.0:1787440246.666728:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701226240 00000100:00100000:1.0:1787440246.666889:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1787440246.666901:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04ca1d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:168176ea-29d1-49de-a254-317e90d54802+17:11678:x1874266701226240:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787440246.667196:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04ca1d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:168176ea-29d1-49de-a254-317e90d54802+17:11678:x1874266701226240:12345-0@lo:502:llog_process_th.0 Request processed in 297us (1283us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440246.667204:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1787440246.667327:0:11678:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee0804c4380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:168176ea-29d1-49de-a254-317e90d54802:11678:1874266701226240:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787440246.667375:0:11678:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787440246.667387:0:11678:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787440246.667389:0:11678:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787440246.667397:0:11678:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8ee06db91000 00000020:00000080:0.0:1787440246.667400:0:11678:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787440246.667528:0:11678:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee0804c4380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:168176ea-29d1-49de-a254-317e90d54802:11678:1874266701226368:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787440246.667581:0:11678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440246.667625:0:11678:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee045e47780 going to sleep for 11 seconds 00000100:00100000:3.0:1787440246.670484:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701226368 00000100:00100000:3.0:1787440246.670518:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701226368 00000100:00100000:3.0:1787440246.670586:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1787440246.670597:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04ca1e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:168176ea-29d1-49de-a254-317e90d54802+17:11678:x1874266701226368:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787440246.670941:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04ca1e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:168176ea-29d1-49de-a254-317e90d54802+17:11678:x1874266701226368:12345-0@lo:502:llog_process_th.0 Request processed in 344us (3357us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440246.670951:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1787440246.673632:0:11678:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee0804c4380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:168176ea-29d1-49de-a254-317e90d54802:11678:1874266701226368:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787440246.673698:0:11678:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787440246.673709:0:11678:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787440246.673712:0:11678:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1787440246.673719:0:11678:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1787440246.675711:0:5847:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:2.0:1787440246.675747:0:5847:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.158@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787440246.675914:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.158@tcp lock: ffff8ee07f86e800/0x85f5fa77adf3c4d7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3c4de expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440246.675929:0:5847:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.158@tcp lock: ffff8ee07f86e800/0x85f5fa77adf3c4d7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3c4de expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787440246.675947:0:5847:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787440246.675950:0:5847:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8ee045e4e000 from 7 10000000:01000000:2.0:1787440246.675954:0:5847:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787440246.675996:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.158@tcp lock: ffff8ee07f86f200/0x85f5fa77adf3c4e5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440246.676005:0:5847:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.158@tcp lock: ffff8ee07f86f200/0x85f5fa77adf3c4e5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440246.676017:0:5847:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.158@tcp lock: ffff8ee07f86f200/0x85f5fa77adf3c4e5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440246.676047:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee049046680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:168176ea-29d1-49de-a254-317e90d54802:5847:1874266701226496:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787440246.676128:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440246.676188:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee041377240 going to sleep for 11 seconds 00000100:00100000:1.0:1787440246.676274:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701226496 00000100:00100000:1.0:1787440246.676282:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701226496 00000100:00100000:1.0:1787440246.676354:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1787440246.676364:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04ca1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:168176ea-29d1-49de-a254-317e90d54802+17:5847:x1874266701226496:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787440246.676389:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440246.676411:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ee07fb9e200/0x85f5fa77adf3c4ec lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x85f5fa77adf3c4e5 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440246.676438:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ee07fb9e200/0x85f5fa77adf3c4ec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x85f5fa77adf3c4e5 expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440246.676449:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ee07fb9e200/0x85f5fa77adf3c4ec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f5fa77adf3c4e5 expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440246.676458:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee07fb9e200, rc 0) 00000100:00100000:1.0:1787440246.676523:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04ca1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:168176ea-29d1-49de-a254-317e90d54802+18:5847:x1874266701226496:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 160us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440246.676530:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1787440246.676571:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee049046680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:168176ea-29d1-49de-a254-317e90d54802:5847:1874266701226496:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787440246.676586:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.158@tcp lock: ffff8ee07f86f200/0x85f5fa77adf3c4e5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3c4ec expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440246.676595:0:5847:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.158@tcp lock: ffff8ee07f86f200/0x85f5fa77adf3c4e5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x85f5fa77adf3c4ec expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440246.676665:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee047a7f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:168176ea-29d1-49de-a254-317e90d54802:5847:1874266701226624:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787440246.676698:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440246.676724:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee080569a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787440246.676743:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701226624 00000100:00100000:1.0:1787440246.676748:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701226624 00000100:00100000:1.0:1787440246.676913:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1787440246.676920:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04ca1f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:168176ea-29d1-49de-a254-317e90d54802+18:5847:x1874266701226624:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787440246.677203:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04ca1f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:168176ea-29d1-49de-a254-317e90d54802+18:5847:x1874266701226624:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 283us (504us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440246.677211:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1787440246.677236:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee047a7f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:168176ea-29d1-49de-a254-317e90d54802:5847:1874266701226624:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787440246.677266:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee047a7f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:168176ea-29d1-49de-a254-317e90d54802:5847:1874266701226752:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787440246.677305:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440246.677314:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee04b16fc00 going to sleep for 11 seconds 00000100:00100000:1.0:1787440246.677330:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701226752 00000100:00100000:1.0:1787440246.677332:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701226752 00000100:00100000:1.0:1787440246.677361:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1787440246.677367:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04ca1f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:168176ea-29d1-49de-a254-317e90d54802+18:5847:x1874266701226752:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787440246.677540:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04ca1f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:168176ea-29d1-49de-a254-317e90d54802+18:5847:x1874266701226752:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 173us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440246.677549:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1787440246.677580:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee047a7f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:168176ea-29d1-49de-a254-317e90d54802:5847:1874266701226752:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787440246.686112:0:11681:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee047a7f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:168176ea-29d1-49de-a254-317e90d54802:11681:1874266701226880:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787440246.686219:0:11681:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440246.686280:0:11681:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee0799f2a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787440246.686608:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701226880 00000100:00100000:1.0:1787440246.686618:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701226880 00000100:00100000:1.0:1787440246.686848:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:1.0:1787440246.686859:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04ca1d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:168176ea-29d1-49de-a254-317e90d54802+18:11681:x1874266701226880:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787440246.687141:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04ca1d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:168176ea-29d1-49de-a254-317e90d54802+18:11681:x1874266701226880:12345-0@lo:502:llog_process_th.0 Request processed in 284us (923us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440246.687157:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:1.0:1787440246.687227:0:11681:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee047a7f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:168176ea-29d1-49de-a254-317e90d54802:11681:1874266701226880:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787440246.687267:0:11681:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787440246.687281:0:11681:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787440246.687283:0:11681:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787440246.687291:0:11681:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8ee045e4e000 00000020:00000080:1.0:1787440246.687293:0:11681:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000040:00080000:0.0:1787440246.694387:0:11682:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1787440246.695364:0:11681:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee047a7f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:168176ea-29d1-49de-a254-317e90d54802:11681:1874266701227008:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787440246.695477:0:11681:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440246.695565:0:11681:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee0799f2a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787440246.696346:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701227008 00000100:00100000:3.0:1787440246.696358:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701227008 00000100:00100000:3.0:1787440246.696431:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:3.0:1787440246.696442:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04ca1d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:168176ea-29d1-49de-a254-317e90d54802+18:11681:x1874266701227008:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787440246.697062:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04ca1d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:168176ea-29d1-49de-a254-317e90d54802+18:11681:x1874266701227008:12345-0@lo:502:llog_process_th.0 Request processed in 618us (1582us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440246.697072:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:2.0:1787440246.697565:0:11681:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee047a7f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:168176ea-29d1-49de-a254-317e90d54802:11681:1874266701227008:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787440246.697625:0:11681:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787440246.697637:0:11681:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787440246.697640:0:11681:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1787440246.697646:0:11681:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1787440246.698098:0:5847:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1787440246.698122:0:5847:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.158@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787440246.698136:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.158@tcp lock: ffff8ee07f86f200/0x85f5fa77adf3c4e5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3c4ec expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440246.698149:0:5847:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.158@tcp lock: ffff8ee07f86f200/0x85f5fa77adf3c4e5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3c4ec expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787440246.698161:0:5847:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787440246.698164:0:5847:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8ee045f41000 from 7 10000000:01000000:0.0:1787440246.698168:0:5847:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787440246.698234:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.158@tcp lock: ffff8ee04cbcea00/0x85f5fa77adf3c4f3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440246.698243:0:5847:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.158@tcp lock: ffff8ee04cbcea00/0x85f5fa77adf3c4f3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440246.698255:0:5847:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.158@tcp lock: ffff8ee04cbcea00/0x85f5fa77adf3c4f3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440246.698281:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee0804c4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:168176ea-29d1-49de-a254-317e90d54802:5847:1874266701227136:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787440246.698365:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440246.698525:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee045e47540 going to sleep for 11 seconds 00000100:00100000:1.0:1787440246.698613:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701227136 00000100:00100000:1.0:1787440246.698620:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701227136 00000100:00100000:1.0:1787440246.698681:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:1.0:1787440246.698691:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04ca1c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:168176ea-29d1-49de-a254-317e90d54802+18:5847:x1874266701227136:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787440246.698705:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440246.698721:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ee07fb9fc00/0x85f5fa77adf3c4fa lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x85f5fa77adf3c4f3 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440246.698748:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ee07fb9fc00/0x85f5fa77adf3c4fa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x85f5fa77adf3c4f3 expref: 19 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440246.698954:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ee07fb9fc00/0x85f5fa77adf3c4fa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f5fa77adf3c4f3 expref: 19 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440246.698967:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee07fb9fc00, rc 0) 00000100:00100000:1.0:1787440246.699026:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04ca1c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:168176ea-29d1-49de-a254-317e90d54802+19:5847:x1874266701227136:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 337us (661us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440246.699045:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:0.0:1787440246.699934:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee0804c4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:168176ea-29d1-49de-a254-317e90d54802:5847:1874266701227136:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787440246.699962:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.158@tcp lock: ffff8ee04cbcea00/0x85f5fa77adf3c4f3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3c4fa expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440246.699974:0:5847:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.158@tcp lock: ffff8ee04cbcea00/0x85f5fa77adf3c4f3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x85f5fa77adf3c4fa expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440246.700059:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee0804c4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:168176ea-29d1-49de-a254-317e90d54802:5847:1874266701227264:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787440246.700110:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440246.700156:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee045e47540 going to sleep for 11 seconds 00000100:00100000:2.0:1787440246.700986:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701227264 00000100:00100000:2.0:1787440246.700997:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701227264 00000100:00100000:2.0:1787440246.701058:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1787440246.701068:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04ca1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:168176ea-29d1-49de-a254-317e90d54802+19:5847:x1874266701227264:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787440246.703684:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04ca1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:168176ea-29d1-49de-a254-317e90d54802+19:5847:x1874266701227264:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 2608us (3563us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440246.703700:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:1.0:1787440246.715949:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee0804c4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:168176ea-29d1-49de-a254-317e90d54802:5847:1874266701227264:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787440246.716038:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee047a7e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:168176ea-29d1-49de-a254-317e90d54802:5847:1874266701227392:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787440246.716136:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440246.716239:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee0799f2240 going to sleep for 11 seconds 00000100:00100000:2.0:1787440246.721071:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701227392 00000100:00100000:2.0:1787440246.721089:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701227392 00000100:00100000:2.0:1787440246.721240:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:2.0:1787440246.721252:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04a69a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:168176ea-29d1-49de-a254-317e90d54802+19:5847:x1874266701227392:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787440246.721626:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04a69a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:168176ea-29d1-49de-a254-317e90d54802+19:5847:x1874266701227392:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 375us (5489us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440246.721634:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:1.0:1787440246.725015:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee047a7e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:168176ea-29d1-49de-a254-317e90d54802:5847:1874266701227392:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787440246.725568:0:11684:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee047a7e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:168176ea-29d1-49de-a254-317e90d54802:11684:1874266701227520:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787440246.725690:0:11684:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440246.725736:0:11684:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee0799f2c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787440246.725940:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701227520 00000100:00100000:3.0:1787440246.725950:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701227520 00000100:00100000:3.0:1787440246.726004:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:3.0:1787440246.726017:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04a69b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:168176ea-29d1-49de-a254-317e90d54802+19:11684:x1874266701227520:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787440246.726294:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04a69b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:168176ea-29d1-49de-a254-317e90d54802+19:11684:x1874266701227520:12345-0@lo:502:llog_process_th.0 Request processed in 278us (603us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440246.726303:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:1.0:1787440246.726437:0:11684:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee047a7e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:168176ea-29d1-49de-a254-317e90d54802:11684:1874266701227520:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787440246.726467:0:11684:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787440246.726478:0:11684:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787440246.726480:0:11684:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787440246.726489:0:11684:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8ee045f41000 00000020:00000080:1.0:1787440246.726519:0:11684:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787440246.726606:0:11684:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee047a7e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:168176ea-29d1-49de-a254-317e90d54802:11684:1874266701227648:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787440246.726645:0:11684:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440246.726744:0:11684:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee0799f2c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787440246.727437:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701227648 00000100:00100000:2.0:1787440246.727448:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701227648 00000100:00100000:2.0:1787440246.727528:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:2.0:1787440246.727538:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04a699850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:168176ea-29d1-49de-a254-317e90d54802+19:11684:x1874266701227648:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787440246.728021:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04a699850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:168176ea-29d1-49de-a254-317e90d54802+19:11684:x1874266701227648:12345-0@lo:502:llog_process_th.0 Request processed in 483us (1373us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440246.728030:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:1.0:1787440246.730220:0:11684:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee047a7e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:168176ea-29d1-49de-a254-317e90d54802:11684:1874266701227648:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787440246.730284:0:11684:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787440246.730296:0:11684:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787440246.730298:0:11684:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1787440246.730303:0:11684:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1787440246.730914:0:5847:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1787440246.730943:0:5847:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.158@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787440246.730958:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.158@tcp lock: ffff8ee04cbcea00/0x85f5fa77adf3c4f3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3c4fa expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440246.730972:0:5847:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.158@tcp lock: ffff8ee04cbcea00/0x85f5fa77adf3c4f3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3c4fa expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440246.843487:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:1.0:1787440246.843580:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:1.0:1787440246.843620:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:1.0:1787440246.843645:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:2.0:1787440246.843699:0:6892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681269632 00000100:00100000:2.0:1787440246.843709:0:6892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681269632 00000100:00100000:0.0:1787440246.843727:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681269504 00000100:00100000:0.0:1787440246.843733:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681269504 00000100:00100000:0.0:1787440246.843780:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 278 00000100:00100000:0.0:1787440246.843789:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04a69a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+13:2360:x1874266681269504:12345-192.168.206.58@tcp:400:kworker.0 00000100:00100000:2.0:1787440246.843836:0:6892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681269888 00000100:00100000:2.0:1787440246.843841:0:6892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681269888 00000100:00100000:0.0:1787440246.843874:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04a69a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+13:2360:x1874266681269504:12345-192.168.206.58@tcp:400:kworker.0 Request processed in 84us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440246.843883:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 278 00000100:00100000:0.0:1787440246.843935:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681269760 00000100:00100000:0.0:1787440246.843940:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681269760 00000100:00100000:0.0:1787440246.843974:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 62 00000100:00100000:2.0:1787440246.843980:0:6892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 109 00000100:00100000:0.0:1787440246.843985:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee047a7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+5:2360:x1874266681269760:12345-192.168.206.58@tcp:400:kworker.0 00000100:00100000:2.0:1787440246.843995:0:6892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee047a7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+5:2360:x1874266681269632:12345-192.168.206.58@tcp:400:kworker.0 00000100:00100000:0.0:1787440246.844021:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee047a7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+5:2360:x1874266681269760:12345-192.168.206.58@tcp:400:kworker.0 Request processed in 39us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440246.844030:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 62 00000100:00100000:2.0:1787440246.844035:0:6892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee047a7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+5:2360:x1874266681269632:12345-192.168.206.58@tcp:400:kworker.0 Request processed in 43us (556us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440246.844045:0:6892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 109 00000100:00100000:2.0:1787440246.844062:0:6892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 110 00000100:00100000:2.0:1787440246.844069:0:6892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee047a7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fde7b340-91f7-42a0-a1a3-5665ea2691c9+5:2360:x1874266681269888:12345-192.168.206.58@tcp:400:kworker.0 00000100:00100000:2.0:1787440246.844088:0:6892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee047a7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fde7b340-91f7-42a0-a1a3-5665ea2691c9+5:2360:x1874266681269888:12345-192.168.206.58@tcp:400:kworker.0 Request processed in 21us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440246.844101:0:6892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 110 00000100:00080000:1.0:1787440246.844232:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787440246.844237:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787440246.876696:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787440247.197947:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787440247.197971:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee079914700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1874266701227776:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787440247.198047:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440247.198600:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701227776 00000100:00100000:3.0:1787440247.198610:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701227776 00000100:00100000:3.0:1787440247.198676:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787440247.198686:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee047a7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874266701227776:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787440247.198723:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787440247.198787:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee047a7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874266701227776:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (740us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440247.198795:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:0.0:1787440247.198923:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ee079914700 x1874266701227776/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787440263 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787440247.198942:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee079914700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1874266701227776:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787440247.199477:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:0.0:1787440247.709193:0:11682:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787440247.901399:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787440248.222261:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee079917800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:168176ea-29d1-49de-a254-317e90d54802:3312:1874266701227904:0@lo:400:kworker.0 00000100:00100000:3.0:1787440248.222302:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee079916d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3310:1874266701228160:0@lo:400:kworker.0 00000100:00100000:1.0:1787440248.222377:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee079914000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874266701228032:0@lo:400:kworker.0 00000100:00100000:2.0:1787440248.222425:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee079914700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874266701228288:0@lo:400:kworker.0 00000100:00100000:3.0:1787440248.225440:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440248.225560:0:6892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701228160 00000100:00100000:3.0:1787440248.225568:0:6892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701228160 00000100:00100000:3.0:1787440248.225625:0:6892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1787440248.225634:0:6892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee079917480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874266701228160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440248.225690:0:6892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee079917480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874266701228160:12345-0@lo:400:kworker.0 Request processed in 58us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440248.225698:0:6892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1787440248.225741:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee079916d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3310:1874266701228160:0@lo:400:kworker.0 00000100:00080000:3.0:1787440248.225771:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787440248.226167:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440248.226207:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee079915f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874266701228544:0@lo:400:kworker.0 00000100:00100000:1.0:1787440248.226239:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440248.226299:0:9225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701228544 00000100:00100000:1.0:1787440248.226304:0:9225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701228544 00000100:00100000:1.0:1787440248.226357:0:9225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787440248.226365:0:9225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee047a7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1874266701228544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440248.226406:0:9225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee047a7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1874266701228544:12345-0@lo:400:kworker.0 Request processed in 42us (165us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440248.226413:0:9225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787440248.226442:0:3309:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:1.0:1787440248.226447:0:3309:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8ee04a65bb80, transno 4294967300 00000100:00100000:1.0:1787440248.226458:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee079915f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874266701228544:0@lo:400:kworker.0 00000100:00100000:3.0:1787440248.228335:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701228032 00000100:00100000:3.0:1787440248.228349:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701228032 00000100:00100000:3.0:1787440248.228408:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1787440248.228417:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee047a7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874266701228032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440248.228539:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee047a7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874266701228032:12345-0@lo:400:kworker.0 Request processed in 123us (2372us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440248.228546:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00080000:3.0:1787440248.228572:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787440248.230518:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440248.230595:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee079916a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3312:1874266701228416:0@lo:400:kworker.0 00000100:00100000:0.0:1787440248.230650:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440248.230731:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee079914000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874266701228032:0@lo:400:kworker.0 00000100:00100000:3.0:1787440248.231289:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701227904 00000100:00100000:3.0:1787440248.231297:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701227904 00000100:00100000:3.0:1787440248.231356:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:3.0:1787440248.231365:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04a698c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:168176ea-29d1-49de-a254-317e90d54802+19:3312:x1874266701227904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440248.231425:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04a698c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:168176ea-29d1-49de-a254-317e90d54802+19:3312:x1874266701227904:12345-0@lo:400:kworker.0 Request processed in 61us (914us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440248.231433:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:1.0:1787440248.231461:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee079917800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:168176ea-29d1-49de-a254-317e90d54802:3312:1874266701227904:0@lo:400:kworker.0 00000100:00100000:3.0:1787440248.231477:0:6892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701228416 00000100:00100000:3.0:1787440248.231482:0:6892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701228416 00000100:00100000:3.0:1787440248.231556:0:6892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1787440248.231563:0:6892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee0804c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874266701228416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440248.231600:0:6892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee0804c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874266701228416:12345-0@lo:400:kworker.0 Request processed in 37us (950us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440248.231606:0:6892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1787440248.231978:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee079916a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3312:1874266701228416:0@lo:400:kworker.0 00000100:00080000:0.0:1787440248.232116:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787440248.236147:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440248.237160:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701228288 00000100:00100000:0.0:1787440248.237171:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701228288 00000100:00100000:0.0:1787440248.237305:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787440248.237315:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee049044000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1874266701228288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787440248.237406:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee049044000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1874266701228288:12345-0@lo:400:kworker.0 Request processed in 92us (1267us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440248.237413:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00010000:00080000:2.0:1787440248.237571:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ee079914700 x1874266701228288/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787440264 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787440248.237586:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee079914700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874266701228288:0@lo:400:kworker.0 00000100:00100000:0.0:1787440248.732793:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee079916d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1874266701228672:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787440248.732880:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440248.733486:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701228672 00000100:00100000:3.0:1787440248.733515:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701228672 00000100:00100000:3.0:1787440248.733566:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787440248.733576:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee0804c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874266701228672:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787440248.733608:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787440248.733666:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee0804c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874266701228672:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (792us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440248.733673:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787440248.733763:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee079916d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1874266701228672:0@lo:13:osp-pre-1-0.0 00000004:00080000:2.0:1787440248.812855:0:5871:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00010000:00010000:3.0:1787440248.924683:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787440249.948934:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787440250.973179:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787440251.961623:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440251.961675:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440251.961707:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440251.961738:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440251.961863:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681270144 00000100:00100000:3.0:1787440251.961873:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681270144 00000100:00100000:3.0:1787440251.961934:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681270400 00000100:00100000:3.0:1787440251.961937:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681270400 00000100:00100000:3.0:1787440251.961964:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 114 00000100:00100000:3.0:1787440251.961974:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee0804c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+5:2361:x1874266681270144:12345-192.168.206.58@tcp:400:kworker.0 00000100:00100000:3.0:1787440251.962047:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee0804c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+5:2361:x1874266681270144:12345-192.168.206.58@tcp:400:kworker.0 Request processed in 74us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440251.962056:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 114 00000100:00100000:3.0:1787440251.962073:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 115 00000100:00100000:3.0:1787440251.962080:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee0804c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fde7b340-91f7-42a0-a1a3-5665ea2691c9+5:2361:x1874266681270400:12345-192.168.206.58@tcp:400:kworker.0 00000100:00100000:3.0:1787440251.962105:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee0804c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fde7b340-91f7-42a0-a1a3-5665ea2691c9+5:2361:x1874266681270400:12345-192.168.206.58@tcp:400:kworker.0 Request processed in 26us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440251.962111:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 115 00000100:00100000:2.0:1787440251.962343:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681270016 00000100:00100000:2.0:1787440251.962348:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681270016 00000100:00100000:2.0:1787440251.962384:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 280 00000100:00100000:2.0:1787440251.962392:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04a69b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+13:2361:x1874266681270016:12345-192.168.206.58@tcp:400:kworker.0 00000100:00100000:2.0:1787440251.962427:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04a69b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+13:2361:x1874266681270016:12345-192.168.206.58@tcp:400:kworker.0 Request processed in 36us (813us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440251.962433:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 280 00000100:00100000:1.0:1787440251.962884:0:9225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681270272 00000100:00100000:1.0:1787440251.962901:0:9225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681270272 00000100:00100000:1.0:1787440251.962959:0:9225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 65 00000100:00100000:1.0:1787440251.962967:0:9225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee0804c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+5:2361:x1874266681270272:12345-192.168.206.58@tcp:400:kworker.0 00000100:00100000:1.0:1787440251.963008:0:9225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee0804c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+5:2361:x1874266681270272:12345-192.168.206.58@tcp:400:kworker.0 Request processed in 43us (1333us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440251.963016:0:9225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 65 00000100:00080000:0.0:1787440251.963261:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787440251.963272:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787440252.005936:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787440252.317775:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee079915c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874266701228800:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787440252.318356:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440252.319213:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701228800 00000100:00100000:3.0:1787440252.319222:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701228800 00000100:00100000:3.0:1787440252.319286:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787440252.319296:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee049045c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874266701228800:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787440252.319340:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787440252.319410:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee049045c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874266701228800:12345-0@lo:13:osp-pre-0-0.0 Request processed in 116us (1056us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440252.319418:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:0.0:1787440252.319516:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787440252.319599:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ee079915c00 x1874266701228800/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787440268 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787440252.319619:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee079915c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874266701228800:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787440253.020700:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787440253.341326:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee049046680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:168176ea-29d1-49de-a254-317e90d54802:3312:1874266701228928:0@lo:400:kworker.0 00000100:00100000:1.0:1787440253.341402:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440253.341739:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee05d27e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874266701229312:0@lo:400:kworker.0 00000100:00100000:0.0:1787440253.341776:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440253.341808:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701229312 00000100:00100000:0.0:1787440253.341816:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701229312 00000100:00100000:0.0:1787440253.341860:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787440253.341869:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee0804c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1874266701229312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787440253.341921:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee0804c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1874266701229312:12345-0@lo:400:kworker.0 Request processed in 53us (144us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440253.341928:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00010000:00080000:0.0:1787440253.341965:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ee05d27e680 x1874266701229312/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787440269 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787440253.341980:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee05d27e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874266701229312:0@lo:400:kworker.0 00000100:00100000:3.0:1787440253.344121:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701228928 00000100:00100000:3.0:1787440253.344133:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701228928 00000100:00100000:3.0:1787440253.344199:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:3.0:1787440253.344209:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04a69b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:168176ea-29d1-49de-a254-317e90d54802+19:3312:x1874266701228928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787440253.344360:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee05d27c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874266701229056:0@lo:400:kworker.0 00000100:00100000:0.0:1787440253.344402:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440253.344438:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787440253.344445:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee05d27df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1874266701229184:0@lo:400:kworker.0 00000100:00100000:0.0:1787440253.344467:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440253.344537:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701229056 00000100:00100000:0.0:1787440253.344541:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701229056 00000100:00100000:0.0:1787440253.344566:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701229184 00000100:00100000:0.0:1787440253.344569:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701229184 00000100:00100000:0.0:1787440253.344592:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1787440253.344598:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee0804c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874266701229056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787440253.344634:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee0804c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874266701229056:12345-0@lo:400:kworker.0 Request processed in 36us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440253.344657:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1787440253.344673:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1787440253.344678:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee0804c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1874266701229184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787440253.344706:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee0804c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1874266701229184:12345-0@lo:400:kworker.0 Request processed in 28us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440253.344712:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00080000:0.0:1787440253.344727:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787440253.344754:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee05d27df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1874266701229184:0@lo:400:kworker.0 00000100:00100000:0.0:1787440253.344765:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee05d27c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874266701229056:0@lo:400:kworker.0 00000100:00100000:2.0:1787440253.348344:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787440253.348364:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee05d27df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1874266701229568:0@lo:400:kworker.0 00000100:00100000:2.0:1787440253.348432:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440253.348550:0:9225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701229568 00000100:00100000:2.0:1787440253.348558:0:9225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701229568 00000100:00100000:2.0:1787440253.348611:0:9225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787440253.348634:0:9225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee05d27e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1874266701229568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787440253.348684:0:9225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee05d27e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1874266701229568:12345-0@lo:400:kworker.0 Request processed in 52us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440253.348691:0:9225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787440253.348731:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee05d27df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1874266701229568:0@lo:400:kworker.0 00000100:00080000:2.0:1787440253.348757:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787440253.348864:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787440253.348874:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee05d27c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1874266701229440:0@lo:400:kworker.0 00000100:00100000:0.0:1787440253.348915:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440253.349002:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701229440 00000100:00100000:2.0:1787440253.349006:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701229440 00000100:00100000:2.0:1787440253.349046:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1787440253.349053:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee0804c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874266701229440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787440253.349101:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee0804c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874266701229440:12345-0@lo:400:kworker.0 Request processed in 48us (185us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440253.349107:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00080000:0.0:1787440253.349232:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787440253.349253:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee05d27c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1874266701229440:0@lo:400:kworker.0 00000100:00100000:1.0:1787440253.350614:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee049046680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:168176ea-29d1-49de-a254-317e90d54802:3312:1874266701228928:0@lo:400:kworker.0 00000100:00100000:3.0:1787440253.350615:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04a69b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:168176ea-29d1-49de-a254-317e90d54802+19:3312:x1874266701228928:12345-0@lo:400:kworker.0 Request processed in 6402us (9207us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440253.350630:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:2.0:1787440253.854576:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee079915c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1874266701229696:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787440253.854641:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440253.854858:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701229696 00000100:00100000:1.0:1787440253.854866:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701229696 00000100:00100000:1.0:1787440253.854918:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787440253.854927:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee05d27df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874266701229696:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787440253.854961:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787440253.855014:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee05d27df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874266701229696:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440253.855022:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787440253.855064:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee079915c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1874266701229696:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787440254.045603:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787440255.071704:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787440256.093250:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787440257.080903:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440257.080945:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440257.081143:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440257.081183:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440257.081214:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681270784 00000100:00100000:3.0:1787440257.081221:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681270784 00000100:00100000:3.0:1787440257.081386:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 68 00000100:00100000:3.0:1787440257.081395:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee079914700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+5:2360:x1874266681270784:12345-192.168.206.58@tcp:400:kworker.0 00000100:00100000:3.0:1787440257.081460:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee079914700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+5:2360:x1874266681270784:12345-192.168.206.58@tcp:400:kworker.0 Request processed in 66us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440257.081466:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 68 00000100:00080000:3.0:1787440257.081487:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787440257.081888:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681270528 00000100:00100000:1.0:1787440257.081894:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681270528 00000100:00100000:1.0:1787440257.081930:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 282 00000100:00100000:1.0:1787440257.081938:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04a699450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+13:2360:x1874266681270528:12345-192.168.206.58@tcp:400:kworker.0 00000100:00100000:1.0:1787440257.081988:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04a699450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+13:2360:x1874266681270528:12345-192.168.206.58@tcp:400:kworker.0 Request processed in 51us (845us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440257.082007:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 282 00000100:00100000:2.0:1787440257.083264:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681270656 00000100:00100000:2.0:1787440257.083274:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681270656 00000100:00100000:3.0:1787440257.083424:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681270912 00000100:00100000:3.0:1787440257.083428:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681270912 00000100:00100000:3.0:1787440257.083457:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 119 00000100:00100000:3.0:1787440257.083466:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee079915c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+5:2360:x1874266681270656:12345-192.168.206.58@tcp:400:kworker.0 00000100:00100000:3.0:1787440257.083615:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee079915c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+5:2360:x1874266681270656:12345-192.168.206.58@tcp:400:kworker.0 Request processed in 149us (2721us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440257.083632:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 119 00000100:00100000:3.0:1787440257.083648:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 120 00000100:00100000:3.0:1787440257.083655:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee079916d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fde7b340-91f7-42a0-a1a3-5665ea2691c9+5:2360:x1874266681270912:12345-192.168.206.58@tcp:400:kworker.0 00000100:00100000:3.0:1787440257.083696:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee079916d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fde7b340-91f7-42a0-a1a3-5665ea2691c9+5:2360:x1874266681270912:12345-192.168.206.58@tcp:400:kworker.0 Request processed in 42us (2751us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440257.083701:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 120 00000100:00080000:2.0:1787440257.084203:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787440257.117702:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787440257.436951:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787440257.442940:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee079916a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1874266701229824:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787440257.443033:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440257.443459:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701229824 00000100:00100000:2.0:1787440257.443468:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701229824 00000100:00100000:2.0:1787440257.443565:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787440257.443575:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee047a7f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874266701229824:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787440257.443612:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1787440257.443757:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787440257.443906:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee047a7f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874266701229824:12345-0@lo:13:osp-pre-0-0.0 Request processed in 332us (871us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440257.443931:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:1.0:1787440257.444555:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ee079916a00 x1874266701229824/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787440273 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787440257.444577:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee079916a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1874266701229824:0@lo:13:osp-pre-0-0.0 00000040:00080000:1.0:1787440257.949247:0:11682:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787440258.141314:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787440258.460805:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787440258.460926:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee047a79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874266701230080:0@lo:400:kworker.0 00000100:00100000:3.0:1787440258.461008:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440258.461074:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787440258.461081:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee047a7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1874266701230208:0@lo:400:kworker.0 00000100:00100000:3.0:1787440258.461104:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440258.461147:0:6892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701230080 00000100:00100000:3.0:1787440258.461153:0:6892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701230080 00000100:00100000:3.0:1787440258.461196:0:6892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701230208 00000100:00100000:3.0:1787440258.461199:0:6892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701230208 00000100:00100000:3.0:1787440258.461230:0:6892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1787440258.461238:0:6892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee079917800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874266701230080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440258.461300:0:6892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee079917800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874266701230080:12345-0@lo:400:kworker.0 Request processed in 62us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440258.461307:0:6892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1787440258.461323:0:6892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1787440258.461329:0:6892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee079914000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1874266701230208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440258.461357:0:6892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee079914000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1874266701230208:12345-0@lo:400:kworker.0 Request processed in 29us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440258.461376:0:6892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00080000:3.0:1787440258.461396:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787440258.461422:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee047a7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1874266701230208:0@lo:400:kworker.0 00000100:00100000:3.0:1787440258.461433:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee047a79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874266701230080:0@lo:400:kworker.0 00000100:00100000:1.0:1787440258.461697:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787440258.461707:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee047a78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1874266701230336:0@lo:400:kworker.0 00000100:00100000:1.0:1787440258.461741:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440258.463296:0:9225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701230336 00000100:00100000:3.0:1787440258.463305:0:9225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701230336 00000100:00100000:3.0:1787440258.463366:0:9225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787440258.463376:0:9225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee047a7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1874266701230336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440258.463448:0:9225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee047a7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1874266701230336:12345-0@lo:400:kworker.0 Request processed in 74us (1706us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440258.463455:0:9225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00010000:00080000:3.0:1787440258.463546:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ee047a78a80 x1874266701230336/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787440274 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787440258.463558:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee047a78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1874266701230336:0@lo:400:kworker.0 00000100:00100000:0.0:1787440258.464284:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee05d27c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:168176ea-29d1-49de-a254-317e90d54802:3311:1874266701229952:0@lo:400:kworker.0 00000100:00100000:0.0:1787440258.464333:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440258.464911:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701229952 00000100:00100000:3.0:1787440258.464918:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701229952 00000100:00100000:3.0:1787440258.465067:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:3.0:1787440258.465077:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04a699050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:168176ea-29d1-49de-a254-317e90d54802+19:3311:x1874266701229952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440258.465137:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04a699050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:168176ea-29d1-49de-a254-317e90d54802+19:3311:x1874266701229952:12345-0@lo:400:kworker.0 Request processed in 63us (804us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440258.465144:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:0.0:1787440258.465216:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee05d27c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:168176ea-29d1-49de-a254-317e90d54802:3311:1874266701229952:0@lo:400:kworker.0 00000100:00100000:2.0:1787440258.465950:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee047a78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874266701230592:0@lo:400:kworker.0 00000100:00100000:2.0:1787440258.466007:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440258.466045:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee047a7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3312:1874266701230464:0@lo:400:kworker.0 00000100:00100000:2.0:1787440258.466071:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440258.466112:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701230592 00000100:00100000:2.0:1787440258.466117:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701230592 00000100:00100000:2.0:1787440258.466163:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787440258.466170:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee047a79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1874266701230592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787440258.466213:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee047a79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1874266701230592:12345-0@lo:400:kworker.0 Request processed in 44us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440258.466220:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787440258.466249:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee047a78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874266701230592:0@lo:400:kworker.0 00000100:00080000:2.0:1787440258.466283:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787440258.466294:0:6892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701230464 00000100:00100000:2.0:1787440258.466298:0:6892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701230464 00000100:00100000:2.0:1787440258.466331:0:6892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1787440258.466337:0:6892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee047a7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874266701230464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787440258.466373:0:6892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee047a7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874266701230464:12345-0@lo:400:kworker.0 Request processed in 36us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440258.466379:0:6892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00080000:2.0:1787440258.466392:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787440258.466407:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee047a7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3312:1874266701230464:0@lo:400:kworker.0 00000100:00100000:0.0:1787440258.973215:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787440258.973239:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee079915f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874266701230720:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787440258.973322:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440258.973438:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701230720 00000100:00100000:3.0:1787440258.973446:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701230720 00000100:00100000:3.0:1787440258.973526:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787440258.973536:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee0804c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874266701230720:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787440258.973583:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787440258.973631:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee0804c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874266701230720:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440258.973638:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787440258.973689:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee079915f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874266701230720:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787440259.164712:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787440260.193637:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787440261.212687:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787440262.201818:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440262.201879:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440262.201977:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681271040 00000100:00100000:0.0:1787440262.201990:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681271040 00000100:00100000:0.0:1787440262.202078:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 284 00000100:00100000:1.0:1787440262.202096:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681271168 00000100:00100000:1.0:1787440262.202102:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681271168 00000100:00100000:0.0:1787440262.202112:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04a698050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+13:2362:x1874266681271040:12345-192.168.206.58@tcp:400:kworker.0 00000100:00100000:1.0:1787440262.202170:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 124 00000100:00100000:1.0:1787440262.202182:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee079915f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+5:2362:x1874266681271168:12345-192.168.206.58@tcp:400:kworker.0 00000100:00100000:0.0:1787440262.202210:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04a698050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+13:2362:x1874266681271040:12345-192.168.206.58@tcp:400:kworker.0 Request processed in 102us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440262.202221:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 284 00000100:00100000:1.0:1787440262.202226:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee079915f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+5:2362:x1874266681271168:12345-192.168.206.58@tcp:400:kworker.0 Request processed in 45us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440262.202235:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 124 00000100:00080000:2.0:1787440262.202338:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787440262.223193:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440262.223476:0:9225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681271296 00000100:00100000:3.0:1787440262.223489:0:9225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681271296 00000100:00100000:3.0:1787440262.223618:0:9225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 19 00000100:00100000:3.0:1787440262.223632:0:9225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee0804c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+5:2359:x1874266681271296:12345-192.168.206.58@tcp:9:kworker.0 00000100:00080000:2.0:1787440262.223726:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000080:3.0:1787440262.223872:0:9225:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x85f5fa77adf3c436 00000100:00080000:3.0:1787440262.223885:0:9225:0:(import.c:65:import_set_state_nolock()) ffff8ee080786000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787440262.223942:0:9225:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967300 00010000:00010000:2.0:1787440262.224134:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787440262.224446:0:9225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee0804c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+2:2359:x1874266681271296:12345-192.168.206.58@tcp:9:kworker.0 Request processed in 816us (1267us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440262.224456:0:9225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 19 00000100:00100000:0.0:1787440262.232787:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:2.0:1787440262.232919:0:6892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681271424 00000100:00100000:2.0:1787440262.232942:0:6892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681271424 00000100:00100000:2.0:1787440262.233042:0:6892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 125 00000100:00100000:2.0:1787440262.233053:0:6892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee0804c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fde7b340-91f7-42a0-a1a3-5665ea2691c9+5:2363:x1874266681271424:12345-192.168.206.58@tcp:400:kworker.0 00000100:00100000:2.0:1787440262.233156:0:6892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee0804c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fde7b340-91f7-42a0-a1a3-5665ea2691c9+5:2363:x1874266681271424:12345-192.168.206.58@tcp:400:kworker.0 Request processed in 104us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440262.233164:0:6892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 125 00000100:00080000:0.0:1787440262.234093:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787440262.241167:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787440262.562196:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee079916a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874266701230848:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787440262.562308:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440262.562533:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701230848 00000100:00100000:3.0:1787440262.562543:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701230848 00000100:00100000:3.0:1787440262.562624:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787440262.562644:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee0804c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874266701230848:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787440262.562693:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787440262.562746:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee0804c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874266701230848:12345-0@lo:13:osp-pre-0-0.0 Request processed in 113us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440262.562770:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:0.0:1787440262.564024:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787440262.564103:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ee079916a00 x1874266701230848/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787440278 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787440262.564132:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee079916a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874266701230848:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787440263.262368:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787440263.581194:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee08032ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874266701231104:0@lo:400:kworker.0 00000100:00100000:1.0:1787440263.581301:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440263.581383:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee077f41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874266701231616:0@lo:400:kworker.0 00000100:00100000:1.0:1787440263.581414:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440263.581452:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787440263.581459:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee080325f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1874266701231232:0@lo:400:kworker.0 00000100:00100000:1.0:1787440263.581551:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440263.581592:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701231104 00000100:00100000:1.0:1787440263.581609:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701231104 00000100:00100000:1.0:1787440263.581659:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701231232 00000100:00100000:1.0:1787440263.581662:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701231232 00000100:00100000:1.0:1787440263.581701:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1787440263.581710:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee047a7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874266701231104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440263.581770:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee047a7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874266701231104:12345-0@lo:400:kworker.0 Request processed in 61us (469us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440263.581778:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1787440263.581799:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1787440263.581805:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee049046680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1874266701231232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440263.581832:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee049046680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1874266701231232:12345-0@lo:400:kworker.0 Request processed in 28us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440263.581838:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00080000:1.0:1787440263.581859:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787440263.582169:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee077d79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874266701231360:0@lo:400:kworker.0 00000100:00100000:0.0:1787440263.582205:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440263.582232:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1787440263.582237:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee079916a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:168176ea-29d1-49de-a254-317e90d54802:3311:1874266701230976:0@lo:400:kworker.0 00000100:00100000:0.0:1787440263.582279:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440263.582302:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee077d78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1874266701231488:0@lo:400:kworker.0 00000100:00100000:0.0:1787440263.582324:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440263.582354:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701231616 00000100:00100000:0.0:1787440263.582359:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701231616 00000100:00100000:0.0:1787440263.582396:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701231360 00000100:00100000:0.0:1787440263.582400:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701231360 00000100:00100000:0.0:1787440263.582420:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787440263.582427:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee047a7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1874266701231616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787440263.582479:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee047a7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1874266701231616:12345-0@lo:400:kworker.0 Request processed in 53us (1065us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440263.582486:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787440263.582563:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787440263.582570:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee0804c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1874266701231360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787440263.582605:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee0804c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1874266701231360:12345-0@lo:400:kworker.0 Request processed in 35us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440263.582610:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:0.0:1787440263.582657:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1787440263.582682:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ee077d79500 x1874266701231360/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787440279 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787440263.582697:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee077d79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874266701231360:0@lo:400:kworker.0 00000100:00100000:0.0:1787440263.582737:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701231488 00000100:00100000:0.0:1787440263.582741:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701231488 00000100:00100000:0.0:1787440263.582770:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1787440263.582775:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee0804c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874266701231488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787440263.582811:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee0804c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874266701231488:12345-0@lo:400:kworker.0 Request processed in 35us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440263.582817:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00080000:0.0:1787440263.582830:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787440263.582847:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee077d78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1874266701231488:0@lo:400:kworker.0 00000100:00100000:1.0:1787440263.583149:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee080325f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1874266701231232:0@lo:400:kworker.0 00000100:00100000:1.0:1787440263.583169:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee08032ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874266701231104:0@lo:400:kworker.0 00000100:00100000:1.0:1787440263.583180:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee077f41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874266701231616:0@lo:400:kworker.0 00000100:00100000:3.0:1787440263.583318:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701230976 00000100:00100000:3.0:1787440263.583324:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701230976 00000100:00100000:3.0:1787440263.583361:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:3.0:1787440263.583368:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04a69ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:168176ea-29d1-49de-a254-317e90d54802+19:3311:x1874266701230976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440263.583418:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04a69ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:168176ea-29d1-49de-a254-317e90d54802+19:3311:x1874266701230976:12345-0@lo:400:kworker.0 Request processed in 51us (1138us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440263.583425:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:3.0:1787440263.583475:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee079916a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:168176ea-29d1-49de-a254-317e90d54802:3311:1874266701230976:0@lo:400:kworker.0 00000100:00100000:2.0:1787440264.092841:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee077f40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1874266701231744:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787440264.092921:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440264.093386:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701231744 00000100:00100000:3.0:1787440264.093398:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701231744 00000100:00100000:3.0:1787440264.093474:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787440264.093487:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee047a7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874266701231744:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787440264.093863:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787440264.093996:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee047a7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874266701231744:12345-0@lo:13:osp-pre-1-0.0 Request processed in 509us (1073us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440264.094009:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787440264.094071:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee077f40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1874266701231744:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787440264.284673:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787440264.685896:0:7640:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 792563a7-4c22-4ac7-ac25-d49ef7fb41a8 00000020:00000080:1.0:1787440264.685905:0:7640:0:(genops.c:885:class_export_put()) final put ffff8ee080785800/792563a7-4c22-4ac7-ac25-d49ef7fb41a8 00000020:00000080:3.0:1787440264.686267:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8ee080785800/792563a7-4c22-4ac7-ac25-d49ef7fb41a8 for lustre-OST0001 00000020:00000080:3.0:1787440264.686319:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ee080786000 for lustre-OST0001 00010000:00010000:2.0:1787440265.309876:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787440266.332641:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787440267.168941:0:11682:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1787440267.327870:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:2.0:1787440267.327986:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:2.0:1787440267.328026:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440267.328195:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681271808 00000100:00100000:0.0:1787440267.328205:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681271808 00000100:00100000:0.0:1787440267.328283:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681271680 00000100:00100000:0.0:1787440267.328286:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681271680 00000100:00100000:0.0:1787440267.328313:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 129 00000100:00100000:0.0:1787440267.328334:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee047a78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fde7b340-91f7-42a0-a1a3-5665ea2691c9+5:2361:x1874266681271808:12345-192.168.206.58@tcp:400:kworker.0 00000100:00100000:0.0:1787440267.328400:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee047a78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fde7b340-91f7-42a0-a1a3-5665ea2691c9+5:2361:x1874266681271808:12345-192.168.206.58@tcp:400:kworker.0 Request processed in 68us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440267.328407:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 129 00000100:00100000:0.0:1787440267.328425:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 130 00000100:00100000:0.0:1787440267.328545:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee047a7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+5:2361:x1874266681271680:12345-192.168.206.58@tcp:400:kworker.0 00000100:00100000:0.0:1787440267.328576:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee047a7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+5:2361:x1874266681271680:12345-192.168.206.58@tcp:400:kworker.0 Request processed in 145us (551us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440267.328582:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 130 00000100:00100000:3.0:1787440267.328716:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681271552 00000100:00100000:3.0:1787440267.328722:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681271552 00000100:00100000:3.0:1787440267.328755:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 286 00000100:00100000:3.0:1787440267.328764:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04a69a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+13:2361:x1874266681271552:12345-192.168.206.58@tcp:400:kworker.0 00000100:00080000:2.0:1787440267.329025:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787440267.330721:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04a69a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+13:2361:x1874266681271552:12345-192.168.206.58@tcp:400:kworker.0 Request processed in 1948us (2850us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440267.330733:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 286 00010000:00010000:2.0:1787440267.357138:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787440267.677182:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee077f43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874266701231872:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787440267.677410:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440267.677619:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701231872 00000100:00100000:1.0:1787440267.677626:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701231872 00000100:00100000:1.0:1787440267.677697:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787440267.677707:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee0804c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874266701231872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787440267.677756:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787440267.677923:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee0804c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874266701231872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (529us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440267.677932:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:0.0:1787440267.678453:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787440267.678512:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ee077f43b80 x1874266701231872/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787440283 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787440267.678536:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee077f43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874266701231872:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787440268.381613:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787440268.641419:0:11848:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 19:11:07 (1787440267) 00000100:00100000:3.0:1787440268.704251:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee077f41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874266701232128:0@lo:400:kworker.0 00000100:00100000:3.0:1787440268.704319:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440268.704368:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee077f41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874266701232640:0@lo:400:kworker.0 00000100:00100000:3.0:1787440268.704413:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440268.704447:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787440268.704453:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee077f42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1874266701232256:0@lo:400:kworker.0 00000100:00100000:3.0:1787440268.704478:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440268.704537:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701232128 00000100:00100000:3.0:1787440268.704544:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701232128 00000100:00100000:3.0:1787440268.704583:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701232256 00000100:00100000:3.0:1787440268.704586:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701232256 00000100:00100000:3.0:1787440268.704617:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1787440268.704624:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee079916a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874266701232128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440268.704672:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee079916a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874266701232128:12345-0@lo:400:kworker.0 Request processed in 48us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440268.704679:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1787440268.704697:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1787440268.704703:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee06e6ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1874266701232256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440268.705101:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee077f43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874266701232384:0@lo:400:kworker.0 00000100:00100000:1.0:1787440268.705135:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440268.705156:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787440268.705161:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee077f40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:168176ea-29d1-49de-a254-317e90d54802:3311:1874266701232000:0@lo:400:kworker.0 00000100:00100000:1.0:1787440268.705187:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440268.705211:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee077f40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1874266701232512:0@lo:400:kworker.0 00000100:00100000:1.0:1787440268.705247:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440268.705289:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee06e6ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1874266701232256:12345-0@lo:400:kworker.0 Request processed in 27us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440268.705297:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1787440268.705314:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701232512 00000100:00100000:3.0:1787440268.705328:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701232512 00000100:00100000:3.0:1787440268.705352:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1787440268.705358:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee080325f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874266701232512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440268.705405:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee080325f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874266701232512:12345-0@lo:400:kworker.0 Request processed in 47us (157us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440268.705411:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1787440268.705430:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701232640 00000100:00100000:3.0:1787440268.705434:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701232640 00000100:00100000:3.0:1787440268.705457:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701232384 00000100:00100000:3.0:1787440268.705460:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701232384 00000100:00100000:3.0:1787440268.705479:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787440268.705485:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee06e6cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1874266701232640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440268.705540:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee06e6cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1874266701232640:12345-0@lo:400:kworker.0 Request processed in 55us (1126us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440268.705548:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787440268.705560:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787440268.705566:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee08032ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1874266701232384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440268.705594:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee08032ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1874266701232384:12345-0@lo:400:kworker.0 Request processed in 28us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440268.705600:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:3.0:1787440268.705623:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787440268.705628:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787440268.705641:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701232000 00000100:00100000:3.0:1787440268.705645:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701232000 00000100:00100000:3.0:1787440268.705666:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:3.0:1787440268.705672:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04a69bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:168176ea-29d1-49de-a254-317e90d54802+19:3311:x1874266701232000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440268.705701:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04a69bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:168176ea-29d1-49de-a254-317e90d54802+19:3311:x1874266701232000:12345-0@lo:400:kworker.0 Request processed in 30us (514us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440268.705715:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:1.0:1787440268.706039:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee077f40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:168176ea-29d1-49de-a254-317e90d54802:3311:1874266701232000:0@lo:400:kworker.0 00000100:00100000:1.0:1787440268.706054:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee077f40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1874266701232512:0@lo:400:kworker.0 00010000:00080000:1.0:1787440268.706066:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ee077f43b80 x1874266701232384/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787440284 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787440268.706077:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee077f43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874266701232384:0@lo:400:kworker.0 00000100:00100000:3.0:1787440268.706320:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee077f42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1874266701232256:0@lo:400:kworker.0 00000100:00100000:3.0:1787440268.706331:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee077f41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874266701232128:0@lo:400:kworker.0 00000100:00100000:3.0:1787440268.706340:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee077f41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874266701232640:0@lo:400:kworker.0 00000100:00100000:3.0:1787440269.215836:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787440269.215859:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee06e6cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874266701232768:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787440269.215938:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440269.216023:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701232768 00000100:00100000:3.0:1787440269.216030:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701232768 00000100:00100000:3.0:1787440269.216073:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787440269.216083:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee06e6cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874266701232768:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787440269.216160:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787440269.216204:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee06e6cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874266701232768:12345-0@lo:13:osp-pre-1-0.0 Request processed in 122us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440269.216212:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787440269.216269:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee06e6cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874266701232768:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787440269.406091:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787440270.428705:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787440270.494969:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440270.495037:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681271936 00000100:00100000:3.0:1787440270.495046:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681271936 00000100:00100000:3.0:1787440270.495134:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 32 00000100:00100000:3.0:1787440270.495144:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee047a79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+5:10242:x1874266681271936:12345-192.168.206.58@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787440270.495162:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440270.495183:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94e00/0x85f5fa77adf3c501 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fab14535dc6215a expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787440270.495688:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787440270.495781:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94600/0x85f5fa77adf3c508 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440270.495796:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94600/0x85f5fa77adf3c508 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440270.495810:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94600/0x85f5fa77adf3c508 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787440270.496002:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787440270.496006:0:5851:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787440270.496094:0:5851:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94600/0x85f5fa77adf3c508 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440270.496119:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94e00/0x85f5fa77adf3c501 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6215a expref: 7 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440270.496135:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94600/0x85f5fa77adf3c508 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6215a expref: 6 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440270.496143:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ee0460cc600) 00010000:00010000:3.0:1787440270.496146:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787440270.496150:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee049e94600, rc 0) 00000100:00100000:3.0:1787440270.496222:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee047a79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+6:10242:x1874266681271936:12345-192.168.206.58@tcp:101:lhsmtool_posix.0 Request processed in 1079us (1260us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440270.496230:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 32 00000100:00100000:1.0:1787440270.513641:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440270.513747:0:6892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681272064 00000100:00100000:3.0:1787440270.513759:0:6892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681272064 00000100:00100000:3.0:1787440270.513867:0:6892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 33 00000100:00100000:3.0:1787440270.513880:0:6892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee077f41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+6:10243:x1874266681272064:12345-192.168.206.58@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787440270.513918:0:6892:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440270.513944:0:6892:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94e00/0x85f5fa77adf3c50f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fab14535dc62161 expref: -99 pid: 6892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440270.514027:0:6892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94400/0x85f5fa77adf3c516 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440270.514045:0:6892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94400/0x85f5fa77adf3c516 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440270.514059:0:6892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94400/0x85f5fa77adf3c516 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440270.514076:0:6892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95000/0x85f5fa77adf3c51d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440270.514083:0:6892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95000/0x85f5fa77adf3c51d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440270.514090:0:6892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95000/0x85f5fa77adf3c51d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440270.514626:0:6892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94a00/0x85f5fa77adf3c524 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440270.514638:0:6892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94a00/0x85f5fa77adf3c524 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440270.514645:0:6892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94a00/0x85f5fa77adf3c524 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787440270.514752:0:6892:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:3.0:1787440270.514756:0:6892:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1787440270.514840:0:6892:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94a00/0x85f5fa77adf3c524 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440270.514853:0:6892:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94400/0x85f5fa77adf3c516 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440270.514860:0:6892:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94400/0x85f5fa77adf3c516 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440270.514868:0:6892:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94400/0x85f5fa77adf3c516 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440270.514874:0:6892:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee049e94400 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:3.0:1787440270.514879:0:6892:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94400/0x85f5fa77adf3c516 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440270.514887:0:6892:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94400/0x85f5fa77adf3c516 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440270.514902:0:6892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ee0460cc600) 00010000:00010000:3.0:1787440270.514905:0:6892:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440270.514910:0:6892:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94400/0x85f5fa77adf3c516 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440270.514917:0:6892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94400/0x85f5fa77adf3c516 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440270.514932:0:6892:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95000/0x85f5fa77adf3c51d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440270.514948:0:6892:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95000/0x85f5fa77adf3c51d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440270.514954:0:6892:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95000/0x85f5fa77adf3c51d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440270.514959:0:6892:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee049e95000 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:3.0:1787440270.514962:0:6892:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95000/0x85f5fa77adf3c51d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440270.514967:0:6892:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95000/0x85f5fa77adf3c51d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440270.514976:0:6892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8ee0460cce00) 00010000:00010000:3.0:1787440270.514979:0:6892:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440270.514982:0:6892:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95000/0x85f5fa77adf3c51d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440270.514987:0:6892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95000/0x85f5fa77adf3c51d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440270.515026:0:6892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94e00/0x85f5fa77adf3c50f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62161 expref: 8 pid: 6892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440270.515040:0:6892:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94a00/0x85f5fa77adf3c524 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62161 expref: 7 pid: 6892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440270.515048:0:6892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8ee0460ccf00) 00010000:00010000:3.0:1787440270.515051:0:6892:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787440270.515059:0:6892:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee049e94a00, rc 0) 00000100:00100000:3.0:1787440270.515142:0:6892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee077f41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+7:10243:x1874266681272064:12345-192.168.206.58@tcp:101:lhsmtool_posix.0 Request processed in 1265us (1515us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440270.515151:0:6892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 33 00000100:00100000:0.0:1787440270.525114:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:1.0:1787440270.525250:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681272320 00000100:00100000:1.0:1787440270.525265:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681272320 00000100:00100000:1.0:1787440270.525337:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 34 00000100:00100000:1.0:1787440270.525349:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee0804c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+7:10243:x1874266681272320:12345-192.168.206.58@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787440270.525376:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440270.525401:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9ec00/0x85f5fa77adf3c52b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fab14535dc62168 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440270.525561:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f200/0x85f5fa77adf3c532 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440270.525580:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f200/0x85f5fa77adf3c532 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440270.525594:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f200/0x85f5fa77adf3c532 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440270.526387:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e800/0x85f5fa77adf3c539 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440270.526411:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e800/0x85f5fa77adf3c539 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440270.526424:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e800/0x85f5fa77adf3c539 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440270.527059:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f800/0x85f5fa77adf3c540 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440270.527070:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f800/0x85f5fa77adf3c540 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440270.527079:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f800/0x85f5fa77adf3c540 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787440270.527636:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:1.0:1787440270.528011:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f200/0x85f5fa77adf3c532 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440270.528020:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f200/0x85f5fa77adf3c532 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440270.528428:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f200/0x85f5fa77adf3c532 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440270.528435:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee07fb9f200 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:1.0:1787440270.528441:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f200/0x85f5fa77adf3c532 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440270.528449:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f200/0x85f5fa77adf3c532 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440270.528465:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8ee0460ccf00) 00010000:00010000:1.0:1787440270.528469:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440270.528473:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f200/0x85f5fa77adf3c532 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440270.528479:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f200/0x85f5fa77adf3c532 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440270.528593:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e800/0x85f5fa77adf3c539 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440270.528601:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e800/0x85f5fa77adf3c539 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440270.528608:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e800/0x85f5fa77adf3c539 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440270.528613:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee07fb9e800 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:1.0:1787440270.528616:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e800/0x85f5fa77adf3c539 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440270.528632:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e800/0x85f5fa77adf3c539 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440270.528641:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8ee05132e000) 00010000:00010000:1.0:1787440270.528643:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440270.528646:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e800/0x85f5fa77adf3c539 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440270.528652:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e800/0x85f5fa77adf3c539 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440270.533531:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9ec00/0x85f5fa77adf3c52b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62168 expref: 10 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440270.533558:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f800/0x85f5fa77adf3c540 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62168 expref: 9 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440270.533581:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ee05132e100) 00010000:00010000:0.0:1787440270.533584:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440270.533587:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee07fb9f800, rc 0) 00000100:00100000:0.0:1787440270.533654:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee0804c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+9:10243:x1874266681272320:12345-192.168.206.58@tcp:101:lhsmtool_posix.0 Request processed in 8307us (8552us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1787440270.533664:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 34 00000100:00100000:2.0:1787440270.542408:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440270.543254:0:6892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681272448 00000100:00100000:3.0:1787440270.543264:0:6892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681272448 00000100:00100000:3.0:1787440270.543386:0:6892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 35 00000100:00100000:3.0:1787440270.543397:0:6892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee047a7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+9:10243:x1874266681272448:12345-192.168.206.58@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1787440270.543539:0:6892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee047a7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+9:10243:x1874266681272448:12345-192.168.206.58@tcp:59:lhsmtool_posix.0 Request processed in 143us (1140us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440270.543547:0:6892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 35 00000040:00080000:3.0:1787440271.261922:0:11682:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787440271.452786:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787440272.428182:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440272.428265:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681272576 00000100:00100000:3.0:1787440272.428275:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681272576 00000100:00100000:3.0:1787440272.428347:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 36 00000100:00100000:3.0:1787440272.428357:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee077f41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+9:10285:x1874266681272576:12345-192.168.206.58@tcp:101:lfs.0 00010000:00010000:3.0:1787440272.428377:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440272.428397:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95000/0x85f5fa77adf3c54e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fab14535dc6216f expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440272.428459:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94e00/0x85f5fa77adf3c555 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440272.428473:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94e00/0x85f5fa77adf3c555 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440272.428486:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94e00/0x85f5fa77adf3c555 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440272.428549:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94400/0x85f5fa77adf3c55c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440272.428558:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94400/0x85f5fa77adf3c55c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1787440272.428661:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787440272.428831:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94400/0x85f5fa77adf3c55c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440272.429088:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94e00/0x85f5fa77adf3c555 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440272.429096:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94e00/0x85f5fa77adf3c555 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440272.429102:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94e00/0x85f5fa77adf3c555 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440272.429107:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee049e94e00 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:3.0:1787440272.429112:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94e00/0x85f5fa77adf3c555 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440272.429119:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94e00/0x85f5fa77adf3c555 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440272.429130:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ee0460cc600) 00010000:00010000:3.0:1787440272.429133:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440272.429137:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94e00/0x85f5fa77adf3c555 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440272.429144:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94e00/0x85f5fa77adf3c555 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440272.429163:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94400/0x85f5fa77adf3c55c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440272.429169:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94400/0x85f5fa77adf3c55c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440272.429175:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94400/0x85f5fa77adf3c55c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440272.429180:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee049e94400 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:3.0:1787440272.429184:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94400/0x85f5fa77adf3c55c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440272.429190:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94400/0x85f5fa77adf3c55c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440272.429211:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8ee0460cc100) 00010000:00010000:3.0:1787440272.429214:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440272.429218:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94400/0x85f5fa77adf3c55c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440272.429224:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94400/0x85f5fa77adf3c55c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440272.429259:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95000/0x85f5fa77adf3c54e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6216f expref: 10 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440272.429270:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ee0460cc600) 00010000:00010000:3.0:1787440272.429273:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440272.429282:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95000/0x85f5fa77adf3c54e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6216f expref: 10 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440272.429292:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee049e95000, rc 0) 00000100:00100000:3.0:1787440272.429392:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee077f41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+9:10285:x1874266681272576:12345-192.168.206.58@tcp:101:lfs.0 Request processed in 1036us (1220us total) trans 0 rc 301/301 00000100:00100000:3.0:1787440272.429400:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 36 00000100:00100000:0.0:1787440272.449425:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440272.449573:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440272.449613:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440272.449661:0:6892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681272832 00000100:00100000:1.0:1787440272.449670:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681273088 00000100:00100000:0.0:1787440272.449674:0:6892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681272832 00000100:00100000:1.0:1787440272.449687:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681273088 00000100:00100000:0.0:1787440272.449764:0:6892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 134 00000100:00100000:0.0:1787440272.449777:0:6892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee0804c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fde7b340-91f7-42a0-a1a3-5665ea2691c9+5:2363:x1874266681272832:12345-192.168.206.58@tcp:400:kworker.0 00000100:00100000:0.0:1787440272.449870:0:6892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee0804c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fde7b340-91f7-42a0-a1a3-5665ea2691c9+5:2363:x1874266681272832:12345-192.168.206.58@tcp:400:kworker.0 Request processed in 96us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440272.451106:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681272704 00000100:00100000:3.0:1787440272.451123:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681272704 00000100:00100000:3.0:1787440272.451403:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 288 00000100:00100000:0.0:1787440272.451408:0:6892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 134 00000100:00100000:3.0:1787440272.451416:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04a698450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+13:2363:x1874266681272704:12345-192.168.206.58@tcp:400:kworker.0 00000100:00100000:0.0:1787440272.451445:0:6892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 37 00000100:00100000:3.0:1787440272.451487:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04a698450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+13:2363:x1874266681272704:12345-192.168.206.58@tcp:400:kworker.0 Request processed in 75us (2209us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440272.451531:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 288 00000100:00100000:0.0:1787440272.451617:0:6892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee077d78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+9:10285:x1874266681273088:12345-192.168.206.58@tcp:36:lfs.0 00010000:00010000:0.0:1787440272.451681:0:6892:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787440272.451716:0:6892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94600/0x85f5fa77adf3c508 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6215a expref: 9 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440272.451739:0:6892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ee0460cc600) 00010000:00010000:0.0:1787440272.451751:0:6892:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00080000:1.0:1787440272.454859:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787440272.458857:0:6892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcee00/0x85f5fa77adf3c563 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440272.458906:0:6892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcee00/0x85f5fa77adf3c563 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440272.458925:0:6892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcee00/0x85f5fa77adf3c563 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440272.458943:0:6892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce800/0x85f5fa77adf3c56a lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440272.458951:0:6892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce800/0x85f5fa77adf3c56a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440272.458958:0:6892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce800/0x85f5fa77adf3c56a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787440272.463423:0:6892:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:0.0:1787440272.463446:0:6892:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcee00/0x85f5fa77adf3c563 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440272.463457:0:6892:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcee00/0x85f5fa77adf3c563 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440272.463464:0:6892:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcee00/0x85f5fa77adf3c563 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440272.463470:0:6892:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee04cbcee00 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:0.0:1787440272.463475:0:6892:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcee00/0x85f5fa77adf3c563 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440272.463482:0:6892:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcee00/0x85f5fa77adf3c563 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440272.463527:0:6892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ee050ca1c00) 00010000:00010000:0.0:1787440272.463530:0:6892:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440272.463535:0:6892:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcee00/0x85f5fa77adf3c563 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440272.463542:0:6892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcee00/0x85f5fa77adf3c563 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787440272.463566:0:6892:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000099ef1780 reply state 0000000054e89710 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce800/0x85f5fa77adf3c56a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440272.463576:0:6892:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787440272.463946:0:6892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee077d78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+10:10285:x1874266681273088:12345-192.168.206.58@tcp:36:lfs.0 Request processed in 12329us (14327us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1787440272.463955:0:6892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 37 00010000:00010000:3.0:1787440272.473269:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce800/0x85f5fa77adf3c56a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440272.473668:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce800/0x85f5fa77adf3c56a lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440272.473679:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce800/0x85f5fa77adf3c56a lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440272.473686:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee04cbce800 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:3.0:1787440272.473692:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce800/0x85f5fa77adf3c56a lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440272.473701:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce800/0x85f5fa77adf3c56a lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440272.473744:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8ee050ca1e00) 00010000:00010000:3.0:1787440272.473748:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440272.473753:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce800/0x85f5fa77adf3c56a lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440272.473761:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce800/0x85f5fa77adf3c56a lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440272.477183:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787440272.556856:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:2.0:1787440272.557082:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681273216 00000100:00100000:2.0:1787440272.557093:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681273216 00000100:00100000:2.0:1787440272.557150:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 38 00000100:00100000:2.0:1787440272.557158:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee077f42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+9:10293:x1874266681273216:12345-192.168.206.58@tcp:101:lctl.0 00010000:00010000:2.0:1787440272.557205:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440272.557227:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f600/0x85f5fa77adf3c571 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fab14535dc62176 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440272.557287:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86ee00/0x85f5fa77adf3c578 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440272.557301:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86ee00/0x85f5fa77adf3c578 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440272.557312:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86ee00/0x85f5fa77adf3c578 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787440272.557368:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1787440272.557371:0:5849:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1787440272.557413:0:5849:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86ee00/0x85f5fa77adf3c578 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440272.557438:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f600/0x85f5fa77adf3c571 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62176 expref: 11 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440272.557456:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86ee00/0x85f5fa77adf3c578 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62176 expref: 10 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440272.557464:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ee054b3c600) 00010000:00010000:2.0:1787440272.557468:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787440272.557471:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee07f86ee00, rc 0) 00000100:00100000:2.0:1787440272.557717:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee077f42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+10:10293:x1874266681273216:12345-192.168.206.58@tcp:101:lctl.0 Request processed in 548us (1090us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440272.557726:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 38 00000100:00100000:1.0:1787440272.658251:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:2.0:1787440272.661772:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681273344 00000100:00100000:2.0:1787440272.661787:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681273344 00000100:00100000:3.0:1787440272.662098:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 39 00000100:00100000:3.0:1787440272.662109:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee077f43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+10:10299:x1874266681273344:12345-192.168.206.58@tcp:101:bash.0 00010000:00010000:3.0:1787440272.662129:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440272.662149:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95000/0x85f5fa77adf3c57f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fab14535dc6217d expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440272.662234:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94400/0x85f5fa77adf3c586 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440272.662250:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94400/0x85f5fa77adf3c586 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440272.662263:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94400/0x85f5fa77adf3c586 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440272.662278:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94e00/0x85f5fa77adf3c58d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440272.662286:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94e00/0x85f5fa77adf3c58d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440272.662312:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94e00/0x85f5fa77adf3c58d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440272.662448:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95e00/0x85f5fa77adf3c594 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440272.662458:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95e00/0x85f5fa77adf3c594 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440272.662465:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95e00/0x85f5fa77adf3c594 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787440272.662516:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:3.0:1787440272.662519:0:5850:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787440272.662573:0:5850:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95e00/0x85f5fa77adf3c594 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440272.662586:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94400/0x85f5fa77adf3c586 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440272.662593:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94400/0x85f5fa77adf3c586 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440272.662599:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94400/0x85f5fa77adf3c586 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440272.662605:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee049e94400 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:3.0:1787440272.662609:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94400/0x85f5fa77adf3c586 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440272.662616:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94400/0x85f5fa77adf3c586 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440272.662635:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ee054b3c600) 00010000:00010000:3.0:1787440272.662638:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440272.662642:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94400/0x85f5fa77adf3c586 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440272.662649:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94400/0x85f5fa77adf3c586 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440272.662661:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94e00/0x85f5fa77adf3c58d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440272.662667:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94e00/0x85f5fa77adf3c58d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440272.662672:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94e00/0x85f5fa77adf3c58d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440272.662677:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee049e94e00 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:3.0:1787440272.662680:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94e00/0x85f5fa77adf3c58d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440272.662686:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94e00/0x85f5fa77adf3c58d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440272.662705:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8ee0460cc100) 00010000:00010000:3.0:1787440272.662707:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440272.662710:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94e00/0x85f5fa77adf3c58d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440272.662716:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94e00/0x85f5fa77adf3c58d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440272.662757:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95000/0x85f5fa77adf3c57f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6217d expref: 12 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440272.662771:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95e00/0x85f5fa77adf3c594 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6217d expref: 11 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440272.662777:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8ee0460ccd00) 00010000:00010000:3.0:1787440272.662779:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1787440272.662781:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee049e95e00, rc 0) 00000100:00100000:3.0:1787440272.662852:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee077f43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+11:10299:x1874266681273344:12345-192.168.206.58@tcp:101:bash.0 Request processed in 745us (4608us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440272.662859:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 39 00000100:00100000:2.0:1787440272.665764:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:1.0:1787440272.666889:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681273600 00000100:00100000:1.0:1787440272.666901:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681273600 00000100:00100000:1.0:1787440272.667121:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 40 00000100:00100000:1.0:1787440272.667131:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee047a78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+11:10299:x1874266681273600:12345-192.168.206.58@tcp:101:bash.0 00010000:00010000:1.0:1787440272.667152:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440272.667171:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f200/0x85f5fa77adf3c59b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fab14535dc62184 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440272.667307:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9ec00/0x85f5fa77adf3c5a2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440272.667335:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9ec00/0x85f5fa77adf3c5a2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440272.667345:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9ec00/0x85f5fa77adf3c5a2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440272.667359:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e800/0x85f5fa77adf3c5a9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440272.667365:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e800/0x85f5fa77adf3c5a9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440272.667371:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e800/0x85f5fa77adf3c5a9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787440272.668293:0:5851:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:1.0:1787440272.668542:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f000/0x85f5fa77adf3c5b0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440272.668554:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f000/0x85f5fa77adf3c5b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440272.668564:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f000/0x85f5fa77adf3c5b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440272.668599:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9ec00/0x85f5fa77adf3c5a2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440272.668606:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9ec00/0x85f5fa77adf3c5a2 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440272.668613:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9ec00/0x85f5fa77adf3c5a2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440272.668884:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee07fb9ec00 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:1.0:1787440272.668892:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9ec00/0x85f5fa77adf3c5a2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440272.668901:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9ec00/0x85f5fa77adf3c5a2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440272.668913:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8ee0460ccd00) 00010000:00010000:1.0:1787440272.668979:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440272.668986:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9ec00/0x85f5fa77adf3c5a2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440272.668993:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9ec00/0x85f5fa77adf3c5a2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787440272.669008:0:5851:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000761913f7 reply state 000000008337d011 transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e800/0x85f5fa77adf3c5a9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440272.669017:0:5851:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787440272.669049:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f200/0x85f5fa77adf3c59b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62184 expref: 14 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440272.669062:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f000/0x85f5fa77adf3c5b0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62184 expref: 13 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440272.669070:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ee05132e500) 00010000:00010000:1.0:1787440272.669072:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787440272.669074:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee07fb9f000, rc 0) 00000100:00100000:1.0:1787440272.669271:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee047a78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+14:10299:x1874266681273600:12345-192.168.206.58@tcp:101:bash.0 Request processed in 2140us (3513us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1787440272.669286:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 40 00010000:00010000:3.0:1787440272.673225:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e800/0x85f5fa77adf3c5a9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440272.673247:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e800/0x85f5fa77adf3c5a9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440272.673255:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e800/0x85f5fa77adf3c5a9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440272.673261:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee07fb9e800 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:3.0:1787440272.673267:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e800/0x85f5fa77adf3c5a9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440272.673285:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e800/0x85f5fa77adf3c5a9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440272.673307:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8ee05132e000) 00010000:00010000:3.0:1787440272.673326:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440272.673332:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e800/0x85f5fa77adf3c5a9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440272.673338:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e800/0x85f5fa77adf3c5a9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440272.685879:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440272.685978:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681273728 00000100:00100000:3.0:1787440272.685994:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681273728 00000100:00100000:3.0:1787440272.686056:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 20 00000100:00100000:3.0:1787440272.686065:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee047a78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2359:x1874266681273728:12345-192.168.206.58@tcp:8:bash.0 00010000:00080000:3.0:1787440272.686105:0:6695:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 792563a7-4c22-4ac7-ac25-d49ef7fb41a8@192.168.206.58@tcp t0 exp 0000000000000000 cur 371 last 0 00000020:00000080:3.0:1787440272.686210:0:6695:0:(genops.c:1385:class_connect()) connect: client 792563a7-4c22-4ac7-ac25-d49ef7fb41a8, cookie 0x85f5fa77adf3c5be 00002000:00100000:3.0:1787440272.686226:0:6695:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 792563a7-4c22-4ac7-ac25-d49ef7fb41a8/ffff8ee077eeb800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113940 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787440272.686256:0:6695:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787440272.686832:0:6695:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1787440272.686875:0:6695:0:(import.c:65:import_set_state_nolock()) ffff8ee077eed800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787440272.687018:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee047a78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+6:2359:x1874266681273728:12345-192.168.206.58@tcp:8:bash.0 Request processed in 951us (1147us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440272.687027:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 20 00000100:00100000:1.0:1787440272.690113:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440272.690259:0:9225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681273856 00000100:00100000:3.0:1787440272.690269:0:9225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681273856 00000100:00100000:3.0:1787440272.690353:0:9225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 21 00000100:00100000:3.0:1787440272.690364:0:9225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee077f40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+6:0:x1874266681273856:12345-192.168.206.58@tcp:101:bash.0 00010000:00010000:3.0:1787440272.690383:0:9225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440272.690407:0:9225:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001105f4f2/0x85f5fa77adf3c5c5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5fab14535dc6218b expref: -99 pid: 9225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787440272.690452:0:9225:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787440272.690471:0:9225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=371s v=(0 0) 00010000:00010000:3.0:1787440272.690476:0:9225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787440272.690485:0:9225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001105f4f2/0x85f5fa77adf3c5c5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6218b expref: 7 pid: 9225 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440272.690542:0:9225:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001105f4f2/0x85f5fa77adf3c5c5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6218b expref: 7 pid: 9225 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440272.690556:0:9225:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee049e95000, rc 0) 00000100:00100000:3.0:1787440272.690620:0:9225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee077f40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+7:0:x1874266681273856:12345-192.168.206.58@tcp:101:bash.0 Request processed in 255us (513us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440272.690629:0:9225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 21 00000100:00080000:2.0:1787440272.690722:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787440272.695562:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:2.0:1787440272.695665:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681273984 00000100:00100000:2.0:1787440272.695686:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681273984 00000100:00100000:2.0:1787440272.695771:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 22 00000100:00100000:2.0:1787440272.695781:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee077d79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+7:10299:x1874266681273984:12345-192.168.206.58@tcp:101:bash.0 00010000:00010000:2.0:1787440272.698769:0:6697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440272.698803:0:6697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000218ff76f/0x85f5fa77adf3c5cc lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5fab14535dc62192 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440272.698842:0:6697:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001105f4f2/0x85f5fa77adf3c5c5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6218b expref: 8 pid: 9225 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440272.698853:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787440272.698858:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787440272.698864:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000218ff76f/0x85f5fa77adf3c5cc lrc: 4/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62192 expref: 8 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440272.698914:0:6697:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001105f4f2/0x85f5fa77adf3c5c5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6218b expref: 8 pid: 9225 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440272.698933:0:6697:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001105f4f2/0x85f5fa77adf3c5c5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6218b expref: 8 pid: 9225 timeout: 471 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440272.698948:0:6697:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee047a79880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6697:1874266701232896:192.168.206.58@tcp:104: 00000100:00100000:2.0:1787440272.699094:0:6697:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee047c02f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787440272.705777:0:6697:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee047a79880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6697:1874266701232896:192.168.206.58@tcp:104: 00010000:00010000:2.0:1787440272.705817:0:6697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000218ff76f/0x85f5fa77adf3c5cc lrc: 3/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62192 expref: 8 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440272.705840:0:6697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee07f86f600, rc 0) 00000100:00100000:2.0:1787440272.705908:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee077d79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+8:10299:x1874266681273984:12345-192.168.206.58@tcp:101:bash.0 Request processed in 10128us (10723us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440272.705917:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 22 00000100:00100000:1.0:1787440272.710603:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440272.711536:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681274112 00000100:00100000:0.0:1787440272.711547:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681274112 00010000:00010000:0.0:1787440272.711590:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001105f4f2/0x85f5fa77adf3c5c5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6218b expref: 8 pid: 9225 timeout: 471 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440272.711643:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 35 00000100:00100000:0.0:1787440272.711654:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee077f40380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+8:2362:x1874266681274112:12345-192.168.206.58@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787440272.711669:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787440272.711753:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001105f4f2/0x85f5fa77adf3c5c5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6218b expref: 8 pid: 9225 timeout: 471 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440272.711787:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001105f4f2/0x85f5fa77adf3c5c5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6218b expref: 8 pid: 9225 timeout: 471 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440272.711811:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001105f4f2/0x85f5fa77adf3c5c5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6218b expref: 8 pid: 9225 timeout: 471 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440272.711828:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787440272.711832:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787440272.711841:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000218ff76f/0x85f5fa77adf3c5cc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62192 expref: 7 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440272.711852:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000218ff76f/0x85f5fa77adf3c5cc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62192 expref: 7 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440272.711899:0:5834:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000218ff76f/0x85f5fa77adf3c5cc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62192 expref: 7 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440272.711914:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee05d27c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5834:1874266701233024:192.168.206.58@tcp:105: 00000100:00100000:0.0:1787440272.711988:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee045f0ee40 going to sleep for 11 seconds 00000100:00100000:0.0:1787440272.726267:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:1.0:1787440272.726471:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681274368 00000100:00100000:1.0:1787440272.726480:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681274368 00000100:00100000:1.0:1787440272.726554:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 6 00000100:00100000:1.0:1787440272.726565:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04ca3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+13:10299:x1874266681274368:12345-192.168.206.58@tcp:35:bash.0 00000001:00080000:1.0:1787440272.727081:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967312 00000100:00100000:1.0:1787440272.727237:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04ca3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+15:10299:x1874266681274368:12345-192.168.206.58@tcp:35:bash.0 Request processed in 672us (977us total) trans 4294967313 rc 0/0 00000100:00100000:1.0:1787440272.727245:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 6 00000020:00080000:1.0:1787440272.727250:0:5852:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1787440272.730887:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee05d27c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5834:1874266701233024:192.168.206.58@tcp:105: 00010000:00010000:3.0:1787440272.730918:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787440272.730997:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee077f40380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+7:2362:x1874266681274112:12345-192.168.206.58@tcp:103:ldlm_bl.0 Request processed in 19344us (20402us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440272.731008:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 35 00000100:00100000:1.0:1787440272.797538:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee06e6cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874266701233152:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787440272.797613:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440272.798716:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701233152 00000100:00100000:0.0:1787440272.798730:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701233152 00000100:00100000:0.0:1787440272.798920:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787440272.798929:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04a65bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874266701233152:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787440272.798970:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1787440272.799289:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787440272.808994:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04a65bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874266701233152:12345-0@lo:13:osp-pre-0-0.0 Request processed in 10057us (11372us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440272.809017:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787440272.811823:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee06e6cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874266701233152:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787440272.883337:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440272.885625:0:6892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681274624 00000100:00100000:3.0:1787440272.885639:0:6892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681274624 00000100:00100000:3.0:1787440272.885745:0:6892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 41 00000100:00100000:3.0:1787440272.885756:0:6892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04ca38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+15:10309:x1874266681274624:12345-192.168.206.58@tcp:101:lfs.0 00010000:00010000:3.0:1787440272.885797:0:6892:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440272.885835:0:6892:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94e00/0x85f5fa77adf3c5d3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fab14535dc62199 expref: -99 pid: 6892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787440272.885980:0:6892:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:3.0:1787440272.886125:0:6892:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94e00/0x85f5fa77adf3c5d3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62199 expref: 17 pid: 6892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440272.886152:0:6892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ee054b3c600) 00010000:00010000:3.0:1787440272.886156:0:6892:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787440272.886161:0:6892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94e00/0x85f5fa77adf3c5d3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62199 expref: 17 pid: 6892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440272.886176:0:6892:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee049e94e00, rc 0) 00000100:00100000:3.0:1787440272.886284:0:6892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04ca38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+16:10309:x1874266681274624:12345-192.168.206.58@tcp:101:lfs.0 Request processed in 529us (2955us total) trans 4294967314 rc 301/301 00000100:00100000:3.0:1787440272.886292:0:6892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 41 00000100:00100000:1.0:1787440272.891045:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:2.0:1787440272.892005:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681274880 00000100:00100000:2.0:1787440272.892018:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681274880 00000100:00100000:2.0:1787440272.892076:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 7 00000100:00100000:2.0:1787440272.892085:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee0800a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+16:10309:x1874266681274880:12345-192.168.206.58@tcp:35:lfs.0 00000100:00100000:2.0:1787440272.892388:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee0800a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+17:10309:x1874266681274880:12345-192.168.206.58@tcp:35:lfs.0 Request processed in 302us (1352us total) trans 4294967315 rc 0/0 00000100:00100000:2.0:1787440272.892397:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 7 00000100:00100000:0.0:1787440273.002355:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:2.0:1787440273.002463:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681275008 00000100:00100000:2.0:1787440273.002473:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681275008 00000100:00100000:2.0:1787440273.002569:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 42 00000100:00100000:2.0:1787440273.002580:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04ca3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+17:10315:x1874266681275008:12345-192.168.206.58@tcp:101:lfs.0 00010000:00010000:2.0:1787440273.002602:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440273.002625:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86fc00/0x85f5fa77adf3c5e1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fab14535dc621a0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440273.002686:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f000/0x85f5fa77adf3c5e8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440273.002712:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f000/0x85f5fa77adf3c5e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440273.002735:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f000/0x85f5fa77adf3c5e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787440273.002806:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:2.0:1787440273.002810:0:5849:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787440273.002833:0:5849:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f000/0x85f5fa77adf3c5e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440273.002860:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86fc00/0x85f5fa77adf3c5e1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc621a0 expref: 19 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440273.002877:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f000/0x85f5fa77adf3c5e8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc621a0 expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440273.002895:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8ee0460ccd00) 00010000:00010000:2.0:1787440273.002898:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787440273.002901:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee07f86f000, rc 0) 00000100:00100000:2.0:1787440273.002966:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04ca3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+18:10315:x1874266681275008:12345-192.168.206.58@tcp:101:lfs.0 Request processed in 389us (619us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440273.002974:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 42 00000100:00100000:3.0:1787440273.018209:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440273.018377:0:6892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681275264 00000100:00100000:0.0:1787440273.018387:0:6892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681275264 00000100:00100000:0.0:1787440273.018445:0:6892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 43 00000100:00100000:0.0:1787440273.018456:0:6892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee06e6cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+18:10315:x1874266681275264:12345-192.168.206.58@tcp:101:lfs.0 00010000:00010000:0.0:1787440273.018475:0:6892:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440273.018534:0:6892:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce000/0x85f5fa77adf3c5ef lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fab14535dc621a7 expref: -99 pid: 6892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440273.018625:0:6892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf600/0x85f5fa77adf3c5f6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440273.018638:0:6892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf600/0x85f5fa77adf3c5f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440273.018649:0:6892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf600/0x85f5fa77adf3c5f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787440273.018660:0:6892:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1787440273.018781:0:6892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce000/0x85f5fa77adf3c5ef lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc621a7 expref: 21 pid: 6892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440273.018799:0:6892:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf600/0x85f5fa77adf3c5f6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc621a7 expref: 20 pid: 6892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440273.018825:0:6892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ee05132e500) 00010000:00010000:0.0:1787440273.018829:0:6892:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787440273.018832:0:6892:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee04cbcf600, rc 0) 00000100:00100000:0.0:1787440273.018944:0:6892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee06e6cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+20:10315:x1874266681275264:12345-192.168.206.58@tcp:101:lfs.0 Request processed in 489us (755us total) trans 4294967316 rc 0/0 00000100:00100000:0.0:1787440273.018951:0:6892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 43 00000100:00100000:0.0:1787440273.025943:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440273.026003:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:2.0:1787440273.026099:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681275648 00000100:00100000:2.0:1787440273.026108:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681275648 00000100:00100000:2.0:1787440273.026183:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 2 00000100:00100000:2.0:1787440273.026205:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04ca38380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+20:2361:x1874266681275648:12345-192.168.206.58@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787440273.026221:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787440273.026254:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf600/0x85f5fa77adf3c5f6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc621a7 expref: 20 pid: 6892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440273.026272:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ee05132e500) 00010000:00010000:2.0:1787440273.026278:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787440273.026337:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04ca38380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+19:2361:x1874266681275648:12345-192.168.206.58@tcp:103:ldlm_bl.0 Request processed in 145us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440273.026346:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 2 00000100:00100000:1.0:1787440273.027025:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681275520 00000100:00100000:1.0:1787440273.027032:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681275520 00000100:00100000:1.0:1787440273.027077:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 44 00000100:00100000:1.0:1787440273.027085:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04ca3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+19:10315:x1874266681275520:12345-192.168.206.58@tcp:101:lfs.0 00010000:00010000:1.0:1787440273.027105:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440273.027121:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9ee00/0x85f5fa77adf3c604 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fab14535dc621ae expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440273.027220:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e000/0x85f5fa77adf3c60b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440273.027240:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e000/0x85f5fa77adf3c60b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440273.027251:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e000/0x85f5fa77adf3c60b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787440273.027266:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1787440273.027386:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9ee00/0x85f5fa77adf3c604 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc621ae expref: 22 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440273.027403:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e000/0x85f5fa77adf3c60b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc621ae expref: 21 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440273.027411:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ee05132e500) 00010000:00010000:1.0:1787440273.027414:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787440273.027417:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee07fb9e000, rc 0) 00000100:00100000:1.0:1787440273.027469:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04ca3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+21:10315:x1874266681275520:12345-192.168.206.58@tcp:101:lfs.0 Request processed in 385us (1465us total) trans 4294967317 rc 0/0 00000100:00100000:1.0:1787440273.027476:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 44 00000100:00100000:0.0:1787440273.037430:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440273.037525:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681275776 00000100:00100000:3.0:1787440273.037534:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681275776 00000100:00100000:3.0:1787440273.037594:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 23 00000100:00100000:3.0:1787440273.037605:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04ca38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+7:2362:x1874266681275776:12345-192.168.206.58@tcp:1:lfs.0 00010000:00010000:3.0:1787440273.037646:0:6698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000000874a1b/0x85f5fa77adf3c619 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440273.037666:0:6698:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000218ff76f/0x85f5fa77adf3c5cc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62192 expref: 7 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440273.037675:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787440273.037693:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787440273.037699:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000000874a1b/0x85f5fa77adf3c619 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440273.038255:0:6698:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000218ff76f/0x85f5fa77adf3c5cc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62192 expref: 7 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440273.038274:0:6698:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000218ff76f/0x85f5fa77adf3c5cc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62192 expref: 7 pid: 6697 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440273.038292:0:6698:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee06e6cc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6698:1874266701233280:192.168.206.58@tcp:104: 00000100:00100000:3.0:1787440273.038413:0:6698:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee047d4ce40 going to sleep for 11 seconds 00000100:00100000:0.0:1787440273.045129:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:1.0:1787440273.045251:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681275904 00000100:00100000:1.0:1787440273.045261:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681275904 00002000:00100000:1.0:1787440273.045306:0:6701:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff8ee04ca3ad80 x1874266681275904/t0(0) o4->792563a7-4c22-4ac7-ac25-d49ef7fb41a8@192.168.206.58@tcp:434/0 lens 504/0 e 0 to 0 dl 1787440284 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787440273.045317:0:6701:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ee04ca3ad80 with x1874266681275904 ext(0->12) 00010000:00010000:1.0:1787440273.045335:0:6701:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000218ff76f/0x85f5fa77adf3c5cc lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62192 expref: 8 pid: 6697 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440273.045369:0:6701:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000218ff76f/0x85f5fa77adf3c5cc lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62192 expref: 8 pid: 6697 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787440273.045377:0:6701:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8ee04ca3ad80 00000100:00100000:1.0:1787440273.045408:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 0 00000100:00100000:1.0:1787440273.045416:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04ca3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+8:2363:x1874266681275904:12345-192.168.206.58@tcp:4:lfs.0 00000100:00100000:3.0:1787440273.048854:0:6698:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee06e6cc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6698:1874266701233280:192.168.206.58@tcp:104: 00010000:00010000:3.0:1787440273.048948:0:6698:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000000874a1b/0x85f5fa77adf3c619 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:2.0:1787440273.100599:0:6723:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 792563a7-4c22-4ac7-ac25-d49ef7fb41a8 00000100:00100000:0.0:1787440273.175606:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04ca3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+9:2363:x1874266681275904:12345-192.168.206.58@tcp:4:lfs.0 Request processed in 130181us (130477us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1787440273.175624:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 0 00002000:00100000:0.0:1787440273.175637:0:6701:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff8ee04ca3ad80 x1874266681275904/t4294967299(0) o4->792563a7-4c22-4ac7-ac25-d49ef7fb41a8@192.168.206.58@tcp:434/0 lens 504/448 e 0 to 0 dl 1787440284 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787440273.175646:0:6701:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ee04ca3ad80 with x1874266681275904 ext(0->12) 00010000:00010000:0.0:1787440273.175655:0:6701:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000218ff76f/0x85f5fa77adf3c5cc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62192 expref: 9 pid: 6697 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440273.175672:0:6701:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000218ff76f/0x85f5fa77adf3c5cc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62192 expref: 9 pid: 6697 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787440273.175679:0:6701:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8ee04ca3ad80 00000001:00080000:1.0:1787440273.178043:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000100:00100000:0.0:1787440273.178566:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:2.0:1787440273.178658:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681276032 00000100:00100000:2.0:1787440273.178667:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681276032 00010000:00010000:2.0:1787440273.178702:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000218ff76f/0x85f5fa77adf3c5cc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62192 expref: 7 pid: 6697 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440273.178745:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 36 00000100:00100000:2.0:1787440273.178754:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04ca39c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+7:2362:x1874266681276032:12345-192.168.206.58@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787440273.178771:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1787440273.178789:0:5836:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1787440273.178792:0:5836:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1787440273 00002000:00010000:2.0:1787440273.178794:0:5836:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb atime from disk: 0 -> 1787440273 00002000:00010000:2.0:1787440273.178796:0:5836:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1787440273 00002000:00010000:2.0:1787440273.178798:0:5836:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:2.0:1787440273.178804:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000218ff76f/0x85f5fa77adf3c5cc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62192 expref: 7 pid: 6697 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440273.178817:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000218ff76f/0x85f5fa77adf3c5cc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62192 expref: 7 pid: 6697 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440273.178854:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000218ff76f/0x85f5fa77adf3c5cc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62192 expref: 7 pid: 6697 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440273.178870:0:5836:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787440273.178875:0:5836:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787440273.178893:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000000874a1b/0x85f5fa77adf3c619 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440273.178902:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000000874a1b/0x85f5fa77adf3c619 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440273.178936:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787440273.178991:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04ca39c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+6:2362:x1874266681276032:12345-192.168.206.58@tcp:103:ldlm_bl.0 Request processed in 237us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440273.178999:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 36 00010000:00010000:0.0:1787440273.182268:0:6698:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000000874a1b/0x85f5fa77adf3c619 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440273.182288:0:6698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000000874a1b/0x85f5fa77adf3c619 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440273.182326:0:6698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000000874a1b/0x85f5fa77adf3c619 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440273.182335:0:6698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000000874a1b/0x85f5fa77adf3c619 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440273.182343:0:6698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000000874a1b/0x85f5fa77adf3c619 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440273.182350:0:6698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee049e94e00 already unused, calling callback (ffffffffc15b52a0) 00010000:00010000:0.0:1787440273.182355:0:6698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000000874a1b/0x85f5fa77adf3c619 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440273.182363:0:6698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000000874a1b/0x85f5fa77adf3c619 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440273.182381:0:6698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000000874a1b/0x85f5fa77adf3c619 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440273.182388:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000000874a1b/0x85f5fa77adf3c619 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440273.182565:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04ca38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+5:2362:x1874266681275776:12345-192.168.206.58@tcp:1:lfs.0 Request processed in 144958us (145139us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440273.182575:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 23 00000100:00100000:0.0:1787440273.186808:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:2.0:1787440273.186878:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681276288 00000100:00100000:2.0:1787440273.186889:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681276288 00000100:00100000:2.0:1787440273.186944:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 8 00000100:00100000:2.0:1787440273.186953:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04ca39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+21:10315:x1874266681276288:12345-192.168.206.58@tcp:35:lfs.0 00000004:00010000:2.0:1787440273.187014:0:5853:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e000/0x85f5fa77adf3c60b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc621ae expref: 21 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787440273.187311:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:2.0:1787440273.187361:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00000001:00080000:2.0:1787440273.188118:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00010000:00010000:2.0:1787440273.188179:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86fc00/0x85f5fa77adf3c620 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440273.188213:0:5853:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f000/0x85f5fa77adf3c5b0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62184 expref: 25 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440273.188221:0:5853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86fc00/0x85f5fa77adf3c620 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440273.188400:0:5853:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f000/0x85f5fa77adf3c5b0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62184 expref: 25 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440273.188416:0:5853:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f000/0x85f5fa77adf3c5b0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62184 expref: 25 pid: 5851 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440273.188429:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee047a79880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5853:1874266701233408:192.168.206.58@tcp:104: 00000100:00100000:2.0:1787440273.188598:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee047c02d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787440273.198175:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440273.198675:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681276416 00000100:00100000:0.0:1787440273.198689:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681276416 00010000:00010000:0.0:1787440273.198738:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f000/0x85f5fa77adf3c5b0 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62184 expref: 26 pid: 5851 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440273.198784:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 37 00000100:00100000:0.0:1787440273.198794:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee06e6cc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+26:2363:x1874266681276416:12345-192.168.206.58@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787440273.198809:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787440273.198816:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f000/0x85f5fa77adf3c5b0 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62184 expref: 26 pid: 5851 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440273.198830:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f000/0x85f5fa77adf3c5b0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62184 expref: 26 pid: 5851 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440273.198852:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ee05132e500) 00010000:00010000:0.0:1787440273.198857:0:5835:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86fc00/0x85f5fa77adf3c620 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440273.198867:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86fc00/0x85f5fa77adf3c620 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440273.198874:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86fc00/0x85f5fa77adf3c620 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440273.198907:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787440273.198982:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee06e6cc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+26:2363:x1874266681276416:12345-192.168.206.58@tcp:103:ldlm_bl.0 Request processed in 189us (820us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440273.198990:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 37 00010000:00010000:2.0:1787440273.200653:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f000/0x85f5fa77adf3c5b0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62184 expref: 25 pid: 5851 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440273.200691:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee047a79880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5853:1874266701233408:192.168.206.58@tcp:104: 00010000:00010000:2.0:1787440273.200725:0:5853:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86fc00/0x85f5fa77adf3c620 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440273.200737:0:5853:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86fc00/0x85f5fa77adf3c620 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440273.200757:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86fc00/0x85f5fa77adf3c620 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787440273.201029:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000001:00080000:2.0:1787440273.202092:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:2.0:1787440273.203185:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee047a79880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5853:1874266701233536:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787440273.203427:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440273.203487:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee047c026c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787440273.203673:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701233536 00000100:00100000:0.0:1787440273.203683:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701233536 00000100:00100000:0.0:1787440273.203741:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787440273.203751:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee047a7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5853:x1874266701233536:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787440273.203859:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee047a7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5853:x1874266701233536:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 110us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440273.203866:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787440273.204005:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee047a79880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5853:1874266701233536:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1787440273.204743:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00000100:00100000:3.0:1787440273.204825:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee06e6ce680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5853:1874266701233664:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1787440273.204871:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440273.204907:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee047d4c240 going to sleep for 11 seconds 00000100:00100000:0.0:1787440273.205052:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701233664 00000100:00100000:0.0:1787440273.205058:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701233664 00000100:00100000:0.0:1787440273.205086:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787440273.205093:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee06e6cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5853:x1874266701233664:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787440273.205327:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee06e6cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5853:x1874266701233664:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 234us (454us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1787440273.205334:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787440273.205607:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee06e6ce680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5853:1874266701233664:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1787440273.205664:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:3.0:1787440273.205704:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86fc00/0x85f5fa77adf3c620 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440273.205724:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86fc00/0x85f5fa77adf3c620 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440273.205731:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86fc00/0x85f5fa77adf3c620 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440273.205737:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee07f86fc00 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:3.0:1787440273.205742:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86fc00/0x85f5fa77adf3c620 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440273.205749:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86fc00/0x85f5fa77adf3c620 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440273.205763:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ee05132e500) 00010000:00010000:3.0:1787440273.205766:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1787440273.205770:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86fc00/0x85f5fa77adf3c620 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440273.205776:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86fc00/0x85f5fa77adf3c620 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787440273.205965:0:5853:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1787440273.206158:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:3.0:1787440273.206170:0:5853:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 371576676692ns, next at 372576674662ns, rc = 0 00000001:00080000:3.0:1787440273.206177:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967325 00010000:00010000:3.0:1787440273.206222:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ee05132e500) 00010000:00010000:3.0:1787440273.206225:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787440273.206232:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e000/0x85f5fa77adf3c60b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc621ae expref: 29 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440273.206585:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04ca39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+28:10315:x1874266681276288:12345-192.168.206.58@tcp:35:lfs.0 Request processed in 19632us (19786us total) trans 4294967326 rc 0/0 00000100:00100000:3.0:1787440273.206594:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 8 00000020:00080000:3.0:1787440273.206598:0:5853:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1787440273.211411:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440273.211535:0:6892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681276544 00000100:00100000:0.0:1787440273.211547:0:6892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681276544 00000100:00100000:0.0:1787440273.211610:0:6892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 45 00000100:00100000:0.0:1787440273.211620:0:6892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee06e6cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+28:10315:x1874266681276544:12345-192.168.206.58@tcp:101:lfs.0 00010000:00010000:0.0:1787440273.211649:0:6892:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440273.211675:0:6892:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcec00/0x85f5fa77adf3c627 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fab14535dc621b5 expref: -99 pid: 6892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440273.211779:0:6892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcec00/0x85f5fa77adf3c627 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc621b5 expref: 29 pid: 6892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440273.211794:0:6892:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcec00/0x85f5fa77adf3c627 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc621b5 expref: 29 pid: 6892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440273.211813:0:6892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ee050ca1800) 00010000:00010000:0.0:1787440273.211817:0:6892:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787440273.211821:0:6892:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee04cbcec00, rc 0) 00000100:00100000:0.0:1787440273.211894:0:6892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee06e6cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+29:10315:x1874266681276544:12345-192.168.206.58@tcp:101:lfs.0 Request processed in 275us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440273.211902:0:6892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 45 00000100:00100000:1.0:1787440273.217970:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440273.218217:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681276800 00000100:00100000:0.0:1787440273.218229:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681276800 00000100:00100000:0.0:1787440273.218296:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 9 00000100:00100000:0.0:1787440273.218308:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee079badc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+29:10315:x1874266681276800:12345-192.168.206.58@tcp:35:lfs.0 00000100:00100000:0.0:1787440273.218650:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee079badc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+30:10315:x1874266681276800:12345-192.168.206.58@tcp:35:lfs.0 Request processed in 343us (699us total) trans 4294967327 rc 0/0 00000100:00100000:0.0:1787440273.218659:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 9 00000100:00100000:1.0:1787440273.314825:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:2.0:1787440273.314989:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681277056 00000100:00100000:2.0:1787440273.315000:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681277056 00000100:00100000:2.0:1787440273.315058:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 46 00000100:00100000:2.0:1787440273.315068:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee0800a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+30:10325:x1874266681277056:12345-192.168.206.58@tcp:101:lfs.0 00010000:00010000:2.0:1787440273.315091:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440273.315113:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f600/0x85f5fa77adf3c62e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fab14535dc621bc expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787440273.315409:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:2.0:1787440273.315571:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f600/0x85f5fa77adf3c62e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc621bc expref: 32 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440273.315586:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ee054b3c600) 00010000:00010000:2.0:1787440273.315588:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787440273.315592:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f600/0x85f5fa77adf3c62e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc621bc expref: 32 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440273.315606:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee07f86f600, rc 0) 00000100:00100000:2.0:1787440273.315670:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee0800a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+31:10325:x1874266681277056:12345-192.168.206.58@tcp:101:lfs.0 Request processed in 604us (854us total) trans 4294967328 rc 301/301 00000100:00100000:2.0:1787440273.315677:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 46 00000100:00100000:1.0:1787440273.329797:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:2.0:1787440273.331061:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681277184 00000100:00100000:2.0:1787440273.331072:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681277184 00000100:00100000:2.0:1787440273.331145:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 47 00000100:00100000:2.0:1787440273.331167:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee0800a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+31:10325:x1874266681277184:12345-192.168.206.58@tcp:34:lfs.0 00010000:00010000:2.0:1787440273.331260:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f600/0x85f5fa77adf3c63c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440273.331276:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f600/0x85f5fa77adf3c63c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440273.331287:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f600/0x85f5fa77adf3c63c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440273.331339:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86fc00/0x85f5fa77adf3c643 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440273.331347:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86fc00/0x85f5fa77adf3c643 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440273.331353:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86fc00/0x85f5fa77adf3c643 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440273.331444:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e400/0x85f5fa77adf3c64a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440273.331453:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e400/0x85f5fa77adf3c64a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440273.331459:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e400/0x85f5fa77adf3c64a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787440273.331539:0:5850:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e400/0x85f5fa77adf3c64a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440273.331551:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f600/0x85f5fa77adf3c63c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440273.331563:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f600/0x85f5fa77adf3c63c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440273.331568:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f600/0x85f5fa77adf3c63c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440273.331573:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee07f86f600 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:2.0:1787440273.331577:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f600/0x85f5fa77adf3c63c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440273.331584:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f600/0x85f5fa77adf3c63c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440273.331595:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8ee0460ccd00) 00010000:00010000:2.0:1787440273.331597:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440273.331601:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f600/0x85f5fa77adf3c63c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440273.331606:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f600/0x85f5fa77adf3c63c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440273.331631:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86fc00/0x85f5fa77adf3c643 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440273.331636:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86fc00/0x85f5fa77adf3c643 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440273.331641:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86fc00/0x85f5fa77adf3c643 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440273.331646:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee07f86fc00 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:2.0:1787440273.331654:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86fc00/0x85f5fa77adf3c643 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440273.331659:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86fc00/0x85f5fa77adf3c643 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440273.331667:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8ee054b3cc00) 00010000:00010000:2.0:1787440273.331670:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440273.331672:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86fc00/0x85f5fa77adf3c643 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440273.331678:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86fc00/0x85f5fa77adf3c643 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440273.331693:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e400/0x85f5fa77adf3c64a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440273.331699:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e400/0x85f5fa77adf3c64a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440273.331705:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e400/0x85f5fa77adf3c64a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440273.331709:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee07f86e400 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:2.0:1787440273.331712:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e400/0x85f5fa77adf3c64a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440273.331717:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e400/0x85f5fa77adf3c64a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440273.331724:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ee050ca1800) 00010000:00010000:2.0:1787440273.331726:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440273.331734:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e400/0x85f5fa77adf3c64a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440273.331740:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e400/0x85f5fa77adf3c64a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440273.331811:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee0800a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+31:10325:x1874266681277184:12345-192.168.206.58@tcp:34:lfs.0 Request processed in 645us (2020us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440273.331818:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 47 00000100:00100000:1.0:1787440273.336348:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440273.336530:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681277440 00000100:00100000:0.0:1787440273.336539:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681277440 00000100:00100000:0.0:1787440273.336588:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 10 00000100:00100000:0.0:1787440273.336597:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee077ec1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+31:10325:x1874266681277440:12345-192.168.206.58@tcp:35:lfs.0 00000100:00100000:0.0:1787440273.336861:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee077ec1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+32:10325:x1874266681277440:12345-192.168.206.58@tcp:35:lfs.0 Request processed in 264us (520us total) trans 4294967329 rc 0/0 00000100:00100000:0.0:1787440273.336892:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 10 00000100:00100000:1.0:1787440273.409675:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440273.409765:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681277696 00000100:00100000:3.0:1787440273.409774:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681277696 00000100:00100000:3.0:1787440273.409835:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 48 00000100:00100000:3.0:1787440273.409844:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee077ec2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+32:10328:x1874266681277696:12345-192.168.206.58@tcp:101:lfs.0 00010000:00010000:3.0:1787440273.409867:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440273.409899:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94400/0x85f5fa77adf3c651 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fab14535dc621c3 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440273.409973:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94200/0x85f5fa77adf3c658 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440273.409987:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94200/0x85f5fa77adf3c658 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440273.410007:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94200/0x85f5fa77adf3c658 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440273.410024:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95c00/0x85f5fa77adf3c65f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440273.410031:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95c00/0x85f5fa77adf3c65f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440273.410037:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95c00/0x85f5fa77adf3c65f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440273.410175:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95a00/0x85f5fa77adf3c666 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440273.410184:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95a00/0x85f5fa77adf3c666 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440273.410208:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95a00/0x85f5fa77adf3c666 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787440273.410218:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1787440273.410311:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94200/0x85f5fa77adf3c658 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440273.410318:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94200/0x85f5fa77adf3c658 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440273.410324:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94200/0x85f5fa77adf3c658 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440273.410329:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee049e94200 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:3.0:1787440273.410334:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94200/0x85f5fa77adf3c658 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440273.410340:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94200/0x85f5fa77adf3c658 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440273.410687:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8ee0460ccd00) 00010000:00010000:3.0:1787440273.410692:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440273.410697:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94200/0x85f5fa77adf3c658 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440273.410713:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94200/0x85f5fa77adf3c658 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440273.410728:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95c00/0x85f5fa77adf3c65f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440273.410734:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95c00/0x85f5fa77adf3c65f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440273.410740:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95c00/0x85f5fa77adf3c65f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440273.410745:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee049e95c00 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:3.0:1787440273.410748:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95c00/0x85f5fa77adf3c65f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440273.410755:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95c00/0x85f5fa77adf3c65f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440273.410764:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8ee0460cc500) 00010000:00010000:3.0:1787440273.410766:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440273.410769:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95c00/0x85f5fa77adf3c65f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440273.410775:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95c00/0x85f5fa77adf3c65f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440273.410818:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94400/0x85f5fa77adf3c651 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc621c3 expref: 35 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440273.410832:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95a00/0x85f5fa77adf3c666 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc621c3 expref: 34 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440273.410846:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ee050ca1800) 00010000:00010000:3.0:1787440273.410848:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787440273.410851:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee049e95a00, rc 0) 00000100:00100000:3.0:1787440273.410921:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee077ec2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+34:10328:x1874266681277696:12345-192.168.206.58@tcp:101:lfs.0 Request processed in 1078us (1255us total) trans 4294967330 rc 0/0 00000100:00100000:3.0:1787440273.410929:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 48 00000100:00100000:1.0:1787440273.417430:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:2.0:1787440273.417615:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681277824 00000100:00100000:2.0:1787440273.417636:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681277824 00000100:00100000:2.0:1787440273.417696:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 49 00000100:00100000:2.0:1787440273.417706:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee077ec0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+34:10328:x1874266681277824:12345-192.168.206.58@tcp:54:lfs.0 00010000:00010000:2.0:1787440273.417771:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e400/0x85f5fa77adf3c674 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440273.417787:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e400/0x85f5fa77adf3c674 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440273.417798:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e400/0x85f5fa77adf3c674 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440273.417825:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e400/0x85f5fa77adf3c674 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440273.417832:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e400/0x85f5fa77adf3c674 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440273.417839:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e400/0x85f5fa77adf3c674 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440273.417845:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee07f86e400 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:2.0:1787440273.417863:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e400/0x85f5fa77adf3c674 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440273.417992:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e400/0x85f5fa77adf3c674 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440273.418016:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ee050ca1800) 00010000:00010000:2.0:1787440273.418019:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787440273.418022:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e400/0x85f5fa77adf3c674 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440273.418029:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e400/0x85f5fa77adf3c674 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440273.418773:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee077ec0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+34:10328:x1874266681277824:12345-192.168.206.58@tcp:54:lfs.0 Request processed in 1065us (1348us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440273.418783:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 49 00000100:00100000:1.0:1787440273.427841:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440273.434016:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681278080 00000100:00100000:0.0:1787440273.434037:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681278080 00000100:00100000:0.0:1787440273.434148:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 11 00000100:00100000:0.0:1787440273.434162:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee077ec2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+34:10328:x1874266681278080:12345-192.168.206.58@tcp:35:lfs.0 00000100:00100000:0.0:1787440273.434530:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee077ec2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+35:10328:x1874266681278080:12345-192.168.206.58@tcp:35:lfs.0 Request processed in 369us (6704us total) trans 4294967331 rc 0/0 00000100:00100000:0.0:1787440273.434540:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 11 00010000:00010000:2.0:1787440273.505653:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787440273.754390:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440273.754541:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681278336 00000100:00100000:3.0:1787440273.754555:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681278336 00000100:00100000:3.0:1787440273.754632:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 50 00000100:00100000:3.0:1787440273.754643:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee077ec0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+35:10359:x1874266681278336:12345-192.168.206.58@tcp:101:cat.0 00010000:00010000:3.0:1787440273.754673:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440273.754698:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94400/0x85f5fa77adf3c67b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fab14535dc621ca expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440273.754826:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95c00/0x85f5fa77adf3c682 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440273.754843:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95c00/0x85f5fa77adf3c682 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440273.754860:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95c00/0x85f5fa77adf3c682 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787440273.754886:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1787440273.755066:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94400/0x85f5fa77adf3c67b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc621ca expref: 38 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440273.755112:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95c00/0x85f5fa77adf3c682 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc621ca expref: 37 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440273.755123:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ee050ca1800) 00010000:00010000:3.0:1787440273.755126:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787440273.755130:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee049e95c00, rc 0) 00000100:00100000:3.0:1787440273.756529:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee077ec0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+37:10359:x1874266681278336:12345-192.168.206.58@tcp:101:cat.0 Request processed in 1875us (2140us total) trans 4294967332 rc 0/0 00000100:00100000:3.0:1787440273.756544:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 50 00000100:00100000:1.0:1787440273.760359:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440273.760455:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681278592 00000100:00100000:0.0:1787440273.760468:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681278592 00000100:00100000:0.0:1787440273.760569:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 12 00000100:00100000:0.0:1787440273.760581:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee077ec3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+37:10359:x1874266681278592:12345-192.168.206.58@tcp:35:cat.0 00000100:00100000:0.0:1787440273.760922:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee077ec3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+38:10359:x1874266681278592:12345-192.168.206.58@tcp:35:cat.0 Request processed in 342us (576us total) trans 4294967333 rc 0/0 00000100:00100000:0.0:1787440273.760931:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 12 00000100:00100000:1.0:1787440273.764664:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:2.0:1787440273.764757:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681278720 00000100:00100000:2.0:1787440273.764769:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681278720 00000100:00100000:2.0:1787440273.764854:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 3 00000100:00100000:2.0:1787440273.764867:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee06e7e5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+38:2363:x1874266681278720:12345-192.168.206.58@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787440273.764900:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787440273.764936:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95c00/0x85f5fa77adf3c682 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc621ca expref: 38 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440273.764959:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ee050ca1800) 00010000:00010000:2.0:1787440273.764965:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787440273.765044:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee06e7e5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+37:2363:x1874266681278720:12345-192.168.206.58@tcp:103:ldlm_bl.0 Request processed in 180us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440273.765074:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 3 00000100:00100000:0.0:1787440273.822166:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee06e6ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874266701233920:0@lo:400:kworker.0 00000100:00100000:0.0:1787440273.822274:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440273.822361:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee06e6cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874266701234432:0@lo:400:kworker.0 00000100:00100000:0.0:1787440273.822391:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440273.822429:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787440273.822436:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee06e6cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1874266701234048:0@lo:400:kworker.0 00000100:00100000:0.0:1787440273.822476:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440273.822550:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701233920 00000100:00100000:0.0:1787440273.822560:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701233920 00000100:00100000:0.0:1787440273.822630:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701234048 00000100:00100000:0.0:1787440273.822634:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701234048 00000100:00100000:0.0:1787440273.822673:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1787440273.822683:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04ca3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874266701233920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787440273.822750:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04ca3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874266701233920:12345-0@lo:400:kworker.0 Request processed in 68us (475us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440273.822758:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1787440273.822779:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1787440273.822787:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04ca38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1874266701234048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787440273.822817:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04ca38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1874266701234048:12345-0@lo:400:kworker.0 Request processed in 31us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440273.822823:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00080000:0.0:1787440273.822843:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787440273.822881:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee06e6cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1874266701234048:0@lo:400:kworker.0 00000100:00100000:0.0:1787440273.822893:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee06e6ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874266701233920:0@lo:400:kworker.0 00000100:00100000:1.0:1787440273.823184:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee06e6cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874266701234176:0@lo:400:kworker.0 00000100:00100000:1.0:1787440273.823238:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440273.823277:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787440273.823283:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee06e6cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:168176ea-29d1-49de-a254-317e90d54802:3311:1874266701233792:0@lo:400:kworker.0 00000100:00100000:1.0:1787440273.823316:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440273.823347:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee06e6cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1874266701234304:0@lo:400:kworker.0 00000100:00100000:1.0:1787440273.823371:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440273.823413:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701233792 00000100:00100000:1.0:1787440273.823418:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701233792 00000100:00100000:1.0:1787440273.823453:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:1.0:1787440273.823462:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04a698850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:168176ea-29d1-49de-a254-317e90d54802+19:3311:x1874266701233792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440273.823532:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04a698850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:168176ea-29d1-49de-a254-317e90d54802+19:3311:x1874266701233792:12345-0@lo:400:kworker.0 Request processed in 72us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440273.823539:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:1.0:1787440273.823580:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee06e6cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:168176ea-29d1-49de-a254-317e90d54802:3311:1874266701233792:0@lo:400:kworker.0 00000100:00100000:1.0:1787440273.823600:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701234304 00000100:00100000:1.0:1787440273.823604:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701234304 00000100:00100000:1.0:1787440273.823636:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1787440273.823642:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee077ec2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874266701234304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440273.823678:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee077ec2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874266701234304:12345-0@lo:400:kworker.0 Request processed in 36us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440273.823684:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00080000:1.0:1787440273.823701:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787440273.823719:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee06e6cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1874266701234304:0@lo:400:kworker.0 00000100:00100000:0.0:1787440273.824273:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701234432 00000100:00100000:0.0:1787440273.824281:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701234432 00000100:00100000:0.0:1787440273.824340:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701234176 00000100:00100000:0.0:1787440273.824344:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701234176 00000100:00100000:0.0:1787440273.824368:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787440273.824378:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04ca39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1874266701234432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787440273.824441:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04ca39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1874266701234432:12345-0@lo:400:kworker.0 Request processed in 66us (2048us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440273.824449:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787440273.824465:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787440273.824471:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee077ec0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3311:x1874266701234176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787440273.824559:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee077ec0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3311:x1874266701234176:12345-0@lo:400:kworker.0 Request processed in 88us (1320us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440273.824566:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787440273.824609:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee06e6cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874266701234176:0@lo:400:kworker.0 00000100:00100000:0.0:1787440273.824648:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee06e6cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874266701234432:0@lo:400:kworker.0 00000100:00080000:1.0:1787440273.825092:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787440273.836556:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440273.836786:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681278976 00000100:00100000:0.0:1787440273.836798:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681278976 00000100:00100000:0.0:1787440273.836878:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 51 00000100:00100000:0.0:1787440273.836890:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee077ec1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+37:10365:x1874266681278976:12345-192.168.206.58@tcp:101:dd.0 00010000:00010000:0.0:1787440273.836924:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440273.836929:0:5850:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787440273.836968:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f000/0x85f5fa77adf3c5e8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc621a0 expref: 37 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440273.836994:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8ee0460ccd00) 00010000:00010000:0.0:1787440273.836999:0:5850:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787440273.837098:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf400/0x85f5fa77adf3c690 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fab14535dc621d1 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440273.837252:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfa00/0x85f5fa77adf3c697 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440273.837268:0:5850:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95a00/0x85f5fa77adf3c666 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc621c3 expref: 37 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440273.837280:0:5850:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfa00/0x85f5fa77adf3c697 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440273.837344:0:5850:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95a00/0x85f5fa77adf3c666 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc621c3 expref: 37 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440273.837363:0:5850:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95a00/0x85f5fa77adf3c666 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc621c3 expref: 37 pid: 5851 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440273.837382:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee04ca3b480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5850:1874266701234560:192.168.206.58@tcp:104: 00000100:00100000:0.0:1787440273.837609:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee045f0ed80 going to sleep for 11 seconds 00000100:00100000:1.0:1787440273.842353:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:2.0:1787440273.842536:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681279104 00000100:00100000:2.0:1787440273.842548:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681279104 00010000:00010000:2.0:1787440273.842600:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95a00/0x85f5fa77adf3c666 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc621c3 expref: 38 pid: 5851 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440273.842646:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 38 00000100:00100000:2.0:1787440273.842658:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee077ec1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+38:2362:x1874266681279104:12345-192.168.206.58@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787440273.842679:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787440273.842688:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95a00/0x85f5fa77adf3c666 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc621c3 expref: 38 pid: 5851 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440273.842702:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95a00/0x85f5fa77adf3c666 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc621c3 expref: 38 pid: 5851 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440273.842733:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ee050ca1800) 00010000:00010000:2.0:1787440273.842738:0:5835:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfa00/0x85f5fa77adf3c697 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440273.842748:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfa00/0x85f5fa77adf3c697 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440273.842756:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfa00/0x85f5fa77adf3c697 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440273.842777:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787440273.842842:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee077ec1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+38:2362:x1874266681279104:12345-192.168.206.58@tcp:103:ldlm_bl.0 Request processed in 186us (504us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440273.842874:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 38 00010000:00010000:0.0:1787440273.844248:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95a00/0x85f5fa77adf3c666 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc621c3 expref: 37 pid: 5851 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440273.844275:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee04ca3b480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5850:1874266701234560:192.168.206.58@tcp:104: 00010000:00010000:0.0:1787440273.844303:0:5850:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfa00/0x85f5fa77adf3c697 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440273.844315:0:5850:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfa00/0x85f5fa77adf3c697 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440273.844322:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfa00/0x85f5fa77adf3c697 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787440273.844348:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1787440273.844601:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf400/0x85f5fa77adf3c690 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc621d1 expref: 38 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440273.844618:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfa00/0x85f5fa77adf3c697 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc621d1 expref: 37 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440273.844646:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ee050ca1800) 00010000:00010000:0.0:1787440273.844649:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787440273.844653:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee04cbcfa00, rc 0) 00000100:00100000:0.0:1787440273.844728:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee077ec1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+37:10365:x1874266681278976:12345-192.168.206.58@tcp:101:dd.0 Request processed in 7839us (8189us total) trans 4294967334 rc 0/0 00000100:00100000:0.0:1787440273.844738:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 51 00000100:00100000:1.0:1787440273.848661:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440273.848836:0:6892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681279360 00000100:00100000:3.0:1787440273.848848:0:6892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681279360 00000100:00100000:3.0:1787440273.848936:0:6892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 52 00000100:00100000:3.0:1787440273.848948:0:6892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee077ec0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+37:10365:x1874266681279360:12345-192.168.206.58@tcp:36:dd.0 00010000:00010000:3.0:1787440273.849476:0:6892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94400/0x85f5fa77adf3c6a5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440273.849555:0:6892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94400/0x85f5fa77adf3c6a5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440273.849571:0:6892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94400/0x85f5fa77adf3c6a5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787440273.849636:0:6892:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967335 00000004:00010000:3.0:1787440273.849663:0:6892:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000045ef340d reply state 00000000c1dd91d4 transno 4294967336 ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94400/0x85f5fa77adf3c6a5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440273.849674:0:6892:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787440273.849823:0:6892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee077ec0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+40:10365:x1874266681279360:12345-192.168.206.58@tcp:36:dd.0 Request processed in 875us (1172us total) trans 4294967336 rc 0/0 00000100:00100000:3.0:1787440273.849831:0:6892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 52 00000020:00080000:3.0:1787440273.849838:0:6892:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787440273.859594:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94400/0x85f5fa77adf3c6a5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440273.859619:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94400/0x85f5fa77adf3c6a5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440273.859628:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94400/0x85f5fa77adf3c6a5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440273.859634:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee049e94400 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:3.0:1787440273.859640:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94400/0x85f5fa77adf3c6a5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440273.859647:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94400/0x85f5fa77adf3c6a5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440273.859669:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ee050ca1800) 00010000:00010000:3.0:1787440273.859672:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440273.859677:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94400/0x85f5fa77adf3c6a5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440273.859683:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94400/0x85f5fa77adf3c6a5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440274.049454:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440274.049606:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681279488 00000100:00100000:0.0:1787440274.049620:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681279488 00000100:00100000:0.0:1787440274.049721:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 53 00000100:00100000:0.0:1787440274.049734:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee077ec3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+39:10380:x1874266681279488:12345-192.168.206.58@tcp:101:stat.0 00010000:00010000:0.0:1787440274.049767:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440274.049796:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf400/0x85f5fa77adf3c6ac lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fab14535dc621d8 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440274.049899:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcee00/0x85f5fa77adf3c6b3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440274.049916:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcee00/0x85f5fa77adf3c6b3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440274.049929:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcee00/0x85f5fa77adf3c6b3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440274.049947:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce800/0x85f5fa77adf3c6ba lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440274.049955:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce800/0x85f5fa77adf3c6ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440274.049986:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce800/0x85f5fa77adf3c6ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440274.050116:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfe00/0x85f5fa77adf3c6c1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440274.050129:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfa00/0x85f5fa77adf3c697 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc621d1 expref: 40 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440274.050151:0:5849:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfe00/0x85f5fa77adf3c6c1 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440274.050208:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfa00/0x85f5fa77adf3c697 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc621d1 expref: 40 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440274.050225:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfa00/0x85f5fa77adf3c697 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc621d1 expref: 40 pid: 5850 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440274.050243:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee04ca3b480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5849:1874266701234688:192.168.206.58@tcp:104: 00000100:00100000:0.0:1787440274.050372:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee045f0ec00 going to sleep for 11 seconds 00000100:00080000:1.0:1787440274.050791:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787440274.055869:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:1.0:1787440274.056040:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681279744 00000100:00100000:1.0:1787440274.056051:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681279744 00000100:00100000:1.0:1787440274.056125:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 13 00000100:00100000:1.0:1787440274.056146:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee047a79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+41:5600:x1874266681279744:12345-192.168.206.58@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1787440274.056671:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee047a79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+42:5600:x1874266681279744:12345-192.168.206.58@tcp:35:ldlm_bl.0 Request processed in 534us (813us total) trans 4294967337 rc 0/0 00000100:00100000:1.0:1787440274.056681:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 13 00000100:00100000:0.0:1787440274.057596:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee04ca3b480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5849:1874266701234688:192.168.206.58@tcp:104: 00010000:00010000:0.0:1787440274.057632:0:5849:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfe00/0x85f5fa77adf3c6c1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440274.061460:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:2.0:1787440274.061662:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681279872 00000100:00100000:2.0:1787440274.061676:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681279872 00010000:00010000:2.0:1787440274.061729:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfa00/0x85f5fa77adf3c697 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc621d1 expref: 42 pid: 5850 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440274.061777:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 39 00000100:00100000:2.0:1787440274.061788:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee06e6cd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+42:2362:x1874266681279872:12345-192.168.206.58@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787440274.061808:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787440274.061816:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfa00/0x85f5fa77adf3c697 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc621d1 expref: 42 pid: 5850 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440274.061832:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfa00/0x85f5fa77adf3c697 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc621d1 expref: 42 pid: 5850 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440274.061859:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfa00/0x85f5fa77adf3c697 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc621d1 expref: 42 pid: 5850 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440274.061889:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ee050ca1800) 00010000:00010000:2.0:1787440274.061895:0:5836:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfe00/0x85f5fa77adf3c6c1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440274.061906:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfe00/0x85f5fa77adf3c6c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440274.061914:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfe00/0x85f5fa77adf3c6c1 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440274.061958:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787440274.062033:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee06e6cd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+41:2362:x1874266681279872:12345-192.168.206.58@tcp:103:ldlm_bl.0 Request processed in 246us (600us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440274.062043:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 39 00010000:00010000:0.0:1787440274.062810:0:5849:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfe00/0x85f5fa77adf3c6c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440274.062823:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfe00/0x85f5fa77adf3c6c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787440274.062907:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1787440274.062912:0:5849:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787440274.062978:0:5849:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfe00/0x85f5fa77adf3c6c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440274.062995:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfe00/0x85f5fa77adf3c6c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440274.063005:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcee00/0x85f5fa77adf3c6b3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440274.063011:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcee00/0x85f5fa77adf3c6b3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440274.063018:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcee00/0x85f5fa77adf3c6b3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440274.063024:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee04cbcee00 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:0.0:1787440274.063028:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcee00/0x85f5fa77adf3c6b3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440274.063036:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcee00/0x85f5fa77adf3c6b3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440274.063048:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8ee0460ccd00) 00010000:00010000:0.0:1787440274.063050:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440274.063054:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcee00/0x85f5fa77adf3c6b3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440274.063060:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcee00/0x85f5fa77adf3c6b3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440274.063083:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce800/0x85f5fa77adf3c6ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440274.063089:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce800/0x85f5fa77adf3c6ba lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440274.063094:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce800/0x85f5fa77adf3c6ba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440274.063099:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee04cbce800 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:0.0:1787440274.063102:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce800/0x85f5fa77adf3c6ba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440274.063107:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce800/0x85f5fa77adf3c6ba lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440274.063113:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8ee050ca1c00) 00010000:00010000:0.0:1787440274.063115:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440274.063118:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce800/0x85f5fa77adf3c6ba lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440274.063123:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce800/0x85f5fa77adf3c6ba lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440274.063178:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf400/0x85f5fa77adf3c6ac lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc621d8 expref: 41 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440274.063202:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfe00/0x85f5fa77adf3c6c1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc621d8 expref: 40 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440274.063222:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ee050ca1800) 00010000:00010000:0.0:1787440274.063224:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787440274.063227:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee04cbcfe00, rc 0) 00000100:00100000:0.0:1787440274.063287:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee077ec3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+40:10380:x1874266681279488:12345-192.168.206.58@tcp:101:stat.0 Request processed in 13555us (13848us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440274.063295:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 53 00000100:00100000:3.0:1787440274.128551:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440274.128681:0:6892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681280128 00000100:00100000:0.0:1787440274.128695:0:6892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681280128 00000100:00100000:0.0:1787440274.128769:0:6892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 54 00000100:00100000:0.0:1787440274.128782:0:6892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee06e6cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+40:10386:x1874266681280128:12345-192.168.206.58@tcp:36:truncate.0 00010000:00010000:0.0:1787440274.128860:0:6892:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787440274.128896:0:6892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfe00/0x85f5fa77adf3c6c1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc621d8 expref: 40 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440274.128918:0:6892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ee050ca1800) 00010000:00010000:0.0:1787440274.128924:0:6892:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787440274.129178:0:6892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf400/0x85f5fa77adf3c6c8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440274.129207:0:6892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf400/0x85f5fa77adf3c6c8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440274.129218:0:6892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf400/0x85f5fa77adf3c6c8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787440274.129275:0:6892:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967338 00000004:00010000:0.0:1787440274.129303:0:6892:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f4f88efd reply state 00000000c1371050 transno 4294967339 ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf400/0x85f5fa77adf3c6c8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440274.129329:0:6892:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787440274.129464:0:6892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee06e6cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+42:10386:x1874266681280128:12345-192.168.206.58@tcp:36:truncate.0 Request processed in 683us (974us total) trans 4294967339 rc 0/0 00000100:00100000:0.0:1787440274.129472:0:6892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 54 00000020:00080000:0.0:1787440274.129477:0:6892:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787440274.132883:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf400/0x85f5fa77adf3c6c8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440274.132930:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf400/0x85f5fa77adf3c6c8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440274.132938:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf400/0x85f5fa77adf3c6c8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440274.132946:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee04cbcf400 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:3.0:1787440274.132952:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf400/0x85f5fa77adf3c6c8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440274.132961:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf400/0x85f5fa77adf3c6c8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440274.132985:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ee050ca1800) 00010000:00010000:3.0:1787440274.132989:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440274.132995:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf400/0x85f5fa77adf3c6c8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440274.133002:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf400/0x85f5fa77adf3c6c8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440274.272736:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:2.0:1787440274.272869:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681280256 00000100:00100000:2.0:1787440274.272882:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681280256 00000100:00100000:2.0:1787440274.272959:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 55 00000100:00100000:2.0:1787440274.272972:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee06e6cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+41:10400:x1874266681280256:12345-192.168.206.58@tcp:101:stat.0 00010000:00010000:2.0:1787440274.273007:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440274.273034:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e200/0x85f5fa77adf3c6cf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fab14535dc621df expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440274.273118:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86fe00/0x85f5fa77adf3c6d6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440274.273135:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86fe00/0x85f5fa77adf3c6d6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440274.273149:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86fe00/0x85f5fa77adf3c6d6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440274.273166:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e600/0x85f5fa77adf3c6dd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440274.273173:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e600/0x85f5fa77adf3c6dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440274.273180:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e600/0x85f5fa77adf3c6dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440274.273338:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86ec00/0x85f5fa77adf3c6e4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440274.273349:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86ec00/0x85f5fa77adf3c6e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440274.273356:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86ec00/0x85f5fa77adf3c6e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787440274.273403:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:2.0:1787440274.273408:0:5850:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787440274.273436:0:5850:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86ec00/0x85f5fa77adf3c6e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440274.273451:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86ec00/0x85f5fa77adf3c6e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440274.273460:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86fe00/0x85f5fa77adf3c6d6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440274.273467:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86fe00/0x85f5fa77adf3c6d6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440274.273474:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86fe00/0x85f5fa77adf3c6d6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440274.273481:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee07f86fe00 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:2.0:1787440274.273486:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86fe00/0x85f5fa77adf3c6d6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440274.273533:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86fe00/0x85f5fa77adf3c6d6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440274.273555:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8ee0460ccd00) 00010000:00010000:2.0:1787440274.273558:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440274.274723:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86fe00/0x85f5fa77adf3c6d6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440274.274740:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86fe00/0x85f5fa77adf3c6d6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440274.274764:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e600/0x85f5fa77adf3c6dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440274.274771:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e600/0x85f5fa77adf3c6dd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440274.274778:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e600/0x85f5fa77adf3c6dd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440274.274785:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee07f86e600 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:2.0:1787440274.274789:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e600/0x85f5fa77adf3c6dd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440274.274797:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e600/0x85f5fa77adf3c6dd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440274.274812:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8ee054b3cc00) 00010000:00010000:2.0:1787440274.274815:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440274.274820:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e600/0x85f5fa77adf3c6dd lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440274.274825:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e600/0x85f5fa77adf3c6dd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440274.274906:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e200/0x85f5fa77adf3c6cf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc621df expref: 43 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440274.274923:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86ec00/0x85f5fa77adf3c6e4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc621df expref: 42 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440274.274931:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ee050ca1800) 00010000:00010000:2.0:1787440274.274933:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787440274.274936:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee07f86ec00, rc 0) 00000100:00100000:2.0:1787440274.275038:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee06e6cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+42:10400:x1874266681280256:12345-192.168.206.58@tcp:101:stat.0 Request processed in 2066us (2314us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440274.275047:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 55 00000100:00100000:2.0:1787440274.332816:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee06e6cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1874266701234816:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787440274.332904:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440274.333175:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701234816 00000100:00100000:3.0:1787440274.333196:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701234816 00000100:00100000:3.0:1787440274.333265:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787440274.333276:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee079914380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874266701234816:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787440274.333321:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787440274.333382:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee079914380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874266701234816:12345-0@lo:13:osp-pre-1-0.0 Request processed in 108us (477us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440274.333408:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787440274.333767:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee06e6cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1874266701234816:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787440274.386774:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440274.386897:0:6892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681280512 00000100:00100000:0.0:1787440274.386907:0:6892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681280512 00000100:00100000:0.0:1787440274.386963:0:6892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 56 00000100:00100000:0.0:1787440274.386974:0:6892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee06e6cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+42:10410:x1874266681280512:12345-192.168.206.58@tcp:101:lfs.0 00010000:00010000:0.0:1787440274.386992:0:6892:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440274.387010:0:6892:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfe00/0x85f5fa77adf3c6eb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fab14535dc621e6 expref: -99 pid: 6892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787440274.387240:0:6892:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:0.0:1787440274.387466:0:6892:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfe00/0x85f5fa77adf3c6eb lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc621e6 expref: 44 pid: 6892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440274.387481:0:6892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ee054b3c600) 00010000:00010000:0.0:1787440274.387484:0:6892:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787440274.387489:0:6892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfe00/0x85f5fa77adf3c6eb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc621e6 expref: 44 pid: 6892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440274.387525:0:6892:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee04cbcfe00, rc 0) 00000100:00100000:0.0:1787440274.387580:0:6892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee06e6cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+43:10410:x1874266681280512:12345-192.168.206.58@tcp:101:lfs.0 Request processed in 608us (814us total) trans 4294967340 rc 301/301 00000100:00100000:0.0:1787440274.387588:0:6892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 56 00000100:00100000:1.0:1787440274.391384:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440274.391468:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681280768 00000100:00100000:0.0:1787440274.391476:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681280768 00000100:00100000:0.0:1787440274.391541:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 14 00000100:00100000:0.0:1787440274.391551:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee077ec1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+43:10410:x1874266681280768:12345-192.168.206.58@tcp:35:lfs.0 00000100:00100000:0.0:1787440274.391951:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee077ec1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+44:10410:x1874266681280768:12345-192.168.206.58@tcp:35:lfs.0 Request processed in 400us (574us total) trans 4294967341 rc 0/0 00000100:00100000:0.0:1787440274.391960:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 14 00000001:00080000:2.0:1787440274.406830:0:5871:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967339 is committed 00000004:00080000:2.0:1787440274.406954:0:5871:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:3.0:1787440274.407221:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787440274.407240:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee077ec0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1874266701234944:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1787440274.407306:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440274.407414:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701234944 00000100:00100000:1.0:1787440274.407420:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701234944 00000100:00100000:1.0:1787440274.407556:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787440274.407565:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee06e6cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3312:x1874266701234944:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1787440274.407590:0:6697:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:1.0:1787440274.407622:0:6697:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 13, mtime: 0x6a8a2c91, atime: 0x6a8a2c91, ctime: 0x6a8a2c91, blocks: 0xb 00010000:00010000:1.0:1787440274.407630:0:6697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e413252f/0x85f5fa77adf3c6f9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440274.407644:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=372s v=(0 0) 00010000:00010000:1.0:1787440274.407648:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787440274.407655:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e413252f/0x85f5fa77adf3c6f9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440274.407673:0:6697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e413252f/0x85f5fa77adf3c6f9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440274.407683:0:6697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e413252f/0x85f5fa77adf3c6f9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440274.407691:0:6697:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e413252f/0x85f5fa77adf3c6f9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440274.407793:0:6697:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00080000:3.0:1787440274.408299:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787440274.408310:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787440274.408315:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e413252f/0x85f5fa77adf3c6f9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440274.408323:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee07fb9ea00 already unused, calling callback (ffffffffc15b52a0) 00010000:00010000:3.0:1787440274.408327:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e413252f/0x85f5fa77adf3c6f9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440274.408336:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e413252f/0x85f5fa77adf3c6f9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440274.408351:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e413252f/0x85f5fa77adf3c6f9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440274.408357:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e413252f/0x85f5fa77adf3c6f9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440274.408372:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787440274.408374:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787440274.408375:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787440274.409298:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee06e6cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3312:x1874266701234944:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1729us (1987us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1787440274.409308:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000020:00080000:2.0:1787440274.409481:0:5871:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8ee047d4c180 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:2.0:1787440274.409487:0:5871:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8ee05077b400 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8ee047d4cb40 00000020:00080000:2.0:1787440274.409516:0:5871:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8ee05077ba00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8ee0413ae800 00000004:00080000:3.0:1787440274.409723:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8ee077ec0e00/2, rc 0, transno 4294967301 00000100:00100000:3.0:1787440274.409739:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee077ec0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1874266701234944:0@lo:6:osp-syn-0-0.0 00000020:00080000:0.0:1787440274.409847:0:5882:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:0.0:1787440274.409931:0:5882:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:0.0:1787440274.446627:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:1.0:1787440274.446758:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681281024 00000100:00100000:1.0:1787440274.446767:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681281024 00000100:00100000:1.0:1787440274.446840:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 57 00000100:00100000:1.0:1787440274.446850:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04ca3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+13:10416:x1874266681281024:12345-192.168.206.58@tcp:101:bash.0 00010000:00010000:1.0:1787440274.447041:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440274.447069:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9ee00/0x85f5fa77adf3c700 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fab14535dc621ed expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440274.447156:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fa00/0x85f5fa77adf3c707 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440274.447174:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86ec00/0x85f5fa77adf3c6e4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc621df expref: 14 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440274.447183:0:5849:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fa00/0x85f5fa77adf3c707 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440274.447225:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86ec00/0x85f5fa77adf3c6e4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc621df expref: 14 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440274.447238:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86ec00/0x85f5fa77adf3c6e4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc621df expref: 14 pid: 5850 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440274.447268:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee077ec3100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5849:1874266701235072:192.168.206.58@tcp:104: 00000100:00100000:1.0:1787440274.447362:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee080569900 going to sleep for 11 seconds 00000100:00100000:2.0:1787440274.453819:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440274.454057:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681281152 00000100:00100000:0.0:1787440274.454066:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681281152 00010000:00010000:0.0:1787440274.454102:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86ec00/0x85f5fa77adf3c6e4 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc621df expref: 15 pid: 5850 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440274.454138:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 40 00000100:00100000:0.0:1787440274.454146:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee079916680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+15:2363:x1874266681281152:12345-192.168.206.58@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787440274.454159:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787440274.454165:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86ec00/0x85f5fa77adf3c6e4 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc621df expref: 15 pid: 5850 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440274.454178:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86ec00/0x85f5fa77adf3c6e4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc621df expref: 15 pid: 5850 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440274.454209:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ee050ca1800) 00010000:00010000:0.0:1787440274.454214:0:5835:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fa00/0x85f5fa77adf3c707 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440274.454240:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fa00/0x85f5fa77adf3c707 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440274.454247:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fa00/0x85f5fa77adf3c707 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440274.454263:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787440274.454315:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee079916680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+15:2363:x1874266681281152:12345-192.168.206.58@tcp:103:ldlm_bl.0 Request processed in 169us (505us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440274.454322:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 40 00010000:00010000:1.0:1787440274.454786:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86ec00/0x85f5fa77adf3c6e4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc621df expref: 14 pid: 5850 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440274.454865:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee077ec3100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5849:1874266701235072:192.168.206.58@tcp:104: 00010000:00010000:1.0:1787440274.454888:0:5849:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fa00/0x85f5fa77adf3c707 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440274.455792:0:5849:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fa00/0x85f5fa77adf3c707 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440274.455810:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fa00/0x85f5fa77adf3c707 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787440274.455842:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:3.0:1787440274.456155:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9ee00/0x85f5fa77adf3c700 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc621ed expref: 15 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440274.456179:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fa00/0x85f5fa77adf3c707 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc621ed expref: 14 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440274.456201:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ee050ca1800) 00010000:00010000:3.0:1787440274.456204:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787440274.456208:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee07fb9fa00, rc 0) 00000100:00100000:3.0:1787440274.456296:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04ca3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+14:10416:x1874266681281024:12345-192.168.206.58@tcp:101:bash.0 Request processed in 9446us (9676us total) trans 4294967342 rc 0/0 00000100:00100000:3.0:1787440274.456306:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 57 00000100:00100000:2.0:1787440274.462815:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440274.462943:0:6892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681281408 00000100:00100000:0.0:1787440274.462957:0:6892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681281408 00000100:00100000:0.0:1787440274.463028:0:6892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 58 00000100:00100000:0.0:1787440274.463041:0:6892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee077f40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+14:10416:x1874266681281408:12345-192.168.206.58@tcp:36:bash.0 00010000:00010000:0.0:1787440274.463417:0:6892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfe00/0x85f5fa77adf3c715 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440274.463436:0:6892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfe00/0x85f5fa77adf3c715 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440274.463449:0:6892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfe00/0x85f5fa77adf3c715 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787440274.463549:0:6892:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967343 00000004:00010000:0.0:1787440274.463575:0:6892:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000030140cce reply state 0000000088b2e024 transno 4294967344 ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfe00/0x85f5fa77adf3c715 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440274.463584:0:6892:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787440274.463688:0:6892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee077f40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+17:10416:x1874266681281408:12345-192.168.206.58@tcp:36:bash.0 Request processed in 650us (887us total) trans 4294967344 rc 0/0 00000100:00100000:0.0:1787440274.463713:0:6892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 58 00000020:00080000:0.0:1787440274.463719:0:6892:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787440274.466481:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfe00/0x85f5fa77adf3c715 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440274.466528:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfe00/0x85f5fa77adf3c715 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440274.466537:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfe00/0x85f5fa77adf3c715 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440274.466544:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee04cbcfe00 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:3.0:1787440274.466567:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfe00/0x85f5fa77adf3c715 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440274.466575:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfe00/0x85f5fa77adf3c715 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440274.466598:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ee050ca1800) 00010000:00010000:3.0:1787440274.466601:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440274.466606:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfe00/0x85f5fa77adf3c715 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440274.466613:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfe00/0x85f5fa77adf3c715 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440274.471233:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440274.471343:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681281536 00000100:00100000:0.0:1787440274.471358:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681281536 00000100:00100000:0.0:1787440274.471424:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 59 00000100:00100000:0.0:1787440274.471448:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee05fb63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+16:10416:x1874266681281536:12345-192.168.206.58@tcp:101:bash.0 00010000:00010000:0.0:1787440274.471473:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440274.471916:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcee00/0x85f5fa77adf3c71c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fab14535dc621f4 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440274.472015:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce200/0x85f5fa77adf3c723 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440274.472029:0:5850:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fa00/0x85f5fa77adf3c707 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc621ed expref: 17 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440274.472038:0:5850:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce200/0x85f5fa77adf3c723 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440274.472068:0:5850:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fa00/0x85f5fa77adf3c707 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc621ed expref: 17 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440274.472081:0:5850:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fa00/0x85f5fa77adf3c707 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc621ed expref: 17 pid: 5849 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440274.472094:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee04ca39180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5850:1874266701235200:192.168.206.58@tcp:104: 00000100:00100000:0.0:1787440274.472176:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee045f0e3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787440274.475889:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440274.475993:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681281664 00000100:00100000:3.0:1787440274.476006:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681281664 00010000:00010000:3.0:1787440274.476048:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fa00/0x85f5fa77adf3c707 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc621ed expref: 18 pid: 5849 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440274.476096:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 41 00000100:00100000:3.0:1787440274.476108:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee05fb62300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+18:2362:x1874266681281664:12345-192.168.206.58@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787440274.476123:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787440274.476130:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fa00/0x85f5fa77adf3c707 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc621ed expref: 18 pid: 5849 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440274.476154:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fa00/0x85f5fa77adf3c707 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc621ed expref: 18 pid: 5849 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440274.476161:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee04ca39180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5850:1874266701235200:192.168.206.58@tcp:104: 00010000:00010000:3.0:1787440274.476183:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fa00/0x85f5fa77adf3c707 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc621ed expref: 18 pid: 5849 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440274.476212:0:5850:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce200/0x85f5fa77adf3c723 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440274.476249:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ee050ca1800) 00010000:00010000:3.0:1787440274.476257:0:5836:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce200/0x85f5fa77adf3c723 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440274.476267:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce200/0x85f5fa77adf3c723 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440274.476274:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce200/0x85f5fa77adf3c723 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440274.476304:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787440274.476365:0:5850:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce200/0x85f5fa77adf3c723 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440274.476366:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee05fb62300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+17:2362:x1874266681281664:12345-192.168.206.58@tcp:103:ldlm_bl.0 Request processed in 260us (492us total) trans 0 rc 0/0 00010000:00010000:0.0:1787440274.476394:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce200/0x85f5fa77adf3c723 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440274.476395:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 41 00000004:00200000:0.0:1787440274.476480:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1787440274.476486:0:5850:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787440274.476541:0:5850:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce200/0x85f5fa77adf3c723 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440274.476591:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcee00/0x85f5fa77adf3c71c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc621f4 expref: 17 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440274.476613:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce200/0x85f5fa77adf3c723 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc621f4 expref: 16 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440274.476624:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ee050ca1800) 00010000:00010000:0.0:1787440274.476627:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787440274.476631:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee04cbce200, rc 0) 00000100:00100000:0.0:1787440274.476682:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee05fb63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+16:10416:x1874266681281536:12345-192.168.206.58@tcp:101:bash.0 Request processed in 5249us (5464us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440274.476691:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 59 00000100:00100000:1.0:1787440274.483073:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440274.483163:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681281920 00000100:00100000:0.0:1787440274.483173:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681281920 00000100:00100000:0.0:1787440274.483239:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 15 00000100:00100000:0.0:1787440274.483260:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee079bac450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+16:10416:x1874266681281920:12345-192.168.206.58@tcp:35:bash.0 00000100:00100000:0.0:1787440274.483552:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee079bac450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+17:10416:x1874266681281920:12345-192.168.206.58@tcp:35:bash.0 Request processed in 293us (487us total) trans 4294967345 rc 0/0 00000100:00100000:0.0:1787440274.483559:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 15 00010000:00010000:2.0:1787440274.531102:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787440274.587576:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440274.587757:0:6892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681282176 00000100:00100000:0.0:1787440274.587771:0:6892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681282176 00000100:00100000:0.0:1787440274.587853:0:6892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 60 00000100:00100000:0.0:1787440274.587865:0:6892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee05fb63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+17:10426:x1874266681282176:12345-192.168.206.58@tcp:101:lfs.0 00010000:00010000:0.0:1787440274.587888:0:6892:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440274.587910:0:6892:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcee00/0x85f5fa77adf3c72a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fab14535dc621fb expref: -99 pid: 6892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787440274.588155:0:6892:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:0.0:1787440274.588345:0:6892:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcee00/0x85f5fa77adf3c72a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc621fb expref: 19 pid: 6892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440274.588361:0:6892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ee054b3c600) 00010000:00010000:0.0:1787440274.588364:0:6892:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787440274.588369:0:6892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcee00/0x85f5fa77adf3c72a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc621fb expref: 19 pid: 6892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440274.588381:0:6892:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee04cbcee00, rc 0) 00000100:00100000:0.0:1787440274.588725:0:6892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee05fb63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+18:10426:x1874266681282176:12345-192.168.206.58@tcp:101:lfs.0 Request processed in 863us (1161us total) trans 4294967346 rc 301/301 00000100:00100000:0.0:1787440274.588734:0:6892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 60 00000100:00100000:2.0:1787440274.607807:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440274.607889:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681282304 00000100:00100000:3.0:1787440274.607899:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681282304 00000100:00100000:3.0:1787440274.607961:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 61 00000100:00100000:3.0:1787440274.607971:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee05fb60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+18:10426:x1874266681282304:12345-192.168.206.58@tcp:34:lfs.0 00010000:00010000:3.0:1787440274.608044:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94400/0x85f5fa77adf3c738 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440274.608061:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94400/0x85f5fa77adf3c738 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440274.608072:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94400/0x85f5fa77adf3c738 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440274.608087:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94200/0x85f5fa77adf3c73f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440274.608119:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94200/0x85f5fa77adf3c73f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440274.608127:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94200/0x85f5fa77adf3c73f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440274.610853:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95a00/0x85f5fa77adf3c746 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440274.610872:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95a00/0x85f5fa77adf3c746 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440274.610883:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95a00/0x85f5fa77adf3c746 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787440274.611610:0:5849:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95a00/0x85f5fa77adf3c746 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440274.611631:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94400/0x85f5fa77adf3c738 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440274.611638:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94400/0x85f5fa77adf3c738 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440274.611645:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94400/0x85f5fa77adf3c738 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440274.611651:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee049e94400 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:3.0:1787440274.611655:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94400/0x85f5fa77adf3c738 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440274.611663:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94400/0x85f5fa77adf3c738 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440274.611688:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8ee0460ccd00) 00010000:00010000:3.0:1787440274.611691:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440274.611696:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94400/0x85f5fa77adf3c738 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440274.611702:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94400/0x85f5fa77adf3c738 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440274.611716:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94200/0x85f5fa77adf3c73f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440274.611722:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94200/0x85f5fa77adf3c73f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440274.612341:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94200/0x85f5fa77adf3c73f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440274.612352:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee049e94200 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:3.0:1787440274.612356:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94200/0x85f5fa77adf3c73f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440274.612362:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94200/0x85f5fa77adf3c73f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440274.612373:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8ee0460cca00) 00010000:00010000:3.0:1787440274.612375:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440274.612379:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94200/0x85f5fa77adf3c73f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440274.612385:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94200/0x85f5fa77adf3c73f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440274.612417:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95a00/0x85f5fa77adf3c746 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440274.612423:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95a00/0x85f5fa77adf3c746 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440274.612428:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95a00/0x85f5fa77adf3c746 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440274.612433:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee049e95a00 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:3.0:1787440274.612435:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95a00/0x85f5fa77adf3c746 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440274.612441:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95a00/0x85f5fa77adf3c746 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440274.612448:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ee050ca1800) 00010000:00010000:3.0:1787440274.612450:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440274.612453:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95a00/0x85f5fa77adf3c746 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440274.612459:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95a00/0x85f5fa77adf3c746 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440274.612817:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee05fb60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+18:10426:x1874266681282304:12345-192.168.206.58@tcp:34:lfs.0 Request processed in 4841us (5012us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440274.612827:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 61 00000100:00100000:1.0:1787440274.621834:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440274.621957:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681282560 00000100:00100000:0.0:1787440274.621979:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681282560 00000100:00100000:0.0:1787440274.622080:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 16 00000100:00100000:0.0:1787440274.622090:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee077ec3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+18:10426:x1874266681282560:12345-192.168.206.58@tcp:35:lfs.0 00000100:00100000:0.0:1787440274.622584:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee077ec3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+19:10426:x1874266681282560:12345-192.168.206.58@tcp:35:lfs.0 Request processed in 493us (756us total) trans 4294967347 rc 0/0 00000100:00100000:0.0:1787440274.622592:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 16 00000100:00100000:0.0:1787440274.667278:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440274.667451:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681282816 00000100:00100000:3.0:1787440274.667463:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681282816 00000100:00100000:2.0:1787440274.667731:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 62 00000100:00100000:2.0:1787440274.667745:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04ca39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+19:10429:x1874266681282816:12345-192.168.206.58@tcp:101:lfs.0 00010000:00010000:2.0:1787440274.667773:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440274.667794:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86fc00/0x85f5fa77adf3c74d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fab14535dc62202 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440274.667874:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e400/0x85f5fa77adf3c754 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440274.667888:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e400/0x85f5fa77adf3c754 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440274.667901:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e400/0x85f5fa77adf3c754 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440274.667916:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f000/0x85f5fa77adf3c75b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440274.667923:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f000/0x85f5fa77adf3c75b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440274.667929:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f000/0x85f5fa77adf3c75b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440274.668590:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f600/0x85f5fa77adf3c762 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440274.668600:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f600/0x85f5fa77adf3c762 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440274.668614:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f600/0x85f5fa77adf3c762 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787440274.668624:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1787440274.668711:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e400/0x85f5fa77adf3c754 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440274.668719:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e400/0x85f5fa77adf3c754 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440274.668725:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e400/0x85f5fa77adf3c754 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440274.668731:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee07f86e400 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:2.0:1787440274.668735:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e400/0x85f5fa77adf3c754 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440274.668743:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e400/0x85f5fa77adf3c754 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440274.668754:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8ee0460ccd00) 00010000:00010000:2.0:1787440274.668756:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440274.668761:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e400/0x85f5fa77adf3c754 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440274.668766:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e400/0x85f5fa77adf3c754 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440274.668778:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f000/0x85f5fa77adf3c75b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440274.668784:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f000/0x85f5fa77adf3c75b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440274.668796:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f000/0x85f5fa77adf3c75b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440274.668801:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee07f86f000 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:2.0:1787440274.668803:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f000/0x85f5fa77adf3c75b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440274.668809:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f000/0x85f5fa77adf3c75b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440274.668816:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8ee054b3cc00) 00010000:00010000:2.0:1787440274.668819:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440274.668821:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f000/0x85f5fa77adf3c75b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440274.668826:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f000/0x85f5fa77adf3c75b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440274.668869:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86fc00/0x85f5fa77adf3c74d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62202 expref: 22 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440274.668882:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f600/0x85f5fa77adf3c762 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62202 expref: 21 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440274.668889:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ee050ca1800) 00010000:00010000:2.0:1787440274.668891:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787440274.668893:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee07f86f600, rc 0) 00000100:00100000:2.0:1787440274.669240:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04ca39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+21:10429:x1874266681282816:12345-192.168.206.58@tcp:101:lfs.0 Request processed in 1497us (1969us total) trans 4294967348 rc 0/0 00000100:00100000:2.0:1787440274.669260:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 62 00000100:00100000:2.0:1787440274.674398:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:2.0:1787440274.674444:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440274.674797:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681282944 00000100:00100000:3.0:1787440274.674819:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681282944 00000100:00100000:3.0:1787440274.674891:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 4 00000100:00100000:3.0:1787440274.674901:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee05fb62a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+21:2363:x1874266681282944:12345-192.168.206.58@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787440274.674916:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787440274.674947:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f600/0x85f5fa77adf3c762 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62202 expref: 21 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440274.674964:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ee050ca1800) 00010000:00010000:3.0:1787440274.674969:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787440274.675028:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee05fb62a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+20:2363:x1874266681282944:12345-192.168.206.58@tcp:103:ldlm_bl.0 Request processed in 129us (583us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440274.675035:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 4 00000100:00100000:0.0:1787440274.675091:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681283072 00000100:00100000:0.0:1787440274.675096:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681283072 00000100:00100000:0.0:1787440274.675132:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 63 00000100:00100000:0.0:1787440274.675138:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee05fb62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+20:10429:x1874266681283072:12345-192.168.206.58@tcp:54:lfs.0 00010000:00010000:0.0:1787440274.675199:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce600/0x85f5fa77adf3c770 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440274.675212:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce600/0x85f5fa77adf3c770 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440274.675222:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce600/0x85f5fa77adf3c770 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440274.675248:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce600/0x85f5fa77adf3c770 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440274.675254:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce600/0x85f5fa77adf3c770 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440274.675260:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce600/0x85f5fa77adf3c770 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440274.675265:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee04cbce600 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:0.0:1787440274.675275:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce600/0x85f5fa77adf3c770 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440274.675282:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce600/0x85f5fa77adf3c770 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440274.675290:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ee050ca1800) 00010000:00010000:0.0:1787440274.675293:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787440274.675296:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce600/0x85f5fa77adf3c770 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440274.675302:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce600/0x85f5fa77adf3c770 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440274.675343:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee05fb62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+20:10429:x1874266681283072:12345-192.168.206.58@tcp:54:lfs.0 Request processed in 205us (955us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440274.675348:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 63 00000100:00100000:1.0:1787440274.682608:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440274.683034:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681283328 00000100:00100000:3.0:1787440274.683043:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681283328 00000100:00100000:3.0:1787440274.683121:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 17 00000100:00100000:3.0:1787440274.683132:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee077ec1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+20:10429:x1874266681283328:12345-192.168.206.58@tcp:35:lfs.0 00000100:00100000:3.0:1787440274.683404:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee077ec1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+21:10429:x1874266681283328:12345-192.168.206.58@tcp:35:lfs.0 Request processed in 272us (802us total) trans 4294967349 rc 0/0 00000100:00100000:3.0:1787440274.683411:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 17 00000100:00100000:1.0:1787440274.844036:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440274.844138:0:6892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681283584 00000100:00100000:0.0:1787440274.844147:0:6892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681283584 00000100:00100000:0.0:1787440274.844215:0:6892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 64 00000100:00100000:0.0:1787440274.844226:0:6892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee077ec2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+21:10447:x1874266681283584:12345-192.168.206.58@tcp:101:cat.0 00010000:00010000:0.0:1787440274.844248:0:6892:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440274.844268:0:6892:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce600/0x85f5fa77adf3c777 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fab14535dc62209 expref: -99 pid: 6892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440274.844365:0:6892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcee00/0x85f5fa77adf3c77e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440274.844379:0:6892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcee00/0x85f5fa77adf3c77e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440274.844407:0:6892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcee00/0x85f5fa77adf3c77e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787440274.844419:0:6892:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1787440274.844594:0:6892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce600/0x85f5fa77adf3c777 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62209 expref: 24 pid: 6892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440274.844616:0:6892:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcee00/0x85f5fa77adf3c77e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62209 expref: 23 pid: 6892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440274.844625:0:6892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ee050ca1800) 00010000:00010000:0.0:1787440274.844628:0:6892:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1787440274.844631:0:6892:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee04cbcee00, rc 0) 00000100:00100000:0.0:1787440274.844680:0:6892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee077ec2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+23:10447:x1874266681283584:12345-192.168.206.58@tcp:101:cat.0 Request processed in 457us (652us total) trans 4294967350 rc 0/0 00000100:00100000:0.0:1787440274.844687:0:6892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 64 00000100:00100000:2.0:1787440274.877967:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440274.878128:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681283712 00000100:00100000:0.0:1787440274.878137:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681283712 00000100:00100000:0.0:1787440274.878207:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 65 00000100:00100000:0.0:1787440274.878218:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee05fb61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+23:10448:x1874266681283712:12345-192.168.206.58@tcp:101:lfs.0 00010000:00010000:0.0:1787440274.878240:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440274.878261:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce600/0x85f5fa77adf3c78c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fab14535dc62210 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440274.878326:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfe00/0x85f5fa77adf3c793 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440274.878356:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfe00/0x85f5fa77adf3c793 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440274.878368:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfe00/0x85f5fa77adf3c793 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787440274.878608:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:0.0:1787440274.878612:0:5850:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787440274.878686:0:5850:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfe00/0x85f5fa77adf3c793 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440274.878715:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce600/0x85f5fa77adf3c78c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62210 expref: 25 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440274.878731:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfe00/0x85f5fa77adf3c793 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62210 expref: 24 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440274.878738:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8ee0460ccd00) 00010000:00010000:0.0:1787440274.878741:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787440274.878744:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee04cbcfe00, rc 0) 00000100:00100000:0.0:1787440274.887288:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee05fb61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+24:10448:x1874266681283712:12345-192.168.206.58@tcp:101:lfs.0 Request processed in 9060us (9316us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440274.887300:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 65 00000100:00100000:3.0:1787440274.892798:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440274.895034:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681284096 00000100:00100000:0.0:1787440274.895050:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681284096 00000100:00100000:1.0:1787440274.895177:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 18 00000100:00100000:1.0:1787440274.895202:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee06e6cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+24:10448:x1874266681284096:12345-192.168.206.58@tcp:35:lfs.0 00000100:00100000:1.0:1787440274.895575:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee06e6cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+25:10448:x1874266681284096:12345-192.168.206.58@tcp:35:lfs.0 Request processed in 376us (2787us total) trans 4294967351 rc 0/0 00000100:00100000:1.0:1787440274.895582:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 18 00000100:00100000:1.0:1787440274.900488:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:2.0:1787440274.900991:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681284224 00000100:00100000:2.0:1787440274.901001:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681284224 00000100:00100000:2.0:1787440274.901065:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 5 00000100:00100000:2.0:1787440274.901075:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee077ec3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+25:10448:x1874266681284224:12345-192.168.206.58@tcp:103:lfs.0 00010000:00010000:2.0:1787440274.901090:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1787440274.901114:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce200/0x85f5fa77adf3c723 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc621f4 expref: 25 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440274.901149:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcee00/0x85f5fa77adf3c77e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62209 expref: 24 pid: 6892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440274.901162:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcec00/0x85f5fa77adf3c627 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc621b5 expref: 23 pid: 6892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440274.901171:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ee050ca1800) 00010000:00010000:2.0:1787440274.901191:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787440274.901261:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee077ec3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+22:10448:x1874266681284224:12345-192.168.206.58@tcp:103:lfs.0 Request processed in 187us (782us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440274.901270:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 5 00000100:00100000:2.0:1787440274.904679:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440274.905261:0:6892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681284352 00000100:00100000:0.0:1787440274.905274:0:6892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681284352 00000100:00100000:0.0:1787440274.905350:0:6892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 66 00000100:00100000:0.0:1787440274.905362:0:6892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee0806b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+22:10448:x1874266681284352:12345-192.168.206.58@tcp:58:lfs.0 00010000:00010000:0.0:1787440274.905679:0:6892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce600/0x85f5fa77adf3c79a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440274.905701:0:6892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce600/0x85f5fa77adf3c79a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440274.905716:0:6892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce600/0x85f5fa77adf3c79a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787440274.912573:0:6892:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787440274.912790:0:6892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:1.0:1787440274.913402:0:6892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:1.0:1787440274.913723:0:6892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee0806b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+22:10448:x1874266681284352:12345-192.168.206.58@tcp:58:lfs.0 Request processed in 8354us (9049us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440274.913737:0:6892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 66 00000100:00100000:1.0:1787440274.947924:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440274.948071:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681284480 00000100:00100000:3.0:1787440274.948083:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681284480 00000100:00100000:3.0:1787440274.948158:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 67 00000100:00100000:3.0:1787440274.948171:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee077ec1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+22:10450:x1874266681284480:12345-192.168.206.58@tcp:101:lfs.0 00010000:00010000:3.0:1787440274.948208:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440274.948236:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95a00/0x85f5fa77adf3c7a1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fab14535dc62217 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440274.948345:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94200/0x85f5fa77adf3c7a8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440274.948363:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94200/0x85f5fa77adf3c7a8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440274.948376:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94200/0x85f5fa77adf3c7a8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440274.948393:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94400/0x85f5fa77adf3c7af lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440274.948400:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94400/0x85f5fa77adf3c7af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440274.948407:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94400/0x85f5fa77adf3c7af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440274.948798:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95c00/0x85f5fa77adf3c7b6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440274.948809:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95c00/0x85f5fa77adf3c7b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440274.948818:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95c00/0x85f5fa77adf3c7b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787440274.948866:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1787440274.948871:0:5849:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787440274.950398:0:5849:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95c00/0x85f5fa77adf3c7b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440274.950451:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95c00/0x85f5fa77adf3c7b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440274.950465:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94200/0x85f5fa77adf3c7a8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440274.950473:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94200/0x85f5fa77adf3c7a8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440274.950481:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94200/0x85f5fa77adf3c7a8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440274.950488:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee049e94200 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:3.0:1787440274.950522:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94200/0x85f5fa77adf3c7a8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440274.950532:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94200/0x85f5fa77adf3c7a8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440274.950552:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8ee0460ccd00) 00010000:00010000:3.0:1787440274.950555:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440274.950561:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94200/0x85f5fa77adf3c7a8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440274.950568:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94200/0x85f5fa77adf3c7a8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440274.950587:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94400/0x85f5fa77adf3c7af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440274.950594:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94400/0x85f5fa77adf3c7af lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440274.950607:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94400/0x85f5fa77adf3c7af lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440274.950613:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee049e94400 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:3.0:1787440274.950616:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94400/0x85f5fa77adf3c7af lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440274.950623:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94400/0x85f5fa77adf3c7af lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440274.950632:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8ee0460cca00) 00010000:00010000:3.0:1787440274.950635:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440274.950638:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94400/0x85f5fa77adf3c7af lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440274.950644:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94400/0x85f5fa77adf3c7af lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440274.950696:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95a00/0x85f5fa77adf3c7a1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62217 expref: 24 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440274.950712:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95c00/0x85f5fa77adf3c7b6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62217 expref: 23 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440274.950721:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ee050ca1c00) 00010000:00010000:3.0:1787440274.950723:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787440274.950726:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee049e95c00, rc 0) 00000100:00100000:3.0:1787440274.950834:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee077ec1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+23:10450:x1874266681284480:12345-192.168.206.58@tcp:101:lfs.0 Request processed in 2664us (2921us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440274.950853:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 67 00000040:00080000:0.0:1787440275.360214:0:11682:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787440275.360224:0:11682:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787440275.360276:0:11682:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1787440275.360283:0:11682:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787440275.360403:0:11682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee04ca38e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11682:1874266701235328:192.168.206.58@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787440275.360521:0:11682:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee0807a9a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787440275.365091:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440275.365295:0:11682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee04ca38e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11682:1874266701235328:192.168.206.58@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787440275.365589:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681284608 00000100:00100000:2.0:1787440275.365597:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681284608 00000100:00100000:2.0:1787440275.365659:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 1 00000100:00100000:2.0:1787440275.365668:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee06e6ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+23:10461:x1874266681284608:12345-192.168.206.58@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1787440275.365748:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee06e6ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+23:10461:x1874266681284608:12345-192.168.206.58@tcp:900:lhsmtool_posix.0 Request processed in 80us (664us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440275.365755:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 1 00000100:00100000:0.0:1787440275.371971:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440275.372134:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681284736 00000100:00100000:3.0:1787440275.372145:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681284736 00000100:00100000:3.0:1787440275.372214:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 68 00000100:00100000:3.0:1787440275.372224:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04ca38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+23:10461:x1874266681284736:12345-192.168.206.58@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787440275.372269:0:5851:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787440275.372371:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04ca38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+23:10461:x1874266681284736:12345-192.168.206.58@tcp:53:lhsmtool_posix.0 Request processed in 148us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440275.372379:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 68 00000100:00100000:1.0:1787440275.378982:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440275.379140:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681284864 00000100:00100000:0.0:1787440275.379149:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681284864 00000100:00100000:0.0:1787440275.379205:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 69 00000100:00100000:0.0:1787440275.379214:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee077ec2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+23:10461:x1874266681284864:12345-192.168.206.58@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1787440275.379287:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf200/0x85f5fa77adf3c7bd lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440275.379304:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf200/0x85f5fa77adf3c7bd lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440275.379316:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf200/0x85f5fa77adf3c7bd lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440275.379381:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfc00/0x85f5fa77adf3c7c4 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440275.379391:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfc00/0x85f5fa77adf3c7c4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440275.379398:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfc00/0x85f5fa77adf3c7c4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440275.379432:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce000/0x85f5fa77adf3c7cb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440275.379440:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce000/0x85f5fa77adf3c7cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440275.379447:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce000/0x85f5fa77adf3c7cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787440275.379485:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1787440275.379522:0:5850:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787440275.379536:0:5850:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce000/0x85f5fa77adf3c7cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440275.379547:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf200/0x85f5fa77adf3c7bd lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440275.379553:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf200/0x85f5fa77adf3c7bd lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440275.379559:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf200/0x85f5fa77adf3c7bd lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440275.381033:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee04cbcf200 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:0.0:1787440275.381038:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf200/0x85f5fa77adf3c7bd lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440275.381046:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf200/0x85f5fa77adf3c7bd lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440275.381662:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ee05132e100) 00010000:00010000:0.0:1787440275.381666:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440275.381672:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf200/0x85f5fa77adf3c7bd lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440275.381679:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf200/0x85f5fa77adf3c7bd lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440275.381694:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfc00/0x85f5fa77adf3c7c4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440275.381701:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfc00/0x85f5fa77adf3c7c4 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440275.381707:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfc00/0x85f5fa77adf3c7c4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440275.381712:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee04cbcfc00 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:0.0:1787440275.381715:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfc00/0x85f5fa77adf3c7c4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440275.381721:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfc00/0x85f5fa77adf3c7c4 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440275.381742:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff8ee050ca1600) 00010000:00010000:0.0:1787440275.381744:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440275.381747:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfc00/0x85f5fa77adf3c7c4 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440275.381752:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfc00/0x85f5fa77adf3c7c4 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440275.381767:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce000/0x85f5fa77adf3c7cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440275.381772:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce000/0x85f5fa77adf3c7cb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440275.381777:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce000/0x85f5fa77adf3c7cb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440275.381782:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee04cbce000 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:0.0:1787440275.381785:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce000/0x85f5fa77adf3c7cb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440275.381791:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce000/0x85f5fa77adf3c7cb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440275.381799:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ee050ca1c00) 00010000:00010000:0.0:1787440275.381801:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440275.381803:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce000/0x85f5fa77adf3c7cb lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440275.381808:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce000/0x85f5fa77adf3c7cb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440275.382687:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee077ec2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+23:10461:x1874266681284864:12345-192.168.206.58@tcp:34:lhsmtool_posix.0 Request processed in 3468us (3710us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440275.382840:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 69 00000100:00100000:3.0:1787440275.387369:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:1.0:1787440275.388299:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681285120 00000100:00100000:1.0:1787440275.388312:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681285120 00000100:00100000:1.0:1787440275.388372:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 70 00000100:00100000:1.0:1787440275.388382:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee06e6cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+23:10461:x1874266681285120:12345-192.168.206.58@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787440275.388797:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440275.388817:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e600/0x85f5fa77adf3c7d2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fab14535dc6221e expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440275.388914:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fa00/0x85f5fa77adf3c7d9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440275.388929:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fa00/0x85f5fa77adf3c7d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440275.388941:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fa00/0x85f5fa77adf3c7d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787440275.388952:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1787440275.389049:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fa00/0x85f5fa77adf3c7d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440275.389057:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fa00/0x85f5fa77adf3c7d9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440275.393822:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fa00/0x85f5fa77adf3c7d9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440275.393832:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee07fb9fa00 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:1.0:1787440275.393837:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fa00/0x85f5fa77adf3c7d9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440275.393864:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fa00/0x85f5fa77adf3c7d9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440275.393882:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ee050ca1c00) 00010000:00010000:1.0:1787440275.393885:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787440275.393890:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fa00/0x85f5fa77adf3c7d9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440275.393896:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fa00/0x85f5fa77adf3c7d9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440275.394048:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e600/0x85f5fa77adf3c7d2 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6221e expref: 25 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440275.394074:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ee05132e100) 00010000:00010000:0.0:1787440275.394077:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787440275.394081:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e600/0x85f5fa77adf3c7d2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6221e expref: 25 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440275.394092:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee07fb9e600, rc 0) 00000100:00100000:0.0:1787440275.394167:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee06e6cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+24:10461:x1874266681285120:12345-192.168.206.58@tcp:101:lhsmtool_posix.0 Request processed in 5785us (6818us total) trans 4294967352 rc 301/301 00000100:00100000:0.0:1787440275.394176:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 70 00000100:00100000:2.0:1787440275.400973:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440275.401234:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681285248 00000100:00100000:3.0:1787440275.401244:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681285248 00000100:00100000:3.0:1787440275.401339:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 71 00000100:00100000:3.0:1787440275.401349:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee0806b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+24:10461:x1874266681285248:12345-192.168.206.58@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787440275.401403:0:5849:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787440275.401590:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee0806b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+24:10461:x1874266681285248:12345-192.168.206.58@tcp:53:lhsmtool_posix.0 Request processed in 234us (617us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440275.401604:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 71 00000100:00100000:1.0:1787440275.411860:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:2.0:1787440275.412656:0:6892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681285504 00000100:00100000:2.0:1787440275.412666:0:6892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681285504 00000100:00100000:2.0:1787440275.412756:0:6892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 72 00000100:00100000:2.0:1787440275.412766:0:6892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee077ec3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+24:10461:x1874266681285504:12345-192.168.206.58@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787440275.412784:0:6892:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440275.412787:0:6892:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787440275.412811:0:6892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfe00/0x85f5fa77adf3c793 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62210 expref: 24 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440275.412828:0:6892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8ee0460ccd00) 00010000:00010000:2.0:1787440275.412833:0:6892:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787440275.412846:0:6892:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e200/0x85f5fa77adf3c7e7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fab14535dc62225 expref: -99 pid: 6892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787440275.413584:0:6892:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:2.0:1787440275.413838:0:6892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86ec00/0x85f5fa77adf3c7ee lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440275.413852:0:6892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86ec00/0x85f5fa77adf3c7ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440275.413862:0:6892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86ec00/0x85f5fa77adf3c7ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440275.413930:0:6892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e200/0x85f5fa77adf3c7e7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62225 expref: 26 pid: 6892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440275.413946:0:6892:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86ec00/0x85f5fa77adf3c7ee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62225 expref: 25 pid: 6892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440275.413953:0:6892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8ee054b3cc00) 00010000:00010000:2.0:1787440275.413955:0:6892:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787440275.413958:0:6892:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee07f86ec00, rc 0) 00000100:00100000:2.0:1787440275.414022:0:6892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee077ec3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+25:10461:x1874266681285504:12345-192.168.206.58@tcp:101:lhsmtool_posix.0 Request processed in 1256us (2173us total) trans 4294967353 rc 0/0 00000100:00100000:2.0:1787440275.414029:0:6892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 72 00000100:00100000:3.0:1787440275.425585:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440275.425700:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681285760 00000100:00100000:0.0:1787440275.425710:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681285760 00000100:00100000:0.0:1787440275.425765:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 73 00000100:00100000:0.0:1787440275.425774:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee06e6cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+25:10461:x1874266681285760:12345-192.168.206.58@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787440275.425826:0:5850:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787440275.425851:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86ec00/0x85f5fa77adf3c7ee lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62225 expref: 25 pid: 6892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440275.425882:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8ee054b3cc00) 00010000:00010000:0.0:1787440275.425894:0:5850:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787440275.425937:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce000/0x85f5fa77adf3c7fc lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440275.425951:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce000/0x85f5fa77adf3c7fc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440275.425960:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce000/0x85f5fa77adf3c7fc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440275.426014:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfc00/0x85f5fa77adf3c803 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x6ed1531d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440275.426022:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfc00/0x85f5fa77adf3c803 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x6ed1531d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440275.426029:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfc00/0x85f5fa77adf3c803 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x6ed1531d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440275.426706:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce000/0x85f5fa77adf3c7fc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440275.426717:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce000/0x85f5fa77adf3c7fc lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440275.426724:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce000/0x85f5fa77adf3c7fc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440275.426730:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee04cbce000 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:0.0:1787440275.426735:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce000/0x85f5fa77adf3c7fc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440275.426742:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce000/0x85f5fa77adf3c7fc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440275.426762:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8ee0460ccd00) 00010000:00010000:0.0:1787440275.426765:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440275.426769:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce000/0x85f5fa77adf3c7fc lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440275.426775:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce000/0x85f5fa77adf3c7fc lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440275.426786:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfc00/0x85f5fa77adf3c803 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x6ed1531d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440275.426792:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfc00/0x85f5fa77adf3c803 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x6ed1531d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440275.426798:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfc00/0x85f5fa77adf3c803 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x6ed1531d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440275.426803:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee04cbcfc00 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:0.0:1787440275.426805:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfc00/0x85f5fa77adf3c803 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x6ed1531d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440275.426811:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfc00/0x85f5fa77adf3c803 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x6ed1531d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440275.426818:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x6ed1531d (ffff8ee050ca1600) 00010000:00010000:0.0:1787440275.426820:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440275.426823:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfc00/0x85f5fa77adf3c803 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x6ed1531d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440275.426829:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfc00/0x85f5fa77adf3c803 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x6ed1531d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440275.427049:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee06e6cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+24:10461:x1874266681285760:12345-192.168.206.58@tcp:36:lhsmtool_posix.0 Request processed in 1273us (1469us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787440275.427058:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 73 00000100:00100000:0.0:1787440275.434682:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440275.434825:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681285888 00000100:00100000:3.0:1787440275.434833:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681285888 00000100:00100000:3.0:1787440275.434933:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 74 00000100:00100000:3.0:1787440275.434944:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04ca3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+24:10461:x1874266681285888:12345-192.168.206.58@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787440275.434963:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440275.434997:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95a00/0x85f5fa77adf3c80a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fab14535dc6222c expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440275.435031:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94400/0x85f5fa77adf3c811 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440275.435044:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94400/0x85f5fa77adf3c811 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440275.435054:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94400/0x85f5fa77adf3c811 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440275.435152:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95a00/0x85f5fa77adf3c80a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6222c expref: 26 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440275.435170:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94400/0x85f5fa77adf3c811 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6222c expref: 25 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440275.435188:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8ee0460cca00) 00010000:00010000:3.0:1787440275.435192:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787440275.435195:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee049e94400, rc 0) 00000100:00100000:3.0:1787440275.435353:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04ca3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+25:10461:x1874266681285888:12345-192.168.206.58@tcp:101:lhsmtool_posix.0 Request processed in 410us (679us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440275.435360:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 74 00000100:00100000:2.0:1787440275.442104:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440275.445639:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681286144 00000100:00100000:3.0:1787440275.445654:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681286144 00000100:00100000:0.0:1787440275.447353:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 75 00000100:00100000:0.0:1787440275.447367:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee0806b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+25:10461:x1874266681286144:12345-192.168.206.58@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787440275.447455:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfc00/0x85f5fa77adf3c818 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440275.447472:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfc00/0x85f5fa77adf3c818 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440275.447483:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfc00/0x85f5fa77adf3c818 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787440275.447840:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 88 off8408 00000004:00080000:0.0:1787440275.447852:0:5849:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 373818358454ns, next at 374818356109ns, rc = 0 00000004:00010000:0.0:1787440275.448255:0:5849:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f019f6d5 reply state 000000008aa5d240 transno 4294967354 ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfc00/0x85f5fa77adf3c818 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440275.448265:0:5849:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787440275.448402:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee0806b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+27:10461:x1874266681286144:12345-192.168.206.58@tcp:36:lhsmtool_posix.0 Request processed in 1036us (6304us total) trans 4294967354 rc 0/0 00000100:00100000:0.0:1787440275.448410:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 75 00000100:00100000:3.0:1787440275.459893:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440275.463524:0:6892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681286272 00000100:00100000:0.0:1787440275.463539:0:6892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681286272 00000100:00100000:0.0:1787440275.463606:0:6892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 76 00000100:00100000:0.0:1787440275.463616:0:6892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee06e6cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+27:10461:x1874266681286272:12345-192.168.206.58@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787440275.463670:0:6892:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440275.463693:0:6892:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf200/0x85f5fa77adf3c81f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fab14535dc62233 expref: -99 pid: 6892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440275.463767:0:6892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf200/0x85f5fa77adf3c81f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62233 expref: 28 pid: 6892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440275.463781:0:6892:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf200/0x85f5fa77adf3c81f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62233 expref: 28 pid: 6892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440275.463799:0:6892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8ee0460cca00) 00010000:00010000:0.0:1787440275.463802:0:6892:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787440275.463806:0:6892:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee04cbcf200, rc 0) 00000100:00100000:0.0:1787440275.463881:0:6892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee06e6cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+28:10461:x1874266681286272:12345-192.168.206.58@tcp:101:lhsmtool_posix.0 Request processed in 266us (3994us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440275.463887:0:6892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 76 00010000:00010000:1.0:1787440275.466266:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfc00/0x85f5fa77adf3c818 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440275.466283:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfc00/0x85f5fa77adf3c818 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440275.466291:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfc00/0x85f5fa77adf3c818 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440275.466297:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee04cbcfc00 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:1.0:1787440275.466302:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfc00/0x85f5fa77adf3c818 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440275.466311:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfc00/0x85f5fa77adf3c818 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440275.466327:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8ee0460cca00) 00010000:00010000:1.0:1787440275.466331:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787440275.466341:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfc00/0x85f5fa77adf3c818 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440275.466348:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfc00/0x85f5fa77adf3c818 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440275.470976:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440275.471097:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681286400 00000100:00100000:0.0:1787440275.471106:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681286400 00000100:00100000:0.0:1787440275.471158:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 25 00000100:00100000:0.0:1787440275.471166:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee077ec1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2359:x1874266681286400:12345-192.168.206.58@tcp:8:lhsmtool_posix.0 00010000:00080000:0.0:1787440275.471206:0:6698:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 792563a7-4c22-4ac7-ac25-d49ef7fb41a8@192.168.206.58@tcp t0 exp 0000000000000000 cur 373 last 0 00000020:00000080:0.0:1787440275.471237:0:6698:0:(genops.c:1385:class_connect()) connect: client 792563a7-4c22-4ac7-ac25-d49ef7fb41a8, cookie 0x85f5fa77adf3c826 00002000:00100000:0.0:1787440275.471249:0:6698:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 792563a7-4c22-4ac7-ac25-d49ef7fb41a8/ffff8ee0513b6000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113940 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787440275.471260:0:6698:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1787440275.471488:0:6698:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1787440275.471558:0:6698:0:(import.c:65:import_set_state_nolock()) ffff8ee0513b5000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787440275.471628:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee077ec1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+6:2359:x1874266681286400:12345-192.168.206.58@tcp:8:lhsmtool_posix.0 Request processed in 461us (659us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440275.471636:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 25 00000100:00100000:1.0:1787440275.487434:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:2.0:1787440275.487566:0:9225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681286528 00000100:00100000:2.0:1787440275.487575:0:9225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681286528 00000100:00100000:2.0:1787440275.487633:0:9225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 26 00000100:00100000:2.0:1787440275.487644:0:9225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee0776ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+6:0:x1874266681286528:12345-192.168.206.58@tcp:2:lhsmtool_posix.0 00000100:00080000:3.0:1787440275.489248:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787440275.546450:0:9225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee0776ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+7:0:x1874266681286528:12345-192.168.206.58@tcp:2:lhsmtool_posix.0 Request processed in 58799us (59015us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1787440275.546464:0:9225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 26 00000001:00100000:1.0:1787440275.546520:0:7640:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 792563a7-4c22-4ac7-ac25-d49ef7fb41a8 00000001:00080000:1.0:1787440275.546533:0:7640:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00010000:00010000:3.0:1787440275.548900:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787440275.550706:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:2.0:1787440275.550805:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681286784 00000100:00100000:2.0:1787440275.550814:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681286784 00000100:00100000:2.0:1787440275.550900:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 19 00000100:00100000:2.0:1787440275.551015:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee06e6cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+27:10461:x1874266681286784:12345-192.168.206.58@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787440275.551302:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee06e6cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+28:10461:x1874266681286784:12345-192.168.206.58@tcp:35:lhsmtool_posix.0 Request processed in 289us (602us total) trans 4294967355 rc 0/0 00000100:00100000:2.0:1787440275.551309:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 19 00000100:00100000:2.0:1787440275.554930:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:1.0:1787440275.554998:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681287040 00000100:00100000:1.0:1787440275.555007:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681287040 00000100:00100000:1.0:1787440275.555102:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 77 00000100:00100000:1.0:1787440275.555112:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee0806b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+28:10461:x1874266681287040:12345-192.168.206.58@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787440275.555230:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee0806b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+28:10461:x1874266681287040:12345-192.168.206.58@tcp:57:lhsmtool_posix.0 Request processed in 118us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440275.555238:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 77 00000100:00100000:1.0:1787440275.558616:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440275.558692:0:6892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681287168 00000100:00100000:3.0:1787440275.558702:0:6892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681287168 00000100:00100000:3.0:1787440275.558754:0:6892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 78 00000100:00100000:3.0:1787440275.558764:0:6892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee0776bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+28:10461:x1874266681287168:12345-192.168.206.58@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787440275.558785:0:6892:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440275.558804:0:6892:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95a00/0x85f5fa77adf3c82d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fab14535dc6223a expref: -99 pid: 6892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440275.558884:0:6892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94200/0x85f5fa77adf3c834 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440275.558898:0:6892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94200/0x85f5fa77adf3c834 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440275.559021:0:6892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94200/0x85f5fa77adf3c834 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787440275.559062:0:6892:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787440275.559080:0:6892:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94200/0x85f5fa77adf3c834 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440275.559105:0:6892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95a00/0x85f5fa77adf3c82d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6223a expref: 30 pid: 6892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440275.559120:0:6892:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94200/0x85f5fa77adf3c834 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6223a expref: 29 pid: 6892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440275.559139:0:6892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8ee0460cca00) 00010000:00010000:3.0:1787440275.559142:0:6892:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787440275.559146:0:6892:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee049e94200, rc 0) 00000100:00100000:3.0:1787440275.559227:0:6892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee0776bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+29:10461:x1874266681287168:12345-192.168.206.58@tcp:101:lhsmtool_posix.0 Request processed in 465us (620us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440275.559234:0:6892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 78 00000100:00100000:3.0:1787440275.562069:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:1.0:1787440275.562257:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681287296 00000100:00100000:1.0:1787440275.562266:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681287296 00000100:00100000:1.0:1787440275.562319:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 27 00000100:00100000:1.0:1787440275.562329:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee05d27c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+5:2361:x1874266681287296:12345-192.168.206.58@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787440275.562378:0:6698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440275.562397:0:6698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000024ff31d3/0x85f5fa77adf3c83b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5fab14535dc62241 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787440275.562431:0:6698:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8a2c93, blocks: 0x1 00010000:00010000:1.0:1787440275.562448:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=373s v=(0 0) 00010000:00010000:1.0:1787440275.562453:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787440275.562462:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000024ff31d3/0x85f5fa77adf3c83b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62241 expref: 6 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440275.562486:0:6698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000024ff31d3/0x85f5fa77adf3c83b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62241 expref: 6 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440275.562524:0:6698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee07fb9ec00, rc 0) 00000100:00100000:1.0:1787440275.562583:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee05d27c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+6:2361:x1874266681287296:12345-192.168.206.58@tcp:101:lhsmtool_posix.0 Request processed in 256us (520us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440275.562591:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 27 00000100:00100000:2.0:1787440275.566621:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440275.566702:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681287552 00000100:00100000:0.0:1787440275.566711:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681287552 00000100:00100000:0.0:1787440275.566766:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 79 00000100:00100000:0.0:1787440275.566775:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee0806b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+29:10461:x1874266681287552:12345-192.168.206.58@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787440275.566983:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee0806b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+29:10461:x1874266681287552:12345-192.168.206.58@tcp:57:lhsmtool_posix.0 Request processed in 209us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440275.566990:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 79 00000100:00100000:0.0:1787440275.570956:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:1.0:1787440275.571040:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681287680 00000100:00100000:1.0:1787440275.571049:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681287680 00000100:00100000:1.0:1787440275.571148:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 28 00000100:00100000:1.0:1787440275.571158:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04ca39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+6:10461:x1874266681287680:12345-192.168.206.58@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787440275.571173:0:6697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440275.571202:0:6697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000044f6f125/0x85f5fa77adf3c842 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5fab14535dc62248 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440275.571231:0:6697:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000024ff31d3/0x85f5fa77adf3c83b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62241 expref: 7 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440275.571251:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787440275.571255:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787440275.571261:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000044f6f125/0x85f5fa77adf3c842 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62248 expref: 7 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440275.571292:0:6697:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000024ff31d3/0x85f5fa77adf3c83b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62241 expref: 7 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440275.571306:0:6697:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000024ff31d3/0x85f5fa77adf3c83b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62241 expref: 7 pid: 6698 timeout: 473 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440275.571320:0:6697:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee0776b9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6697:1874266701235456:192.168.206.58@tcp:104: 00000100:00100000:1.0:1787440275.571407:0:6697:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee0805699c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787440275.574785:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:1.0:1787440275.574929:0:6697:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee0776b9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6697:1874266701235456:192.168.206.58@tcp:104: 00010000:00010000:1.0:1787440275.574961:0:6697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000044f6f125/0x85f5fa77adf3c842 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62248 expref: 7 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440275.574981:0:6697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee07fb9f200, rc 0) 00000100:00100000:3.0:1787440275.574995:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681287808 00000100:00100000:3.0:1787440275.575002:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681287808 00010000:00010000:3.0:1787440275.575031:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000024ff31d3/0x85f5fa77adf3c83b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62241 expref: 8 pid: 6698 timeout: 473 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440275.575062:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 42 00000100:00100000:1.0:1787440275.575069:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04ca39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+8:10461:x1874266681287680:12345-192.168.206.58@tcp:101:lhsmtool_posix.0 Request processed in 3914us (4123us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440275.575071:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee06e7e5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+8:2362:x1874266681287808:12345-192.168.206.58@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1787440275.575077:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 28 00010000:00010000:3.0:1787440275.575083:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787440275.575105:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000024ff31d3/0x85f5fa77adf3c83b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62241 expref: 7 pid: 6698 timeout: 473 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440275.575118:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000024ff31d3/0x85f5fa77adf3c83b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62241 expref: 7 pid: 6698 timeout: 473 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440275.575140:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000024ff31d3/0x85f5fa77adf3c83b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62241 expref: 7 pid: 6698 timeout: 473 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440275.575151:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787440275.575156:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787440275.575164:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000044f6f125/0x85f5fa77adf3c842 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62248 expref: 6 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440275.575195:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000044f6f125/0x85f5fa77adf3c842 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62248 expref: 6 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440275.575240:0:5835:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000044f6f125/0x85f5fa77adf3c842 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62248 expref: 6 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440275.575254:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee050359f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5835:1874266701235584:192.168.206.58@tcp:105: 00000100:00100000:3.0:1787440275.575300:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee047c02b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787440275.582561:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:1.0:1787440275.582647:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681287936 00000100:00100000:1.0:1787440275.582654:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681287936 00000100:00100000:3.0:1787440275.582657:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee050359f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5835:1874266701235584:192.168.206.58@tcp:105: 00010000:00010000:3.0:1787440275.582689:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00100000:1.0:1787440275.582695:0:6703:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff8ee04ca3a300 x1874266681287936/t0(0) o4->792563a7-4c22-4ac7-ac25-d49ef7fb41a8@192.168.206.58@tcp:436/0 lens 504/0 e 0 to 0 dl 1787440286 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787440275.582710:0:6703:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ee04ca3a300 with x1874266681287936 ext(0->8) 00002000:00010000:1.0:1787440275.582714:0:6703:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8ee04ca3a300 00000100:00100000:3.0:1787440275.582736:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee06e7e5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+7:2362:x1874266681287808:12345-192.168.206.58@tcp:103:ldlm_bl.0 Request processed in 7666us (7956us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440275.582745:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 42 00000100:00100000:1.0:1787440275.582745:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 0 00000100:00100000:1.0:1787440275.582753:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04ca3a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+7:2363:x1874266681287936:12345-192.168.206.58@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1787440275.583353:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04ca3a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+8:2363:x1874266681287936:12345-192.168.206.58@tcp:4:lhsmtool_posix.0 Request processed in 598us (799us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1787440275.583361:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 0 00002000:00100000:1.0:1787440275.583368:0:6703:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff8ee04ca3a300 x1874266681287936/t4294967302(0) o4->792563a7-4c22-4ac7-ac25-d49ef7fb41a8@192.168.206.58@tcp:436/0 lens 504/448 e 0 to 0 dl 1787440286 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787440275.583376:0:6703:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ee04ca3a300 with x1874266681287936 ext(0->8) 00002000:00010000:1.0:1787440275.583379:0:6703:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8ee04ca3a300 00000100:00100000:0.0:1787440275.587455:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440275.587561:0:6892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681288064 00000100:00100000:3.0:1787440275.587571:0:6892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681288064 00000100:00100000:3.0:1787440275.587619:0:6892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 80 00000100:00100000:3.0:1787440275.587630:0:6892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04ca3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+29:10461:x1874266681288064:12345-192.168.206.58@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1787440275.623549:0:5871:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000004:00080000:2.0:1787440275.623562:0:5871:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:2.0:1787440275.623587:0:5871:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000001:00080000:2.0:1787440275.623608:0:5871:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967355 is committed 00000020:00080000:2.0:1787440275.623746:0:5882:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:2.0:1787440275.623756:0:5882:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:2.0:1787440275.623764:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787440275.623784:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee047a21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874266701235712:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1787440275.623849:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440275.624019:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701235712 00000100:00100000:3.0:1787440275.624027:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701235712 00000100:00100000:3.0:1787440275.624089:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787440275.624097:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee047a20700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1874266701235712:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1787440275.624158:0:6892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04ca3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+13:10461:x1874266681288064:12345-192.168.206.58@tcp:44:lhsmtool_posix.0 Request processed in 36528us (36707us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440275.624168:0:6892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 80 00002000:00010000:3.0:1787440275.624253:0:6695:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1787440275.624257:0:6695:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1787440275 00002000:00010000:3.0:1787440275.624260:0:6695:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1787440275.624276:0:6695:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1787440275 -> 1787440275 00002000:00010000:3.0:1787440275.624278:0:6695:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1787440275.624324:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee047a20700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3311:x1874266701235712:12345-0@lo:2:osp-syn-1-0.0 Request processed in 227us (474us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1787440275.624331:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:3.0:1787440275.624349:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:0.0:1787440275.624952:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8ee047a21c00/2, rc 0, transno 4294967303 00000100:00100000:0.0:1787440275.624960:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee047a21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874266701235712:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1787440275.627167:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440275.627253:0:9225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681288192 00000100:00100000:3.0:1787440275.627264:0:9225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681288192 00000100:00100000:3.0:1787440275.627319:0:9225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 30 00000100:00100000:3.0:1787440275.627329:0:9225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04ca39f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+8:2362:x1874266681288192:12345-192.168.206.58@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1787440275.686638:0:9225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04ca39f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+8:2362:x1874266681288192:12345-192.168.206.58@tcp:16:lhsmtool_posix.0 Request processed in 59301us (59471us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440275.686651:0:9225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 30 00000001:00080000:1.0:1787440275.687021:0:7640:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000001:00080000:1.0:1787440275.687037:0:7640:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000100:00100000:3.0:1787440275.690085:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:2.0:1787440275.690286:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681288448 00000100:00100000:2.0:1787440275.690296:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681288448 00000100:00100000:2.0:1787440275.690352:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 81 00000100:00100000:2.0:1787440275.690362:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee050359f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+13:10461:x1874266681288448:12345-192.168.206.58@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787440275.690410:0:5849:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787440275.690439:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94200/0x85f5fa77adf3c834 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6223a expref: 13 pid: 6892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440275.690456:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8ee0460cca00) 00010000:00010000:2.0:1787440275.690461:0:5849:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787440275.690510:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f000/0x85f5fa77adf3c849 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440275.690523:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f000/0x85f5fa77adf3c849 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440275.690533:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f000/0x85f5fa77adf3c849 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787440275.690789:0:5849:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000033eb88a4 reply state 00000000c35d3e86 transno 4294967356 ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f000/0x85f5fa77adf3c849 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440275.690798:0:5849:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787440275.690891:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee050359f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+14:10461:x1874266681288448:12345-192.168.206.58@tcp:36:lhsmtool_posix.0 Request processed in 530us (815us total) trans 4294967356 rc 0/0 00000100:00100000:2.0:1787440275.690899:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 81 00010000:00010000:1.0:1787440275.694230:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f000/0x85f5fa77adf3c849 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440275.694247:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f000/0x85f5fa77adf3c849 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440275.694254:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f000/0x85f5fa77adf3c849 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440275.694260:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee07f86f000 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:1.0:1787440275.694264:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f000/0x85f5fa77adf3c849 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440275.694284:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f000/0x85f5fa77adf3c849 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440275.694300:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8ee0460cca00) 00010000:00010000:1.0:1787440275.694304:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440275.694308:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f000/0x85f5fa77adf3c849 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440275.694315:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f000/0x85f5fa77adf3c849 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440275.697105:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440275.697427:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681288576 00000100:00100000:0.0:1787440275.697436:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681288576 00000100:00100000:0.0:1787440275.697516:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 31 00000100:00100000:0.0:1787440275.697526:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee05035aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+6:2363:x1874266681288576:12345-192.168.206.58@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1787440275.697770:0:6695:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:0.0:1787440275.697774:0:6695:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1787440275 -> 1787440274 00002000:00010000:0.0:1787440275.697782:0:6695:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1787440273 00002000:00010000:0.0:1787440275.697784:0:6695:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1787440275 -> 1787440274 00002000:00010000:0.0:1787440275.697787:0:6695:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1787440275.697844:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee05035aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+7:2363:x1874266681288576:12345-192.168.206.58@tcp:2:lhsmtool_posix.0 Request processed in 318us (747us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1787440275.697852:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 31 00000100:00100000:1.0:1787440275.705322:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440275.705447:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681288832 00000100:00100000:0.0:1787440275.705456:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681288832 00000100:00100000:0.0:1787440275.705531:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 82 00000100:00100000:0.0:1787440275.705541:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee0776b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+13:10461:x1874266681288832:12345-192.168.206.58@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1787440275.705614:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce800/0x85f5fa77adf3c850 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440275.705630:0:5851:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94400/0x85f5fa77adf3c811 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6222c expref: 13 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440275.705638:0:5851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce800/0x85f5fa77adf3c850 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440275.705669:0:5851:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94400/0x85f5fa77adf3c811 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6222c expref: 13 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440275.705683:0:5851:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94400/0x85f5fa77adf3c811 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6222c expref: 13 pid: 5851 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440275.705696:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee04ca38380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5851:1874266701235840:192.168.206.58@tcp:104: 00000100:00100000:0.0:1787440275.705786:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee06e7c7000 going to sleep for 11 seconds 00000100:00100000:0.0:1787440275.708119:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440275.710072:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681288960 00000100:00100000:3.0:1787440275.710086:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681288960 00010000:00010000:3.0:1787440275.710127:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94400/0x85f5fa77adf3c811 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6222c expref: 14 pid: 5851 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440275.710230:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 43 00000100:00100000:3.0:1787440275.710240:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04ca39c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+14:2363:x1874266681288960:12345-192.168.206.58@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787440275.710254:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787440275.710261:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94400/0x85f5fa77adf3c811 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6222c expref: 14 pid: 5851 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440275.710274:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94400/0x85f5fa77adf3c811 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6222c expref: 14 pid: 5851 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440275.710302:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8ee0460cca00) 00010000:00010000:3.0:1787440275.710306:0:5834:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce800/0x85f5fa77adf3c850 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440275.710315:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce800/0x85f5fa77adf3c850 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440275.710322:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce800/0x85f5fa77adf3c850 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440275.710338:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787440275.710386:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04ca39c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+14:2363:x1874266681288960:12345-192.168.206.58@tcp:103:ldlm_bl.0 Request processed in 148us (2274us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440275.710393:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 43 00010000:00010000:1.0:1787440275.710555:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94400/0x85f5fa77adf3c811 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6222c expref: 13 pid: 5851 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440275.710569:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee04ca38380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5851:1874266701235840:192.168.206.58@tcp:104: 00010000:00010000:1.0:1787440275.710588:0:5851:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce800/0x85f5fa77adf3c850 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440275.710597:0:5851:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce800/0x85f5fa77adf3c850 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440275.710602:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce800/0x85f5fa77adf3c850 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440275.710629:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce800/0x85f5fa77adf3c850 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440275.710636:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce800/0x85f5fa77adf3c850 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440275.710652:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce800/0x85f5fa77adf3c850 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440275.710658:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee04cbce800 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:1.0:1787440275.710662:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce800/0x85f5fa77adf3c850 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440275.710729:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce800/0x85f5fa77adf3c850 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440275.710741:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8ee0460cca00) 00010000:00010000:1.0:1787440275.710744:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1787440275.710748:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce800/0x85f5fa77adf3c850 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440275.710754:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce800/0x85f5fa77adf3c850 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440275.710807:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee0776b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+12:10461:x1874266681288832:12345-192.168.206.58@tcp:55:lhsmtool_posix.0 Request processed in 5266us (5492us total) trans 0 rc -22/-22 00000100:00100000:1.0:1787440275.710815:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 82 00000100:00100000:0.0:1787440275.722280:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:2.0:1787440275.722392:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681289088 00000100:00100000:2.0:1787440275.722401:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681289088 00000100:00100000:2.0:1787440275.722521:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 32 00000100:00100000:2.0:1787440275.722532:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04ca38380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+7:2361:x1874266681289088:12345-192.168.206.58@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1787440275.722588:0:6697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e5acaa5e/0x85f5fa77adf3c857 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440275.722609:0:6697:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000044f6f125/0x85f5fa77adf3c842 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62248 expref: 7 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440275.722617:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1787440275.722622:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787440275.722626:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e5acaa5e/0x85f5fa77adf3c857 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440275.722661:0:6697:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000044f6f125/0x85f5fa77adf3c842 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62248 expref: 7 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440275.722768:0:6697:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000044f6f125/0x85f5fa77adf3c842 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62248 expref: 7 pid: 6697 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440275.722791:0:6697:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee047a23800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6697:1874266701235968:192.168.206.58@tcp:104: 00000100:00100000:2.0:1787440275.722891:0:6697:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee07f9a8900 going to sleep for 11 seconds 00000100:00100000:0.0:1787440275.728622:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440275.728706:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681289216 00000100:00100000:3.0:1787440275.728715:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681289216 00010000:00010000:3.0:1787440275.728751:0:6711:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000044f6f125/0x85f5fa77adf3c842 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62248 expref: 8 pid: 6697 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440275.728759:0:6697:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee047a23800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6697:1874266701235968:192.168.206.58@tcp:104: 00010000:00010000:1.0:1787440275.728787:0:6697:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e5acaa5e/0x85f5fa77adf3c857 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440275.728799:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 44 00000100:00100000:3.0:1787440275.728809:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee047a79880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+8:2362:x1874266681289216:12345-192.168.206.58@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787440275.728822:0:6711:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787440275.728845:0:6711:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000044f6f125/0x85f5fa77adf3c842 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62248 expref: 8 pid: 6697 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440275.728858:0:6711:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000044f6f125/0x85f5fa77adf3c842 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62248 expref: 8 pid: 6697 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440275.728893:0:6711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000044f6f125/0x85f5fa77adf3c842 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62248 expref: 8 pid: 6697 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440275.728923:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787440275.728928:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787440275.728934:0:6711:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e5acaa5e/0x85f5fa77adf3c857 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440275.728944:0:6711:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e5acaa5e/0x85f5fa77adf3c857 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440275.728963:0:6711:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787440275.729010:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee047a79880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+7:2362:x1874266681289216:12345-192.168.206.58@tcp:103:ldlm_bl.0 Request processed in 202us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440275.729018:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 44 00010000:00010000:1.0:1787440275.729067:0:6697:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e5acaa5e/0x85f5fa77adf3c857 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440275.729086:0:6697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e5acaa5e/0x85f5fa77adf3c857 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440275.729110:0:6697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e5acaa5e/0x85f5fa77adf3c857 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440275.729118:0:6697:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e5acaa5e/0x85f5fa77adf3c857 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440275.729127:0:6697:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e5acaa5e/0x85f5fa77adf3c857 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440275.729135:0:6697:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee07f86e400 already unused, calling callback (ffffffffc15b52a0) 00010000:00010000:1.0:1787440275.729140:0:6697:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e5acaa5e/0x85f5fa77adf3c857 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440275.729149:0:6697:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e5acaa5e/0x85f5fa77adf3c857 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440275.729161:0:6697:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e5acaa5e/0x85f5fa77adf3c857 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440275.729169:0:6697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e5acaa5e/0x85f5fa77adf3c857 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440275.729249:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04ca38380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+6:2361:x1874266681289088:12345-192.168.206.58@tcp:1:lhsmtool_posix.0 Request processed in 6719us (7154us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440275.729257:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 32 00000100:00100000:0.0:1787440275.736563:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440275.736619:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681289472 00000100:00100000:0.0:1787440275.736628:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681289472 00000100:00100000:0.0:1787440275.736677:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 83 00000100:00100000:0.0:1787440275.736687:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee047a7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+12:10461:x1874266681289472:12345-192.168.206.58@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787440275.736771:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce200/0x85f5fa77adf3c85e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440275.736788:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce200/0x85f5fa77adf3c85e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440275.736799:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce200/0x85f5fa77adf3c85e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440275.737660:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcee00/0x85f5fa77adf3c865 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440275.737677:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf200/0x85f5fa77adf3c81f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62233 expref: 13 pid: 6892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440275.737686:0:5849:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcee00/0x85f5fa77adf3c865 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440275.737731:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf200/0x85f5fa77adf3c81f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62233 expref: 13 pid: 6892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440275.737747:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf200/0x85f5fa77adf3c81f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62233 expref: 13 pid: 6892 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440275.737775:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee04a731c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5849:1874266701236096:192.168.206.58@tcp:104: 00000100:00100000:0.0:1787440275.737860:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee06e7c7840 going to sleep for 11 seconds 00000100:00100000:0.0:1787440275.742603:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee04a731c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5849:1874266701236096:192.168.206.58@tcp:104: 00010000:00010000:0.0:1787440275.742631:0:5849:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcee00/0x85f5fa77adf3c865 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440275.742665:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440275.742781:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681289600 00000100:00100000:0.0:1787440275.742789:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681289600 00010000:00010000:0.0:1787440275.742823:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf200/0x85f5fa77adf3c81f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62233 expref: 14 pid: 6892 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440275.742858:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 45 00000100:00100000:0.0:1787440275.742867:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee050358700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+14:2363:x1874266681289600:12345-192.168.206.58@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787440275.742880:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787440275.742887:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf200/0x85f5fa77adf3c81f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62233 expref: 14 pid: 6892 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440275.742899:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf200/0x85f5fa77adf3c81f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62233 expref: 14 pid: 6892 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440275.743067:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf200/0x85f5fa77adf3c81f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62233 expref: 14 pid: 6892 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440275.743081:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8ee0460cca00) 00010000:00010000:0.0:1787440275.743086:0:5836:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcee00/0x85f5fa77adf3c865 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440275.743339:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcee00/0x85f5fa77adf3c865 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440275.743347:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcee00/0x85f5fa77adf3c865 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440275.743450:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787440275.743583:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee050358700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+13:2363:x1874266681289600:12345-192.168.206.58@tcp:103:ldlm_bl.0 Request processed in 715us (918us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440275.743600:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 45 00010000:00010000:2.0:1787440275.743843:0:5849:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcee00/0x85f5fa77adf3c865 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440275.743852:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcee00/0x85f5fa77adf3c865 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787440275.744340:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:2.0:1787440275.744546:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000001:00080000:2.0:1787440275.744614:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:2.0:1787440275.744771:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee047a23480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5849:1874266701236224:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1787440275.744836:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440275.744875:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee07f9a8b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787440275.744947:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701236224 00000100:00100000:1.0:1787440275.744954:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701236224 00000100:00100000:1.0:1787440275.745038:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787440275.745048:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee047a21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5849:x1874266701236224:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1787440275.745168:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee047a21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5849:x1874266701236224:12345-0@lo:1000:mdt00_000.0 Request processed in 121us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440275.745175:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787440275.745263:0:5849:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:3.0:1787440275.745270:0:5849:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8ee047a21c00, transno 4294967303 00000100:00100000:3.0:1787440275.745317:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee047a23480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5849:1874266701236224:0@lo:1000:mdt00_000.0 00000001:00080000:3.0:1787440275.745851:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967360 00000100:00100000:3.0:1787440275.745906:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee05035a680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5849:1874266701236352:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1787440275.745949:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440275.745974:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee045ed4f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787440275.745999:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701236352 00000100:00100000:3.0:1787440275.746003:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701236352 00000100:00100000:3.0:1787440275.746033:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787440275.746040:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee050358380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5849:x1874266701236352:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1787440275.746211:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee050358380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5849:x1874266701236352:12345-0@lo:1000:mdt00_000.0 Request processed in 171us (261us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1787440275.746219:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787440275.746255:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee05035a680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5849:1874266701236352:0@lo:1000:mdt00_000.0 00010000:00010000:3.0:1787440275.746288:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcee00/0x85f5fa77adf3c865 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440275.746299:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcee00/0x85f5fa77adf3c865 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440275.746307:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcee00/0x85f5fa77adf3c865 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440275.746314:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee04cbcee00 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:3.0:1787440275.746318:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcee00/0x85f5fa77adf3c865 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440275.746327:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcee00/0x85f5fa77adf3c865 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440275.746346:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8ee0460cca00) 00010000:00010000:3.0:1787440275.746350:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787440275.746355:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcee00/0x85f5fa77adf3c865 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440275.746363:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcee00/0x85f5fa77adf3c865 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440275.746396:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce600/0x85f5fa77adf3c79a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440275.746408:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce600/0x85f5fa77adf3c79a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440275.746414:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce600/0x85f5fa77adf3c79a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440275.746419:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee04cbce600 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:3.0:1787440275.746422:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce600/0x85f5fa77adf3c79a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440275.746428:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce600/0x85f5fa77adf3c79a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440275.746436:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ee050ca1c00) 00010000:00010000:3.0:1787440275.746439:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787440275.746441:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce600/0x85f5fa77adf3c79a lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440275.746446:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce600/0x85f5fa77adf3c79a lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440275.746473:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95a00/0x85f5fa77adf3c86c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440275.746487:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95c00/0x85f5fa77adf3c7b6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62217 expref: 16 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440275.746517:0:5849:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95a00/0x85f5fa77adf3c86c lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440275.746541:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95c00/0x85f5fa77adf3c7b6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62217 expref: 16 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440275.746561:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95c00/0x85f5fa77adf3c7b6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62217 expref: 16 pid: 5849 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440275.746572:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee05035b800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5849:1874266701236480:192.168.206.58@tcp:104: 00000100:00100000:3.0:1787440275.746634:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee077da7600 going to sleep for 11 seconds 00000100:00100000:3.0:1787440275.750286:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:2.0:1787440275.750331:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681289728 00000100:00100000:2.0:1787440275.750340:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681289728 00010000:00010000:2.0:1787440275.750375:0:6711:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95c00/0x85f5fa77adf3c7b6 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62217 expref: 17 pid: 5849 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440275.750415:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 46 00000100:00100000:2.0:1787440275.750425:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee050358000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+17:2363:x1874266681289728:12345-192.168.206.58@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787440275.750437:0:6711:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787440275.750444:0:6711:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95c00/0x85f5fa77adf3c7b6 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62217 expref: 17 pid: 5849 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440275.750457:0:6711:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95c00/0x85f5fa77adf3c7b6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62217 expref: 17 pid: 5849 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440275.750489:0:6711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ee050ca1c00) 00010000:00010000:2.0:1787440275.750510:0:6711:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95a00/0x85f5fa77adf3c86c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440275.750520:0:6711:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95a00/0x85f5fa77adf3c86c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440275.750528:0:6711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95a00/0x85f5fa77adf3c86c lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440275.750546:0:6711:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787440275.750600:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee050358000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+17:2363:x1874266681289728:12345-192.168.206.58@tcp:103:ldlm_bl.0 Request processed in 177us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440275.750608:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 46 00010000:00010000:1.0:1787440275.751892:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95c00/0x85f5fa77adf3c7b6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62217 expref: 16 pid: 5849 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440275.751925:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee05035b800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5849:1874266701236480:192.168.206.58@tcp:104: 00010000:00010000:1.0:1787440275.751950:0:5849:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95a00/0x85f5fa77adf3c86c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440275.751959:0:5849:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95a00/0x85f5fa77adf3c86c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440275.751966:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95a00/0x85f5fa77adf3c86c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440275.751978:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95a00/0x85f5fa77adf3c86c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440275.751985:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95a00/0x85f5fa77adf3c86c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440275.752011:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95a00/0x85f5fa77adf3c86c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440275.752018:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee049e95a00 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:1.0:1787440275.752023:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95a00/0x85f5fa77adf3c86c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440275.752030:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95a00/0x85f5fa77adf3c86c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440275.752041:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ee050ca1c00) 00010000:00010000:1.0:1787440275.752045:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440275.752057:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95a00/0x85f5fa77adf3c86c lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440275.752063:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95a00/0x85f5fa77adf3c86c lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440275.752074:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce200/0x85f5fa77adf3c85e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440275.752081:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce200/0x85f5fa77adf3c85e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440275.752087:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce200/0x85f5fa77adf3c85e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440275.752093:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee04cbce200 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:1.0:1787440275.752097:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce200/0x85f5fa77adf3c85e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440275.752114:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce200/0x85f5fa77adf3c85e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440275.752402:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ee050ca1c00) 00010000:00010000:1.0:1787440275.752406:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787440275.752410:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce200/0x85f5fa77adf3c85e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440275.752416:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce200/0x85f5fa77adf3c85e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440275.752682:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee047a7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+15:10461:x1874266681289472:12345-192.168.206.58@tcp:57:lhsmtool_posix.0 Request processed in 15983us (16114us total) trans 4294967361 rc 0/0 00000100:00100000:1.0:1787440275.752699:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 83 00000020:00080000:1.0:1787440275.752704:0:5849:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1787440275.752827:0:11682:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787440275.752832:0:11682:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787440275.752859:0:11682:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1787440275.752871:0:11682:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787440275.755893:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440275.756120:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681289984 00000100:00100000:0.0:1787440275.756128:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681289984 00000100:00100000:0.0:1787440275.756192:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 20 00000100:00100000:0.0:1787440275.756201:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee05035ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+15:10461:x1874266681289984:12345-192.168.206.58@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1787440275.757000:0:5852:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1787440275.757100:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967362 00010000:00010000:0.0:1787440275.757145:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf200/0x85f5fa77adf3c873 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440275.757159:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf200/0x85f5fa77adf3c873 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440275.757170:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf200/0x85f5fa77adf3c873 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440275.757264:0:5852:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf200/0x85f5fa77adf3c873 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440275.757272:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf200/0x85f5fa77adf3c873 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440275.757279:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf200/0x85f5fa77adf3c873 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440275.757339:0:5852:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787440275.757427:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee05035ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+17:10461:x1874266681289984:12345-192.168.206.58@tcp:35:lhsmtool_posix.0 Request processed in 1225us (1541us total) trans 4294967363 rc 0/0 00000100:00100000:0.0:1787440275.757435:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 20 00000020:00080000:0.0:1787440275.757440:0:5852:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787440275.757604:0:5837:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787440275.757610:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf200/0x85f5fa77adf3c873 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440275.757618:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee04cbcf200 already unused, calling callback (ffffffffc15b52a0) 00010000:00010000:2.0:1787440275.757622:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf200/0x85f5fa77adf3c873 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440275.757630:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf200/0x85f5fa77adf3c873 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440275.757643:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8ee050ca1600) 00010000:00010000:2.0:1787440275.757646:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787440275.757650:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf200/0x85f5fa77adf3c873 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440275.757666:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf200/0x85f5fa77adf3c873 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440275.757680:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787440275.757682:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787440275.757683:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787440275.780558:0:12002:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787440275.780670:0:12002:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787440275.780709:0:12002:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1787440275.780715:0:12002:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787440275.911761:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440275.911913:0:6892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681290240 00000100:00100000:3.0:1787440275.911922:0:6892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681290240 00000100:00100000:3.0:1787440275.912132:0:6892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 84 00000100:00100000:3.0:1787440275.912141:0:6892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee0776baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+17:10471:x1874266681290240:12345-192.168.206.58@tcp:101:lfs.0 00010000:00010000:3.0:1787440275.912166:0:6892:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440275.912194:0:6892:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94e00/0x85f5fa77adf3c87a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fab14535dc6224f expref: -99 pid: 6892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440275.912426:0:6892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95000/0x85f5fa77adf3c881 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440275.912441:0:6892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95000/0x85f5fa77adf3c881 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440275.912453:0:6892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95000/0x85f5fa77adf3c881 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787440275.912463:0:6892:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:3.0:1787440275.912692:0:6892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94e00/0x85f5fa77adf3c87a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6224f expref: 20 pid: 6892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440275.912717:0:6892:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95000/0x85f5fa77adf3c881 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6224f expref: 19 pid: 6892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440275.912725:0:6892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8ee0460ccd00) 00010000:00010000:3.0:1787440275.912728:0:6892:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787440275.912730:0:6892:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee049e95000, rc 0) 00000100:00100000:3.0:1787440275.912784:0:6892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee0776baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+19:10471:x1874266681290240:12345-192.168.206.58@tcp:101:lfs.0 Request processed in 644us (1032us total) trans 4294967364 rc 0/0 00000100:00100000:3.0:1787440275.912790:0:6892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 84 00000100:00100000:3.0:1787440275.920715:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440275.920750:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681290368 00000100:00100000:3.0:1787440275.920758:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681290368 00000100:00100000:3.0:1787440275.920802:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 85 00000100:00100000:3.0:1787440275.920812:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee050359c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+19:10471:x1874266681290368:12345-192.168.206.58@tcp:34:lfs.0 00010000:00010000:3.0:1787440275.920884:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94600/0x85f5fa77adf3c88f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440275.920900:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94600/0x85f5fa77adf3c88f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440275.920913:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94600/0x85f5fa77adf3c88f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440275.920928:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94c00/0x85f5fa77adf3c896 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440275.920935:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94c00/0x85f5fa77adf3c896 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440275.920954:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94c00/0x85f5fa77adf3c896 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440275.921254:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95400/0x85f5fa77adf3c89d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440275.921263:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95400/0x85f5fa77adf3c89d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440275.921271:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95400/0x85f5fa77adf3c89d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787440275.921309:0:5850:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95400/0x85f5fa77adf3c89d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440275.921321:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94600/0x85f5fa77adf3c88f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440275.921327:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94600/0x85f5fa77adf3c88f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440275.921333:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94600/0x85f5fa77adf3c88f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440275.921338:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee049e94600 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:3.0:1787440275.921343:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94600/0x85f5fa77adf3c88f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440275.921349:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94600/0x85f5fa77adf3c88f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440275.921361:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8ee0460ccd00) 00010000:00010000:3.0:1787440275.921369:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440275.921374:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94600/0x85f5fa77adf3c88f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440275.921380:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94600/0x85f5fa77adf3c88f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440275.921391:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94c00/0x85f5fa77adf3c896 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440275.921396:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94c00/0x85f5fa77adf3c896 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440275.921402:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94c00/0x85f5fa77adf3c896 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440275.921407:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee049e94c00 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:3.0:1787440275.921410:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94c00/0x85f5fa77adf3c896 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440275.921416:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94c00/0x85f5fa77adf3c896 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440275.921424:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8ee0460cca00) 00010000:00010000:3.0:1787440275.921426:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440275.921429:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94c00/0x85f5fa77adf3c896 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440275.921434:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94c00/0x85f5fa77adf3c896 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440275.921447:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95400/0x85f5fa77adf3c89d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440275.921459:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95400/0x85f5fa77adf3c89d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440275.921465:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95400/0x85f5fa77adf3c89d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440275.921470:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee049e95400 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:3.0:1787440275.921474:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95400/0x85f5fa77adf3c89d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440275.921480:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95400/0x85f5fa77adf3c89d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440275.921488:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ee0460cc400) 00010000:00010000:3.0:1787440275.921490:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440275.921512:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95400/0x85f5fa77adf3c89d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440275.921518:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95400/0x85f5fa77adf3c89d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440275.921592:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee050359c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+19:10471:x1874266681290368:12345-192.168.206.58@tcp:34:lfs.0 Request processed in 779us (882us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440275.921600:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 85 00000100:00100000:3.0:1787440275.981431:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440275.983892:0:6892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681290624 00000100:00100000:0.0:1787440275.983907:0:6892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681290624 00000100:00100000:0.0:1787440275.983992:0:6892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 86 00000100:00100000:0.0:1787440275.984004:0:6892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee050359880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+19:10474:x1874266681290624:12345-192.168.206.58@tcp:101:lfs.0 00010000:00010000:0.0:1787440275.984026:0:6892:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440275.984049:0:6892:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcec00/0x85f5fa77adf3c8a4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fab14535dc62256 expref: -99 pid: 6892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440275.984922:0:6892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86fe00/0x85f5fa77adf3c8ab lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440275.984942:0:6892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86fe00/0x85f5fa77adf3c8ab lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440275.984952:0:6892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86fe00/0x85f5fa77adf3c8ab lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440275.984969:0:6892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e600/0x85f5fa77adf3c8b2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440275.984975:0:6892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e600/0x85f5fa77adf3c8b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440275.984981:0:6892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e600/0x85f5fa77adf3c8b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440275.985953:0:6892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86ec00/0x85f5fa77adf3c8b9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440275.985964:0:6892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86ec00/0x85f5fa77adf3c8b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440275.985973:0:6892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86ec00/0x85f5fa77adf3c8b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787440275.985992:0:6892:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:2.0:1787440275.986072:0:6892:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86fe00/0x85f5fa77adf3c8ab lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440275.986079:0:6892:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86fe00/0x85f5fa77adf3c8ab lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440275.986085:0:6892:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86fe00/0x85f5fa77adf3c8ab lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440275.986090:0:6892:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee07f86fe00 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:2.0:1787440275.987855:0:6892:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86fe00/0x85f5fa77adf3c8ab lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440275.987866:0:6892:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86fe00/0x85f5fa77adf3c8ab lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440275.987882:0:6892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8ee0460ccd00) 00010000:00010000:2.0:1787440275.987885:0:6892:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440275.987890:0:6892:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86fe00/0x85f5fa77adf3c8ab lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440275.987896:0:6892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86fe00/0x85f5fa77adf3c8ab lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440275.987914:0:6892:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e600/0x85f5fa77adf3c8b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440275.987919:0:6892:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e600/0x85f5fa77adf3c8b2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440275.987942:0:6892:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e600/0x85f5fa77adf3c8b2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440275.987947:0:6892:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee07f86e600 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:2.0:1787440275.987949:0:6892:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e600/0x85f5fa77adf3c8b2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440275.987954:0:6892:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e600/0x85f5fa77adf3c8b2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440275.987960:0:6892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8ee054b3c800) 00010000:00010000:2.0:1787440275.987962:0:6892:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440275.987964:0:6892:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e600/0x85f5fa77adf3c8b2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440275.987969:0:6892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e600/0x85f5fa77adf3c8b2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440275.988026:0:6892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcec00/0x85f5fa77adf3c8a4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62256 expref: 22 pid: 6892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440275.988050:0:6892:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86ec00/0x85f5fa77adf3c8b9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62256 expref: 21 pid: 6892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440275.988058:0:6892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ee054b3cd00) 00010000:00010000:2.0:1787440275.988060:0:6892:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787440275.988062:0:6892:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee07f86ec00, rc 0) 00000100:00100000:2.0:1787440275.989884:0:6892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee050359880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+21:10474:x1874266681290624:12345-192.168.206.58@tcp:101:lfs.0 Request processed in 5872us (8449us total) trans 4294967365 rc 0/0 00000100:00100000:2.0:1787440275.989911:0:6892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 86 00000100:00100000:2.0:1787440275.994467:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:1.0:1787440275.994706:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681290752 00000100:00100000:1.0:1787440275.994716:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681290752 00000100:00100000:1.0:1787440275.994774:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 87 00000100:00100000:1.0:1787440275.994784:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee047a21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+21:10474:x1874266681290752:12345-192.168.206.58@tcp:54:lfs.0 00010000:00010000:1.0:1787440275.994851:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fa00/0x85f5fa77adf3c8c7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440275.994936:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fa00/0x85f5fa77adf3c8c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440275.994965:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fa00/0x85f5fa77adf3c8c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440275.994992:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fa00/0x85f5fa77adf3c8c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440275.995000:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fa00/0x85f5fa77adf3c8c7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440275.995007:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fa00/0x85f5fa77adf3c8c7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440275.995014:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee07fb9fa00 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:1.0:1787440275.995018:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fa00/0x85f5fa77adf3c8c7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440275.995025:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fa00/0x85f5fa77adf3c8c7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440275.995038:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ee054b3cd00) 00010000:00010000:1.0:1787440275.995041:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787440275.995045:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fa00/0x85f5fa77adf3c8c7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440275.995050:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fa00/0x85f5fa77adf3c8c7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440275.995141:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee047a21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+21:10474:x1874266681290752:12345-192.168.206.58@tcp:54:lfs.0 Request processed in 358us (685us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440275.995149:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 87 00000100:00100000:3.0:1787440275.999348:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:2.0:1787440276.003117:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681291008 00000100:00100000:2.0:1787440276.003132:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681291008 00000100:00100000:2.0:1787440276.003487:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 21 00000100:00100000:2.0:1787440276.003522:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee079bac850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+21:10474:x1874266681291008:12345-192.168.206.58@tcp:35:lfs.0 00000100:00100000:2.0:1787440276.003764:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee079bac850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+22:10474:x1874266681291008:12345-192.168.206.58@tcp:35:lfs.0 Request processed in 244us (4424us total) trans 4294967366 rc 0/0 00000100:00100000:2.0:1787440276.003772:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 21 00000100:00080000:3.0:1787440276.009096:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787440276.047226:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:1.0:1787440276.047300:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681291264 00000100:00100000:1.0:1787440276.047327:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681291264 00000100:00100000:1.0:1787440276.047389:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 88 00000100:00100000:1.0:1787440276.047399:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee047a23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+22:10001:x1874266681291264:12345-192.168.206.58@tcp:101:bash.0 00010000:00010000:1.0:1787440276.047421:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440276.047439:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fa00/0x85f5fa77adf3c8ce lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fab14535dc6225d expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440276.047566:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e000/0x85f5fa77adf3c8d5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440276.047581:0:5851:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86ec00/0x85f5fa77adf3c8b9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62256 expref: 23 pid: 6892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440276.047591:0:5851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e000/0x85f5fa77adf3c8d5 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440276.047633:0:5851:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86ec00/0x85f5fa77adf3c8b9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62256 expref: 23 pid: 6892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440276.047647:0:5851:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86ec00/0x85f5fa77adf3c8b9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62256 expref: 23 pid: 6892 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440276.047661:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee0776b8700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5851:1874266701236608:192.168.206.58@tcp:104: 00000100:00100000:1.0:1787440276.047754:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee0460ebf00 going to sleep for 11 seconds 00000100:00100000:0.0:1787440276.051642:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee0776b8700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5851:1874266701236608:192.168.206.58@tcp:104: 00010000:00010000:0.0:1787440276.051668:0:5851:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e000/0x85f5fa77adf3c8d5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440276.055475:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440276.055813:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681291392 00000100:00100000:3.0:1787440276.055822:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681291392 00010000:00010000:3.0:1787440276.055869:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86ec00/0x85f5fa77adf3c8b9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62256 expref: 24 pid: 6892 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440276.055914:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 47 00000100:00100000:3.0:1787440276.055924:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee047a22d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+24:2362:x1874266681291392:12345-192.168.206.58@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787440276.055938:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787440276.055945:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86ec00/0x85f5fa77adf3c8b9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62256 expref: 24 pid: 6892 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440276.055958:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86ec00/0x85f5fa77adf3c8b9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62256 expref: 24 pid: 6892 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440276.055980:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86ec00/0x85f5fa77adf3c8b9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62256 expref: 24 pid: 6892 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440276.055996:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ee054b3cd00) 00010000:00010000:3.0:1787440276.056001:0:5834:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e000/0x85f5fa77adf3c8d5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440276.056009:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e000/0x85f5fa77adf3c8d5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440276.056016:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e000/0x85f5fa77adf3c8d5 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440276.056049:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787440276.056106:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee047a22d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+23:2362:x1874266681291392:12345-192.168.206.58@tcp:103:ldlm_bl.0 Request processed in 183us (639us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440276.056113:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 47 00010000:00010000:1.0:1787440276.056345:0:5851:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e000/0x85f5fa77adf3c8d5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440276.056353:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e000/0x85f5fa77adf3c8d5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787440276.056382:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:1.0:1787440276.056560:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fa00/0x85f5fa77adf3c8ce lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6225d expref: 24 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440276.056576:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e000/0x85f5fa77adf3c8d5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6225d expref: 23 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440276.056583:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ee054b3cd00) 00010000:00010000:1.0:1787440276.056586:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787440276.056588:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee07fb9e000, rc 0) 00000100:00100000:1.0:1787440276.056628:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee047a23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+23:10001:x1874266681291264:12345-192.168.206.58@tcp:101:bash.0 Request processed in 9230us (9410us total) trans 4294967367 rc 0/0 00000100:00100000:1.0:1787440276.056636:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 88 00000100:00100000:1.0:1787440276.064265:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:2.0:1787440276.064419:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681291648 00000100:00100000:2.0:1787440276.064428:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681291648 00000100:00100000:2.0:1787440276.064489:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 89 00000100:00100000:2.0:1787440276.064534:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee0776ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+23:10001:x1874266681291648:12345-192.168.206.58@tcp:36:bash.0 00010000:00010000:2.0:1787440276.064792:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86fe00/0x85f5fa77adf3c8e3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440276.064808:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86fe00/0x85f5fa77adf3c8e3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440276.064820:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86fe00/0x85f5fa77adf3c8e3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787440276.064884:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000004:00010000:2.0:1787440276.064910:0:5849:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d3b4f788 reply state 00000000e46b42a8 transno 4294967369 ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86fe00/0x85f5fa77adf3c8e3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440276.064936:0:5849:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1787440276.064990:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967369 00000100:00100000:2.0:1787440276.065088:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee0776ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+27:10001:x1874266681291648:12345-192.168.206.58@tcp:36:bash.0 Request processed in 554us (830us total) trans 4294967370 rc 0/0 00000100:00100000:2.0:1787440276.065095:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 89 00000020:00080000:2.0:1787440276.065100:0:5849:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1787440276.071755:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440276.072039:0:6892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681291776 00000100:00100000:3.0:1787440276.072060:0:6892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681291776 00000100:00100000:3.0:1787440276.072129:0:6892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 90 00000100:00100000:3.0:1787440276.072138:0:6892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee047a20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+27:10001:x1874266681291776:12345-192.168.206.58@tcp:101:bash.0 00010000:00010000:3.0:1787440276.072160:0:6892:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440276.072189:0:6892:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95400/0x85f5fa77adf3c8ea lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fab14535dc62264 expref: -99 pid: 6892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440276.072407:0:6892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95400/0x85f5fa77adf3c8ea lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62264 expref: 28 pid: 6892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440276.072422:0:6892:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95400/0x85f5fa77adf3c8ea lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62264 expref: 28 pid: 6892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440276.072442:0:6892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ee054b3cd00) 00010000:00010000:3.0:1787440276.072445:0:6892:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787440276.072448:0:6892:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee049e95400, rc 0) 00000100:00100000:3.0:1787440276.072770:0:6892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee047a20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+28:10001:x1874266681291776:12345-192.168.206.58@tcp:101:bash.0 Request processed in 632us (1023us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440276.072777:0:6892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 90 00010000:00010000:1.0:1787440276.073466:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86fe00/0x85f5fa77adf3c8e3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440276.073476:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86fe00/0x85f5fa77adf3c8e3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440276.073484:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86fe00/0x85f5fa77adf3c8e3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440276.073489:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee07f86fe00 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:1.0:1787440276.073510:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86fe00/0x85f5fa77adf3c8e3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440276.073518:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86fe00/0x85f5fa77adf3c8e3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440276.073545:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ee054b3cd00) 00010000:00010000:1.0:1787440276.073548:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440276.073551:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86fe00/0x85f5fa77adf3c8e3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440276.073558:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86fe00/0x85f5fa77adf3c8e3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440276.077034:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440276.077101:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681291904 00000100:00100000:0.0:1787440276.077109:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681291904 00000100:00100000:0.0:1787440276.077313:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 33 00000100:00100000:0.0:1787440276.077322:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee0806dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+6:10001:x1874266681291904:12345-192.168.206.58@tcp:101:bash.0 00010000:00010000:0.0:1787440276.077338:0:6695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440276.077357:0:6695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ffc00b09/0x85f5fa77adf3c8f1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5fab14535dc6226b expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787440276.077382:0:6695:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a8a2c92, atime: 0x6a8a2c91, ctime: 0x6a8a2c92, blocks: 0xb 00010000:00010000:0.0:1787440276.077401:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=374s v=(0 0) 00010000:00010000:0.0:1787440276.077405:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787440276.077412:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ffc00b09/0x85f5fa77adf3c8f1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6226b expref: 7 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440276.077428:0:6695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ffc00b09/0x85f5fa77adf3c8f1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6226b expref: 7 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440276.077440:0:6695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee04cbcfe00, rc 0) 00000100:00100000:0.0:1787440276.077519:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee0806dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+7:10001:x1874266681291904:12345-192.168.206.58@tcp:101:bash.0 Request processed in 170us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440276.077526:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 33 00000100:00100000:3.0:1787440276.080171:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:1.0:1787440276.080326:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681292032 00000100:00100000:1.0:1787440276.080335:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681292032 00002000:00010000:1.0:1787440276.080372:0:6701:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:1.0:1787440276.080377:0:6701:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ee050358a80 with x1874266681292032 ext(0->18446744073709551615) 00002000:00010000:1.0:1787440276.080389:0:6701:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8ee050358a80. 00000100:00100000:1.0:1787440276.080517:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 1 00000100:00100000:1.0:1787440276.080527:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee050358a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+7:2363:x1874266681292032:12345-192.168.206.58@tcp:10:bash.0 00002000:00010000:1.0:1787440276.080790:0:6701:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:1.0:1787440276.080794:0:6701:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1787440274 -> 1787440276 00002000:00010000:1.0:1787440276.080796:0:6701:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 1787440273 -> 1787440273 00002000:00010000:1.0:1787440276.080798:0:6701:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1787440274 -> 1787440276 00002000:00010000:1.0:1787440276.080800:0:6701:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:1.0:1787440276.080867:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee050358a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+8:2363:x1874266681292032:12345-192.168.206.58@tcp:10:bash.0 Request processed in 332us (694us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1787440276.080876:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 1 00002000:00010000:1.0:1787440276.080879:0:6701:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:1.0:1787440276.080882:0:6701:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ee050358a80 with x1874266681292032 ext(0->18446744073709551615) 00002000:00010000:1.0:1787440276.080887:0:6701:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8ee050358a80. 00000100:00100000:2.0:1787440276.163118:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:1.0:1787440276.163342:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681292160 00000100:00100000:1.0:1787440276.163353:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681292160 00000100:00100000:1.0:1787440276.163412:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 91 00000100:00100000:1.0:1787440276.163422:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee047a22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+27:10488:x1874266681292160:12345-192.168.206.58@tcp:34:lfs.0 00010000:00010000:1.0:1787440276.163489:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fa00/0x85f5fa77adf3c8f8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440276.163554:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fa00/0x85f5fa77adf3c8f8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440276.163566:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fa00/0x85f5fa77adf3c8f8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440276.163582:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fe00/0x85f5fa77adf3c8ff lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440276.163589:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fe00/0x85f5fa77adf3c8ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440276.163596:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fe00/0x85f5fa77adf3c8ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440276.163882:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e400/0x85f5fa77adf3c906 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440276.163891:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e400/0x85f5fa77adf3c906 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440276.163899:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e400/0x85f5fa77adf3c906 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787440276.163938:0:5849:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e400/0x85f5fa77adf3c906 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440276.163957:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fa00/0x85f5fa77adf3c8f8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440276.163964:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fa00/0x85f5fa77adf3c8f8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440276.163971:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fa00/0x85f5fa77adf3c8f8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440276.163977:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee07fb9fa00 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:1.0:1787440276.163981:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fa00/0x85f5fa77adf3c8f8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440276.163989:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fa00/0x85f5fa77adf3c8f8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440276.164002:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8ee0460ccd00) 00010000:00010000:1.0:1787440276.164005:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440276.164009:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fa00/0x85f5fa77adf3c8f8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440276.164015:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fa00/0x85f5fa77adf3c8f8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440276.164027:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fe00/0x85f5fa77adf3c8ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440276.164034:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fe00/0x85f5fa77adf3c8ff lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440276.164040:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fe00/0x85f5fa77adf3c8ff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440276.164051:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee07fb9fe00 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:1.0:1787440276.164054:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fe00/0x85f5fa77adf3c8ff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440276.164060:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fe00/0x85f5fa77adf3c8ff lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440276.164069:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8ee05132e800) 00010000:00010000:1.0:1787440276.164071:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440276.164074:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fe00/0x85f5fa77adf3c8ff lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440276.164079:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fe00/0x85f5fa77adf3c8ff lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440276.165339:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e400/0x85f5fa77adf3c906 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440276.165352:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e400/0x85f5fa77adf3c906 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440276.165360:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e400/0x85f5fa77adf3c906 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440276.165365:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee07fb9e400 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:1.0:1787440276.165368:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e400/0x85f5fa77adf3c906 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440276.165375:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e400/0x85f5fa77adf3c906 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440276.165404:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ee054b3cd00) 00010000:00010000:1.0:1787440276.165407:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440276.165411:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e400/0x85f5fa77adf3c906 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440276.165417:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e400/0x85f5fa77adf3c906 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440276.166319:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee047a22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+27:10488:x1874266681292160:12345-192.168.206.58@tcp:34:lfs.0 Request processed in 2892us (3204us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440276.166332:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 91 00000100:00100000:2.0:1787440276.234525:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440276.234620:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681292416 00000100:00100000:0.0:1787440276.234630:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681292416 00000100:00100000:0.0:1787440276.234686:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 92 00000100:00100000:0.0:1787440276.234695:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee047a20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+27:10491:x1874266681292416:12345-192.168.206.58@tcp:101:lfs.0 00010000:00010000:0.0:1787440276.234715:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440276.234747:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfc00/0x85f5fa77adf3c90d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fab14535dc62272 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440276.234832:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf600/0x85f5fa77adf3c914 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440276.234846:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf600/0x85f5fa77adf3c914 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440276.234856:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf600/0x85f5fa77adf3c914 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440276.234882:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce000/0x85f5fa77adf3c91b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440276.234890:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce000/0x85f5fa77adf3c91b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440276.234897:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce000/0x85f5fa77adf3c91b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440276.235408:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfa00/0x85f5fa77adf3c922 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440276.235419:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfa00/0x85f5fa77adf3c922 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440276.235427:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfa00/0x85f5fa77adf3c922 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787440276.235436:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1787440276.235551:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf600/0x85f5fa77adf3c914 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440276.235558:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf600/0x85f5fa77adf3c914 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440276.235571:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf600/0x85f5fa77adf3c914 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440276.235577:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee04cbcf600 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:0.0:1787440276.235581:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf600/0x85f5fa77adf3c914 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440276.235589:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf600/0x85f5fa77adf3c914 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440276.235600:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8ee0460ccd00) 00010000:00010000:0.0:1787440276.235603:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440276.235607:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf600/0x85f5fa77adf3c914 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440276.235613:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf600/0x85f5fa77adf3c914 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440276.235624:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce000/0x85f5fa77adf3c91b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440276.235629:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce000/0x85f5fa77adf3c91b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440276.235635:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce000/0x85f5fa77adf3c91b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440276.235640:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee04cbce000 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:0.0:1787440276.235643:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce000/0x85f5fa77adf3c91b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440276.235657:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce000/0x85f5fa77adf3c91b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440276.235665:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8ee050ca1700) 00010000:00010000:0.0:1787440276.235667:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440276.235669:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce000/0x85f5fa77adf3c91b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440276.235675:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce000/0x85f5fa77adf3c91b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440276.235709:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfc00/0x85f5fa77adf3c90d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62272 expref: 30 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440276.235721:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfa00/0x85f5fa77adf3c922 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62272 expref: 29 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440276.235727:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ee054b3cd00) 00010000:00010000:0.0:1787440276.236205:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787440276.236210:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee04cbcfa00, rc 0) 00000100:00100000:0.0:1787440276.236322:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee047a20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+29:10491:x1874266681292416:12345-192.168.206.58@tcp:101:lfs.0 Request processed in 1626us (1833us total) trans 4294967371 rc 0/0 00000100:00100000:0.0:1787440276.236330:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 92 00000100:00100000:0.0:1787440276.242417:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440276.242528:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681292544 00000100:00100000:3.0:1787440276.242537:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681292544 00000100:00100000:3.0:1787440276.242595:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 93 00000100:00100000:3.0:1787440276.242605:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04a731c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+29:10491:x1874266681292544:12345-192.168.206.58@tcp:54:lfs.0 00010000:00010000:3.0:1787440276.242673:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94c00/0x85f5fa77adf3c930 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440276.242689:0:5850:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e000/0x85f5fa77adf3c8d5 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6225d expref: 29 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440276.242711:0:5850:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94c00/0x85f5fa77adf3c930 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440276.242758:0:5850:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e000/0x85f5fa77adf3c8d5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6225d expref: 29 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440276.242771:0:5850:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e000/0x85f5fa77adf3c8d5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6225d expref: 29 pid: 5851 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440276.242784:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee05035b480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5850:1874266701236736:192.168.206.58@tcp:104: 00000100:00100000:3.0:1787440276.242876:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee045ed4240 going to sleep for 11 seconds 00000100:00100000:3.0:1787440276.244813:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee05035b480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5850:1874266701236736:192.168.206.58@tcp:104: 00010000:00010000:3.0:1787440276.244839:0:5850:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94c00/0x85f5fa77adf3c930 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440276.250225:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:2.0:1787440276.250699:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681292800 00000100:00100000:2.0:1787440276.250709:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681292800 00000100:00100000:2.0:1787440276.250774:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 22 00000100:00100000:2.0:1787440276.250784:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04a731880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+30:5600:x1874266681292800:12345-192.168.206.58@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1787440276.251342:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04a731880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+31:5600:x1874266681292800:12345-192.168.206.58@tcp:35:ldlm_bl.0 Request processed in 557us (1124us total) trans 4294967372 rc 0/0 00000100:00100000:2.0:1787440276.251350:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 22 00000100:00100000:1.0:1787440276.259796:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440276.260074:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681292928 00000100:00100000:3.0:1787440276.260085:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681292928 00010000:00010000:3.0:1787440276.260134:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e000/0x85f5fa77adf3c8d5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6225d expref: 31 pid: 5851 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440276.260264:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 48 00000100:00100000:3.0:1787440276.260275:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee0776b8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+31:2362:x1874266681292928:12345-192.168.206.58@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787440276.260290:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787440276.260297:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e000/0x85f5fa77adf3c8d5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6225d expref: 31 pid: 5851 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440276.260328:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e000/0x85f5fa77adf3c8d5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6225d expref: 31 pid: 5851 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440276.260352:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e000/0x85f5fa77adf3c8d5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6225d expref: 31 pid: 5851 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440276.260368:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ee054b3cd00) 00010000:00010000:3.0:1787440276.260373:0:5835:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94c00/0x85f5fa77adf3c930 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440276.260383:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94c00/0x85f5fa77adf3c930 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440276.260390:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94c00/0x85f5fa77adf3c930 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440276.260586:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787440276.260648:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee0776b8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+30:2362:x1874266681292928:12345-192.168.206.58@tcp:103:ldlm_bl.0 Request processed in 374us (860us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440276.260656:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 48 00010000:00010000:0.0:1787440276.263316:0:5850:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94c00/0x85f5fa77adf3c930 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440276.263351:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94c00/0x85f5fa77adf3c930 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440276.263387:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94c00/0x85f5fa77adf3c930 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440276.263394:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94c00/0x85f5fa77adf3c930 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440276.263401:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94c00/0x85f5fa77adf3c930 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440276.263408:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee049e94c00 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:0.0:1787440276.263412:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94c00/0x85f5fa77adf3c930 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440276.263420:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94c00/0x85f5fa77adf3c930 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440276.263438:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ee054b3cd00) 00010000:00010000:0.0:1787440276.263441:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787440276.263445:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94c00/0x85f5fa77adf3c930 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440276.263451:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94c00/0x85f5fa77adf3c930 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440276.264459:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04a731c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+29:10491:x1874266681292544:12345-192.168.206.58@tcp:54:lfs.0 Request processed in 21849us (22042us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440276.264472:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 93 00000100:00100000:2.0:1787440276.279346:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440276.279458:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681293184 00000100:00100000:3.0:1787440276.279467:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681293184 00000100:00100000:3.0:1787440276.279550:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 23 00000100:00100000:3.0:1787440276.279560:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee047a23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+29:10491:x1874266681293184:12345-192.168.206.58@tcp:35:lfs.0 00000100:00100000:3.0:1787440276.279786:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee047a23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+30:10491:x1874266681293184:12345-192.168.206.58@tcp:35:lfs.0 Request processed in 227us (448us total) trans 4294967373 rc 0/0 00000100:00100000:3.0:1787440276.279793:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 23 00000100:00100000:1.0:1787440276.401322:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440276.404826:0:6892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681293440 00000100:00100000:3.0:1787440276.404840:0:6892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681293440 00000100:00100000:3.0:1787440276.404908:0:6892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 94 00000100:00100000:3.0:1787440276.404918:0:6892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee0776bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+30:10502:x1874266681293440:12345-192.168.206.58@tcp:101:cat.0 00010000:00010000:3.0:1787440276.404944:0:6892:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440276.404963:0:6892:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94600/0x85f5fa77adf3c937 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fab14535dc62279 expref: -99 pid: 6892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440276.405034:0:6892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94e00/0x85f5fa77adf3c93e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440276.405047:0:6892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94e00/0x85f5fa77adf3c93e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440276.405057:0:6892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94e00/0x85f5fa77adf3c93e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440276.405081:0:6892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95800/0x85f5fa77adf3c945 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440276.405088:0:6892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95800/0x85f5fa77adf3c945 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440276.405100:0:6892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95800/0x85f5fa77adf3c945 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440276.405429:0:6892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95600/0x85f5fa77adf3c94c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440276.405438:0:6892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95600/0x85f5fa77adf3c94c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440276.405457:0:6892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95600/0x85f5fa77adf3c94c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787440276.405473:0:6892:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:3.0:1787440276.405739:0:6892:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94e00/0x85f5fa77adf3c93e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440276.405747:0:6892:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94e00/0x85f5fa77adf3c93e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440276.405753:0:6892:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94e00/0x85f5fa77adf3c93e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440276.405759:0:6892:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee049e94e00 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:3.0:1787440276.405763:0:6892:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94e00/0x85f5fa77adf3c93e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440276.405770:0:6892:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94e00/0x85f5fa77adf3c93e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440276.405781:0:6892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8ee0460ccd00) 00010000:00010000:3.0:1787440276.405784:0:6892:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440276.405788:0:6892:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94e00/0x85f5fa77adf3c93e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440276.405794:0:6892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94e00/0x85f5fa77adf3c93e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440276.405805:0:6892:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95800/0x85f5fa77adf3c945 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440276.405810:0:6892:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95800/0x85f5fa77adf3c945 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440276.405823:0:6892:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95800/0x85f5fa77adf3c945 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440276.405828:0:6892:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee049e95800 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:3.0:1787440276.405831:0:6892:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95800/0x85f5fa77adf3c945 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440276.405837:0:6892:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95800/0x85f5fa77adf3c945 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440276.405845:0:6892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8ee0460cc400) 00010000:00010000:3.0:1787440276.405847:0:6892:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440276.405850:0:6892:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95800/0x85f5fa77adf3c945 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440276.405856:0:6892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95800/0x85f5fa77adf3c945 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440276.405898:0:6892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94600/0x85f5fa77adf3c937 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62279 expref: 33 pid: 6892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440276.405911:0:6892:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95600/0x85f5fa77adf3c94c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62279 expref: 32 pid: 6892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440276.405919:0:6892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ee054b3cd00) 00010000:00010000:3.0:1787440276.405921:0:6892:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787440276.405924:0:6892:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee049e95600, rc 0) 00000100:00100000:3.0:1787440276.405995:0:6892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee0776bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+32:10502:x1874266681293440:12345-192.168.206.58@tcp:101:cat.0 Request processed in 1078us (4682us total) trans 4294967374 rc 0/0 00000100:00100000:3.0:1787440276.406012:0:6892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 94 00000100:00100000:3.0:1787440276.413531:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440276.413619:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681293696 00000100:00100000:0.0:1787440276.413629:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681293696 00000100:00100000:0.0:1787440276.413689:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 24 00000100:00100000:0.0:1787440276.413699:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee05035b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+32:10502:x1874266681293696:12345-192.168.206.58@tcp:35:cat.0 00000100:00100000:0.0:1787440276.413929:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee05035b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+33:10502:x1874266681293696:12345-192.168.206.58@tcp:35:cat.0 Request processed in 230us (435us total) trans 4294967375 rc 0/0 00000100:00100000:0.0:1787440276.413936:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 24 00000100:00100000:2.0:1787440276.443845:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:1.0:1787440276.444318:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681293952 00000100:00100000:1.0:1787440276.444329:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681293952 00000100:00100000:1.0:1787440276.444398:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 95 00000100:00100000:1.0:1787440276.444408:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee047a23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+33:10503:x1874266681293952:12345-192.168.206.58@tcp:36:rm.0 00010000:00010000:1.0:1787440276.444464:0:5849:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1787440276.444520:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95600/0x85f5fa77adf3c94c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62279 expref: 33 pid: 6892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440276.444544:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfa00/0x85f5fa77adf3c922 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62272 expref: 32 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440276.444558:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95400/0x85f5fa77adf3c8ea lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62264 expref: 31 pid: 6892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440276.445134:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ee054b3cd00) 00010000:00010000:1.0:1787440276.445149:0:5849:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787440276.445172:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e600/0x85f5fa77adf3c95a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440276.445196:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e600/0x85f5fa77adf3c95a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440276.445206:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e600/0x85f5fa77adf3c95a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440276.445221:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f000/0x85f5fa77adf3c961 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440276.445229:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f000/0x85f5fa77adf3c961 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440276.445235:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f000/0x85f5fa77adf3c961 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440276.445560:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9ee00/0x85f5fa77adf3c968 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440276.445580:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9ee00/0x85f5fa77adf3c968 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440276.445587:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9ee00/0x85f5fa77adf3c968 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787440276.450164:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8472 00000004:00080000:1.0:1787440276.450192:0:5849:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 374820698375ns, next at 375820694485ns, rc = 0 00010000:00010000:1.0:1787440276.450276:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f600/0x85f5fa77adf3c96f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440276.450293:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f600/0x85f5fa77adf3c96f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440276.450305:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f600/0x85f5fa77adf3c96f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440276.450314:0:5849:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f600/0x85f5fa77adf3c96f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440276.450321:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f600/0x85f5fa77adf3c96f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440276.450327:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f600/0x85f5fa77adf3c96f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440276.451062:0:5849:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787440276.451092:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9ee00/0x85f5fa77adf3c968 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440276.451100:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9ee00/0x85f5fa77adf3c968 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440276.451106:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9ee00/0x85f5fa77adf3c968 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440276.451112:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee07fb9ee00 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:1.0:1787440276.451117:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9ee00/0x85f5fa77adf3c968 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440276.451124:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9ee00/0x85f5fa77adf3c968 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440276.451147:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ee05132e400) 00010000:00010000:1.0:1787440276.451150:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1787440276.451155:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9ee00/0x85f5fa77adf3c968 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440276.451161:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9ee00/0x85f5fa77adf3c968 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440276.451192:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e600/0x85f5fa77adf3c95a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440276.451198:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e600/0x85f5fa77adf3c95a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440276.451204:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e600/0x85f5fa77adf3c95a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440276.451208:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee07fb9e600 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:1.0:1787440276.451211:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e600/0x85f5fa77adf3c95a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440276.451216:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e600/0x85f5fa77adf3c95a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440276.451223:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8ee0460ccd00) 00010000:00010000:1.0:1787440276.451225:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440276.451228:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e600/0x85f5fa77adf3c95a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440276.451234:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e600/0x85f5fa77adf3c95a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787440276.451256:0:5849:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000df61e7f5 reply state 000000003723517e transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f000/0x85f5fa77adf3c961 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440276.451264:0:5849:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787440276.451365:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee047a23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+32:10503:x1874266681293952:12345-192.168.206.58@tcp:36:rm.0 Request processed in 6955us (7523us total) trans 4294967376 rc 0/0 00000100:00100000:1.0:1787440276.451383:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 95 00010000:00010000:3.0:1787440276.456012:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787440276.456025:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f600/0x85f5fa77adf3c96f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440276.456036:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee07fb9f600 already unused, calling callback (ffffffffc15b52a0) 00010000:00010000:3.0:1787440276.456041:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f600/0x85f5fa77adf3c96f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440276.456050:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f600/0x85f5fa77adf3c96f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440276.456069:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ee05132e400) 00010000:00010000:3.0:1787440276.456072:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787440276.456076:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f600/0x85f5fa77adf3c96f lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440276.456082:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f600/0x85f5fa77adf3c96f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440276.456101:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787440276.456103:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787440276.456106:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787440276.458413:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f000/0x85f5fa77adf3c961 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440276.458429:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f000/0x85f5fa77adf3c961 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440276.458437:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f000/0x85f5fa77adf3c961 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440276.458457:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee07fb9f000 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:3.0:1787440276.458462:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f000/0x85f5fa77adf3c961 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440276.458470:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f000/0x85f5fa77adf3c961 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440276.458487:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8ee05132e800) 00010000:00010000:3.0:1787440276.458490:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440276.458720:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f000/0x85f5fa77adf3c961 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440276.458727:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f000/0x85f5fa77adf3c961 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440276.512928:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440276.514058:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681294208 00000100:00100000:0.0:1787440276.514069:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681294208 00000100:00100000:0.0:1787440276.514143:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 96 00000100:00100000:0.0:1787440276.514153:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee080b05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+31:10509:x1874266681294208:12345-192.168.206.58@tcp:101:bash.0 00010000:00010000:0.0:1787440276.514190:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440276.514213:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfc00/0x85f5fa77adf3c976 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fab14535dc62280 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440276.514343:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce000/0x85f5fa77adf3c97d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440276.514358:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce000/0x85f5fa77adf3c97d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440276.514369:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce000/0x85f5fa77adf3c97d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440276.514384:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf600/0x85f5fa77adf3c984 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440276.514391:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf600/0x85f5fa77adf3c984 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440276.514415:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf600/0x85f5fa77adf3c984 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787440276.514990:0:5851:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:0.0:1787440276.515150:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf400/0x85f5fa77adf3c98b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440276.515160:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf400/0x85f5fa77adf3c98b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440276.515168:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf400/0x85f5fa77adf3c98b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440276.515212:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce000/0x85f5fa77adf3c97d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440276.515220:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce000/0x85f5fa77adf3c97d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440276.515226:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce000/0x85f5fa77adf3c97d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440276.515232:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee04cbce000 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:0.0:1787440276.515236:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce000/0x85f5fa77adf3c97d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440276.515243:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce000/0x85f5fa77adf3c97d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440276.515255:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8ee0460ccd00) 00010000:00010000:0.0:1787440276.515258:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440276.515270:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce000/0x85f5fa77adf3c97d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440276.515276:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce000/0x85f5fa77adf3c97d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787440276.515289:0:5851:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003b8a95d3 reply state 00000000b197aff5 transno 4294967377 ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf600/0x85f5fa77adf3c984 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440276.515297:0:5851:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787440276.515325:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfc00/0x85f5fa77adf3c976 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62280 expref: 34 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440276.515337:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf400/0x85f5fa77adf3c98b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62280 expref: 33 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440276.515344:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8ee050ca1100) 00010000:00010000:0.0:1787440276.515346:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787440276.515348:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee04cbcf400, rc 0) 00000100:00100000:0.0:1787440276.515421:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee080b05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+34:10509:x1874266681294208:12345-192.168.206.58@tcp:101:bash.0 Request processed in 1270us (2505us total) trans 4294967377 rc 0/0 00000100:00100000:0.0:1787440276.515429:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 96 00010000:00010000:3.0:1787440276.517339:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf600/0x85f5fa77adf3c984 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440276.517355:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf600/0x85f5fa77adf3c984 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440276.517362:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf600/0x85f5fa77adf3c984 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440276.517368:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee04cbcf600 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:3.0:1787440276.517372:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf600/0x85f5fa77adf3c984 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440276.517379:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf600/0x85f5fa77adf3c984 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440276.517410:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8ee050ca1700) 00010000:00010000:3.0:1787440276.517413:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440276.517416:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf600/0x85f5fa77adf3c984 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440276.517424:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf600/0x85f5fa77adf3c984 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440276.523358:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440276.523460:0:9225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681294336 00000100:00100000:3.0:1787440276.523469:0:9225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681294336 00000100:00100000:3.0:1787440276.523554:0:9225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 34 00000100:00100000:3.0:1787440276.523564:0:9225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee080b05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+5:2360:x1874266681294336:12345-192.168.206.58@tcp:101:bash.0 00010000:00010000:3.0:1787440276.523581:0:9225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440276.523601:0:9225:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000feb8f078/0x85f5fa77adf3c999 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5fab14535dc62287 expref: -99 pid: 9225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787440276.523627:0:9225:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787440276.523646:0:9225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=374s v=(0 0) 00010000:00010000:3.0:1787440276.523651:0:9225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787440276.523660:0:9225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000feb8f078/0x85f5fa77adf3c999 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62287 expref: 6 pid: 9225 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440276.523678:0:9225:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000feb8f078/0x85f5fa77adf3c999 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62287 expref: 6 pid: 9225 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440276.523690:0:9225:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee049e94600, rc 0) 00000100:00100000:3.0:1787440276.523748:0:9225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee080b05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+6:2360:x1874266681294336:12345-192.168.206.58@tcp:101:bash.0 Request processed in 185us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440276.523768:0:9225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 34 00000100:00080000:0.0:1787440276.523841:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787440276.527148:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440276.527281:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681294464 00000100:00100000:3.0:1787440276.527291:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681294464 00000100:00100000:3.0:1787440276.527345:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 35 00000100:00100000:3.0:1787440276.527354:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee0776b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+6:10509:x1874266681294464:12345-192.168.206.58@tcp:101:bash.0 00010000:00010000:3.0:1787440276.527370:0:6698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440276.527388:0:6698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b300ed3f/0x85f5fa77adf3c9a0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5fab14535dc6228e expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440276.527422:0:6698:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000feb8f078/0x85f5fa77adf3c999 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62287 expref: 7 pid: 9225 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440276.527432:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787440276.527436:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787440276.527442:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b300ed3f/0x85f5fa77adf3c9a0 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6228e expref: 7 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440276.527473:0:6698:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000feb8f078/0x85f5fa77adf3c999 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62287 expref: 7 pid: 9225 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440276.527487:0:6698:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000feb8f078/0x85f5fa77adf3c999 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62287 expref: 7 pid: 9225 timeout: 474 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440276.527537:0:6698:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee050359180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6698:1874266701236864:192.168.206.58@tcp:104: 00000100:00100000:3.0:1787440276.527628:0:6698:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee045ed4240 going to sleep for 11 seconds 00000100:00100000:3.0:1787440276.529318:0:6698:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee050359180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6698:1874266701236864:192.168.206.58@tcp:104: 00010000:00010000:3.0:1787440276.529346:0:6698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b300ed3f/0x85f5fa77adf3c9a0 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6228e expref: 7 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440276.529364:0:6698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee049e95800, rc 0) 00000100:00100000:3.0:1787440276.529415:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee0776b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+7:10509:x1874266681294464:12345-192.168.206.58@tcp:101:bash.0 Request processed in 2062us (2274us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440276.529423:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 35 00000100:00100000:2.0:1787440276.539303:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440276.539389:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681294592 00000100:00100000:3.0:1787440276.539399:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681294592 00010000:00010000:3.0:1787440276.539439:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000feb8f078/0x85f5fa77adf3c999 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62287 expref: 7 pid: 9225 timeout: 474 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440276.539613:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 49 00000100:00100000:3.0:1787440276.539624:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee06e7e4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+7:2362:x1874266681294592:12345-192.168.206.58@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787440276.539639:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787440276.539667:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000feb8f078/0x85f5fa77adf3c999 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62287 expref: 7 pid: 9225 timeout: 474 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440276.539682:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000feb8f078/0x85f5fa77adf3c999 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62287 expref: 7 pid: 9225 timeout: 474 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440276.539704:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000feb8f078/0x85f5fa77adf3c999 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62287 expref: 7 pid: 9225 timeout: 474 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440276.539720:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787440276.539737:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787440276.539745:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b300ed3f/0x85f5fa77adf3c9a0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6228e expref: 6 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440276.539755:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b300ed3f/0x85f5fa77adf3c9a0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6228e expref: 6 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440276.539791:0:5834:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000b300ed3f/0x85f5fa77adf3c9a0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6228e expref: 6 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440276.539806:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee050359180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5834:1874266701236992:192.168.206.58@tcp:105: 00000100:00100000:3.0:1787440276.539888:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee045ed4240 going to sleep for 11 seconds 00000100:00100000:3.0:1787440276.542018:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee050359180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5834:1874266701236992:192.168.206.58@tcp:105: 00010000:00010000:3.0:1787440276.542041:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787440276.542100:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee06e7e4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+6:2362:x1874266681294592:12345-192.168.206.58@tcp:103:ldlm_bl.0 Request processed in 2477us (2805us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440276.542110:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 49 00000100:00100000:2.0:1787440276.547312:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440276.547398:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681294848 00000100:00100000:0.0:1787440276.547409:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681294848 00000100:00100000:0.0:1787440276.547467:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 25 00000100:00100000:0.0:1787440276.548057:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee080b04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+33:10509:x1874266681294848:12345-192.168.206.58@tcp:35:bash.0 00000100:00100000:0.0:1787440276.549104:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee080b04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+34:10509:x1874266681294848:12345-192.168.206.58@tcp:35:bash.0 Request processed in 1623us (1796us total) trans 4294967378 rc 0/0 00000100:00100000:0.0:1787440276.549140:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 25 00010000:00010000:2.0:1787440276.573155:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787440276.701949:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440276.702099:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681294976 00000100:00100000:0.0:1787440276.702108:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681294976 00000100:00100000:0.0:1787440276.702167:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 97 00000100:00100000:0.0:1787440276.702202:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee080b05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+34:10525:x1874266681294976:12345-192.168.206.58@tcp:101:lfs.0 00010000:00010000:0.0:1787440276.702225:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440276.702244:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfc00/0x85f5fa77adf3c9a7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fab14535dc62295 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440276.702858:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce000/0x85f5fa77adf3c9ae lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440276.702874:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce000/0x85f5fa77adf3c9ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440276.702887:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce000/0x85f5fa77adf3c9ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787440276.702945:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:0.0:1787440276.702949:0:5850:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787440276.702968:0:5850:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce000/0x85f5fa77adf3c9ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440276.702992:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfc00/0x85f5fa77adf3c9a7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62295 expref: 36 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440276.703213:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce000/0x85f5fa77adf3c9ae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62295 expref: 35 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440276.703239:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8ee0460ccd00) 00010000:00010000:0.0:1787440276.703243:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787440276.703246:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee04cbce000, rc 0) 00000100:00100000:0.0:1787440276.703612:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee080b05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+35:10525:x1874266681294976:12345-192.168.206.58@tcp:101:lfs.0 Request processed in 1434us (1670us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440276.703621:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 97 00000100:00100000:1.0:1787440276.717009:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:2.0:1787440276.717704:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681295232 00000100:00100000:2.0:1787440276.717729:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681295232 00000100:00100000:2.0:1787440276.717785:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 98 00000100:00100000:2.0:1787440276.717795:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee0776bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+35:10525:x1874266681295232:12345-192.168.206.58@tcp:101:lfs.0 00010000:00010000:2.0:1787440276.717818:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440276.717841:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e200/0x85f5fa77adf3c9b5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fab14535dc6229c expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440276.717942:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86ec00/0x85f5fa77adf3c9bc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440276.717955:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86ec00/0x85f5fa77adf3c9bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440276.717967:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86ec00/0x85f5fa77adf3c9bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787440276.717979:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1787440276.718098:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e200/0x85f5fa77adf3c9b5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6229c expref: 38 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440276.718116:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86ec00/0x85f5fa77adf3c9bc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6229c expref: 37 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440276.718125:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8ee050ca1100) 00010000:00010000:2.0:1787440276.718128:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787440276.718131:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee07f86ec00, rc 0) 00000100:00100000:2.0:1787440276.718247:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee0776bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+37:10525:x1874266681295232:12345-192.168.206.58@tcp:101:lfs.0 Request processed in 453us (1247us total) trans 4294967379 rc 0/0 00000100:00100000:2.0:1787440276.718254:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 98 00000100:00100000:2.0:1787440276.723263:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:2.0:1787440276.723304:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440276.723371:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681295616 00000100:00100000:3.0:1787440276.723381:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681295616 00000100:00100000:1.0:1787440276.723405:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681295488 00000100:00100000:1.0:1787440276.723412:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681295488 00000100:00100000:3.0:1787440276.723446:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 6 00000100:00100000:3.0:1787440276.723456:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee080b06300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+38:2363:x1874266681295616:12345-192.168.206.58@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787440276.723471:0:6711:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1787440276.723669:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 99 00000100:00100000:1.0:1787440276.723679:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee080b07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+38:10525:x1874266681295488:12345-192.168.206.58@tcp:101:lfs.0 00010000:00010000:1.0:1787440276.723699:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440276.723714:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9ea00/0x85f5fa77adf3c9ca lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fab14535dc622a3 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440276.723717:0:6711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86ec00/0x85f5fa77adf3c9bc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6229c expref: 38 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440276.723744:0:6711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8ee050ca1100) 00010000:00010000:3.0:1787440276.723761:0:6711:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787440276.723813:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee080b06300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+38:2363:x1874266681295616:12345-192.168.206.58@tcp:103:ldlm_bl.0 Request processed in 358us (508us total) trans 0 rc 0/0 00010000:00010000:1.0:1787440276.723815:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9ec00/0x85f5fa77adf3c9d1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440276.723825:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 6 00010000:00010000:1.0:1787440276.723833:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9ec00/0x85f5fa77adf3c9d1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440276.723846:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9ec00/0x85f5fa77adf3c9d1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787440276.723859:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1787440276.723991:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9ea00/0x85f5fa77adf3c9ca lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc622a3 expref: 39 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440276.724014:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9ec00/0x85f5fa77adf3c9d1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc622a3 expref: 38 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440276.724022:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8ee050ca1100) 00010000:00010000:1.0:1787440276.724024:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787440276.724027:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee07fb9ec00, rc 0) 00000100:00100000:1.0:1787440276.724066:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee080b07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+38:10525:x1874266681295488:12345-192.168.206.58@tcp:101:lfs.0 Request processed in 389us (812us total) trans 4294967380 rc 0/0 00000100:00100000:1.0:1787440276.724072:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 99 00000100:00100000:2.0:1787440276.735845:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440276.739388:0:9225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681295744 00000100:00100000:3.0:1787440276.739408:0:9225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681295744 00000100:00100000:3.0:1787440276.739519:0:9225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 36 00000100:00100000:3.0:1787440276.739533:0:9225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee080b07b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+6:2361:x1874266681295744:12345-192.168.206.58@tcp:1:lfs.0 00010000:00010000:3.0:1787440276.739597:0:9225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000feb8f078/0x85f5fa77adf3c9df lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440276.739622:0:9225:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b300ed3f/0x85f5fa77adf3c9a0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6228e expref: 6 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440276.739631:0:9225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1787440276.739636:0:9225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787440276.739641:0:9225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000feb8f078/0x85f5fa77adf3c9df lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440276.739685:0:9225:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b300ed3f/0x85f5fa77adf3c9a0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6228e expref: 6 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440276.739703:0:9225:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b300ed3f/0x85f5fa77adf3c9a0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6228e expref: 6 pid: 6698 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440276.739719:0:9225:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee050358700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9225:1874266701237120:192.168.206.58@tcp:104: 00000100:00100000:3.0:1787440276.739852:0:9225:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee045ed49c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787440276.746870:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440276.747047:0:9225:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee050358700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9225:1874266701237120:192.168.206.58@tcp:104: 00010000:00010000:3.0:1787440276.747082:0:9225:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000feb8f078/0x85f5fa77adf3c9df lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440276.747276:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681295872 00000100:00100000:1.0:1787440276.747290:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681295872 00002000:00100000:1.0:1787440276.747349:0:6703:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff8ee04a730a80 x1874266681295872/t0(0) o4->792563a7-4c22-4ac7-ac25-d49ef7fb41a8@192.168.206.58@tcp:437/0 lens 504/0 e 0 to 0 dl 1787440287 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787440276.747360:0:6703:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ee04a730a80 with x1874266681295872 ext(0->8) 00010000:00010000:1.0:1787440276.747370:0:6703:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000b300ed3f/0x85f5fa77adf3c9a0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6228e expref: 7 pid: 6698 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440276.747388:0:6703:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000b300ed3f/0x85f5fa77adf3c9a0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6228e expref: 7 pid: 6698 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787440276.747397:0:6703:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8ee04a730a80 00000100:00100000:1.0:1787440276.747537:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 1 00000100:00100000:1.0:1787440276.747548:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04a730a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+7:2362:x1874266681295872:12345-192.168.206.58@tcp:4:lfs.0 00000100:00100000:1.0:1787440276.748058:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04a730a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+9:2362:x1874266681295872:12345-192.168.206.58@tcp:4:lfs.0 Request processed in 511us (1213us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1787440276.748072:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 1 00002000:00100000:1.0:1787440276.748080:0:6703:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff8ee04a730a80 x1874266681295872/t4294967302(0) o4->792563a7-4c22-4ac7-ac25-d49ef7fb41a8@192.168.206.58@tcp:437/0 lens 504/448 e 0 to 0 dl 1787440287 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787440276.748088:0:6703:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ee04a730a80 with x1874266681295872 ext(0->8) 00010000:00010000:1.0:1787440276.748094:0:6703:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000b300ed3f/0x85f5fa77adf3c9a0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6228e expref: 9 pid: 6698 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440276.748106:0:6703:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000b300ed3f/0x85f5fa77adf3c9a0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6228e expref: 9 pid: 6698 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787440276.748112:0:6703:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8ee04a730a80 00000100:00100000:1.0:1787440276.753126:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440276.755877:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681296000 00000100:00100000:0.0:1787440276.755890:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681296000 00010000:00010000:0.0:1787440276.756085:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b300ed3f/0x85f5fa77adf3c9a0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6228e expref: 9 pid: 6698 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440276.756281:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 50 00000100:00100000:0.0:1787440276.756292:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee0776b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+9:2362:x1874266681296000:12345-192.168.206.58@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787440276.756307:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1787440276.756326:0:5836:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1787440276.756329:0:5836:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1787440276 00002000:00010000:0.0:1787440276.756331:0:5836:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1787440277 00002000:00010000:0.0:1787440276.756333:0:5836:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1787440276 00010000:00010000:0.0:1787440276.756339:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b300ed3f/0x85f5fa77adf3c9a0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6228e expref: 9 pid: 6698 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440276.756351:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b300ed3f/0x85f5fa77adf3c9a0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6228e expref: 9 pid: 6698 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440276.756396:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b300ed3f/0x85f5fa77adf3c9a0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6228e expref: 9 pid: 6698 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440276.756411:0:5836:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787440276.756415:0:5836:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787440276.756421:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000feb8f078/0x85f5fa77adf3c9df lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440276.756429:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000feb8f078/0x85f5fa77adf3c9df lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440276.756467:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787440276.756554:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee0776b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+8:2362:x1874266681296000:12345-192.168.206.58@tcp:103:ldlm_bl.0 Request processed in 263us (3438us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440276.756561:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 50 00010000:00010000:2.0:1787440276.756626:0:9225:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000feb8f078/0x85f5fa77adf3c9df lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440276.756635:0:9225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000feb8f078/0x85f5fa77adf3c9df lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440276.756659:0:9225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000feb8f078/0x85f5fa77adf3c9df lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440276.756666:0:9225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000feb8f078/0x85f5fa77adf3c9df lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440276.756674:0:9225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000feb8f078/0x85f5fa77adf3c9df lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440276.756680:0:9225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee049e94600 already unused, calling callback (ffffffffc15b52a0) 00010000:00010000:2.0:1787440276.756684:0:9225:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000feb8f078/0x85f5fa77adf3c9df lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440276.756691:0:9225:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000feb8f078/0x85f5fa77adf3c9df lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440276.756702:0:9225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000feb8f078/0x85f5fa77adf3c9df lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440276.756720:0:9225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000feb8f078/0x85f5fa77adf3c9df lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440276.756769:0:9225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee080b07b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+7:2361:x1874266681295744:12345-192.168.206.58@tcp:1:lfs.0 Request processed in 17240us (20940us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440276.756776:0:9225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 36 00000100:00100000:2.0:1787440276.761358:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440276.761737:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681296256 00000100:00100000:3.0:1787440276.761750:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681296256 00000100:00100000:3.0:1787440276.761821:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 26 00000100:00100000:3.0:1787440276.761837:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee079bae050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+38:10525:x1874266681296256:12345-192.168.206.58@tcp:35:lfs.0 00000004:00010000:3.0:1787440276.761989:0:5853:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9ec00/0x85f5fa77adf3c9d1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc622a3 expref: 38 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787440276.762392:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:3.0:1787440276.762443:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00000001:00080000:3.0:1787440276.764314:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00010000:00010000:3.0:1787440276.764423:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94e00/0x85f5fa77adf3c9e6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440276.764992:0:5853:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf400/0x85f5fa77adf3c98b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62280 expref: 42 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440276.765008:0:5853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94e00/0x85f5fa77adf3c9e6 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440276.765062:0:5853:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf400/0x85f5fa77adf3c98b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62280 expref: 42 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440276.765079:0:5853:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf400/0x85f5fa77adf3c98b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62280 expref: 42 pid: 5851 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440276.765661:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee050358700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5853:1874266701237248:192.168.206.58@tcp:104: 00000100:00100000:3.0:1787440276.765823:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee0462846c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787440276.777887:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440276.779296:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681296384 00000100:00100000:0.0:1787440276.779314:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681296384 00010000:00010000:0.0:1787440276.779377:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf400/0x85f5fa77adf3c98b lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62280 expref: 43 pid: 5851 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440276.779439:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 51 00000100:00100000:0.0:1787440276.779450:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee080b06a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+43:2363:x1874266681296384:12345-192.168.206.58@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787440276.779474:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787440276.779483:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf400/0x85f5fa77adf3c98b lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62280 expref: 43 pid: 5851 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440276.779547:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf400/0x85f5fa77adf3c98b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62280 expref: 43 pid: 5851 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440276.779579:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8ee050ca1100) 00010000:00010000:0.0:1787440276.779586:0:5835:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94e00/0x85f5fa77adf3c9e6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440276.779597:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94e00/0x85f5fa77adf3c9e6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440276.779605:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94e00/0x85f5fa77adf3c9e6 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440276.779628:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787440276.779713:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee080b06a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+43:2363:x1874266681296384:12345-192.168.206.58@tcp:103:ldlm_bl.0 Request processed in 265us (1840us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440276.779721:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 51 00010000:00010000:3.0:1787440276.780117:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf400/0x85f5fa77adf3c98b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62280 expref: 42 pid: 5851 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440276.780143:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee050358700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5853:1874266701237248:192.168.206.58@tcp:104: 00010000:00010000:3.0:1787440276.780186:0:5853:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94e00/0x85f5fa77adf3c9e6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440276.780196:0:5853:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94e00/0x85f5fa77adf3c9e6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440276.780203:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94e00/0x85f5fa77adf3c9e6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787440276.780384:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000001:00080000:3.0:1787440276.781140:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:3.0:1787440276.781771:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee050358700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5853:1874266701237376:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1787440276.781854:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440276.782855:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701237376 00000100:00100000:2.0:1787440276.782871:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701237376 00000100:00100000:2.0:1787440276.782975:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787440276.782987:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee050358000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5853:x1874266701237376:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00080000:0.0:1787440276.783153:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787440276.783249:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee0462843c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787440276.783256:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee050358000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5853:x1874266701237376:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 271us (1402us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440276.783264:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787440276.783281:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee050358700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5853:1874266701237376:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1787440276.783885:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00000100:00100000:3.0:1787440276.783984:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee050358700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5853:1874266701237504:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1787440276.784027:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440276.784105:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee047f96c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787440276.784143:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701237504 00000100:00100000:1.0:1787440276.784149:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701237504 00000100:00100000:1.0:1787440276.784203:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787440276.784212:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee050359180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5853:x1874266701237504:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1787440276.784409:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee050359180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:5853:x1874266701237504:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 199us (381us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1787440276.784417:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787440276.784475:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee050358700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5853:1874266701237504:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1787440276.784681:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:3.0:1787440276.784721:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94e00/0x85f5fa77adf3c9e6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440276.784731:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94e00/0x85f5fa77adf3c9e6 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440276.784739:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94e00/0x85f5fa77adf3c9e6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440276.784745:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee049e94e00 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:3.0:1787440276.784750:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94e00/0x85f5fa77adf3c9e6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440276.784758:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94e00/0x85f5fa77adf3c9e6 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440276.784776:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8ee050ca1100) 00010000:00010000:3.0:1787440276.784779:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1787440276.784784:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94e00/0x85f5fa77adf3c9e6 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440276.784791:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94e00/0x85f5fa77adf3c9e6 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787440276.784970:0:5853:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1787440276.785070:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00000004:00080000:3.0:1787440276.785081:0:5853:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 375155587307ns, next at 376155585094ns, rc = 0 00000001:00080000:3.0:1787440276.785085:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967388 00010000:00010000:3.0:1787440276.785115:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8ee050ca1100) 00010000:00010000:3.0:1787440276.785118:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787440276.785133:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9ec00/0x85f5fa77adf3c9d1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc622a3 expref: 46 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440276.785271:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee079bae050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+45:10525:x1874266681296256:12345-192.168.206.58@tcp:35:lfs.0 Request processed in 23436us (23927us total) trans 4294967389 rc 0/0 00000100:00100000:3.0:1787440276.785280:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 26 00000020:00080000:3.0:1787440276.785284:0:5853:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1787440276.788348:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440276.788545:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681296512 00000100:00100000:0.0:1787440276.788558:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681296512 00000100:00100000:0.0:1787440276.788625:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 100 00000100:00100000:0.0:1787440276.788637:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee080b04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+45:10525:x1874266681296512:12345-192.168.206.58@tcp:101:lfs.0 00010000:00010000:0.0:1787440276.788671:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440276.788702:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcec00/0x85f5fa77adf3c9ed lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fab14535dc622aa expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440276.788792:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcec00/0x85f5fa77adf3c9ed lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc622aa expref: 46 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440276.788835:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcec00/0x85f5fa77adf3c9ed lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc622aa expref: 46 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440276.788872:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8ee050ca1b00) 00010000:00010000:0.0:1787440276.788877:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787440276.788881:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee04cbcec00, rc 0) 00000100:00100000:0.0:1787440276.789091:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee080b04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+46:10525:x1874266681296512:12345-192.168.206.58@tcp:101:lfs.0 Request processed in 454us (755us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440276.789100:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 100 00000100:00100000:2.0:1787440276.794924:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440276.795094:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681296768 00000100:00100000:0.0:1787440276.795106:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681296768 00000100:00100000:0.0:1787440276.795290:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 27 00000100:00100000:0.0:1787440276.795302:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee080b04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+46:10525:x1874266681296768:12345-192.168.206.58@tcp:35:lfs.0 00000100:00100000:0.0:1787440276.795637:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee080b04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+47:10525:x1874266681296768:12345-192.168.206.58@tcp:35:lfs.0 Request processed in 335us (723us total) trans 4294967390 rc 0/0 00000100:00100000:0.0:1787440276.795646:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 27 00000100:00100000:1.0:1787440276.879901:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:2.0:1787440276.880285:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681296896 00000100:00100000:2.0:1787440276.880299:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681296896 00000100:00100000:2.0:1787440276.880376:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 101 00000100:00100000:2.0:1787440276.880388:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee0776b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+47:10535:x1874266681296896:12345-192.168.206.58@tcp:34:lfs.0 00010000:00010000:2.0:1787440276.880488:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86fc00/0x85f5fa77adf3c9f4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440276.880769:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86fc00/0x85f5fa77adf3c9f4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440276.880801:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86fc00/0x85f5fa77adf3c9f4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440276.880822:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f600/0x85f5fa77adf3c9fb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440276.880830:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f600/0x85f5fa77adf3c9fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440276.880837:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f600/0x85f5fa77adf3c9fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440276.880966:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f000/0x85f5fa77adf3ca02 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440276.880974:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f000/0x85f5fa77adf3ca02 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440276.880982:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f000/0x85f5fa77adf3ca02 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787440276.881031:0:5850:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f000/0x85f5fa77adf3ca02 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440276.881045:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86fc00/0x85f5fa77adf3c9f4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440276.881052:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86fc00/0x85f5fa77adf3c9f4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440276.881059:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86fc00/0x85f5fa77adf3c9f4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440276.881076:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee07f86fc00 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:2.0:1787440276.881081:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86fc00/0x85f5fa77adf3c9f4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440276.881089:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86fc00/0x85f5fa77adf3c9f4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440276.881104:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8ee0460ccd00) 00010000:00010000:2.0:1787440276.881107:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440276.881320:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86fc00/0x85f5fa77adf3c9f4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440276.881329:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86fc00/0x85f5fa77adf3c9f4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440276.881345:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f600/0x85f5fa77adf3c9fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440276.881351:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f600/0x85f5fa77adf3c9fb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440276.881357:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f600/0x85f5fa77adf3c9fb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440276.881362:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee07f86f600 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:2.0:1787440276.881365:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f600/0x85f5fa77adf3c9fb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440276.881371:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f600/0x85f5fa77adf3c9fb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440276.881392:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8ee054b3c800) 00010000:00010000:2.0:1787440276.881395:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440276.881398:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f600/0x85f5fa77adf3c9fb lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440276.881405:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f600/0x85f5fa77adf3c9fb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440276.881423:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f000/0x85f5fa77adf3ca02 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440276.881428:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f000/0x85f5fa77adf3ca02 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440276.881433:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f000/0x85f5fa77adf3ca02 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440276.881438:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee07f86f000 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:2.0:1787440276.881441:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f000/0x85f5fa77adf3ca02 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440276.881446:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f000/0x85f5fa77adf3ca02 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440276.881453:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8ee050ca1b00) 00010000:00010000:2.0:1787440276.881456:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440276.881459:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f000/0x85f5fa77adf3ca02 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440276.881465:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f000/0x85f5fa77adf3ca02 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440276.881805:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee0776b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+47:10535:x1874266681296896:12345-192.168.206.58@tcp:34:lfs.0 Request processed in 1414us (1915us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440276.881815:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 101 00000100:00100000:2.0:1787440276.930169:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440276.930321:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681297152 00000100:00100000:0.0:1787440276.930335:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681297152 00000100:00100000:0.0:1787440276.930447:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 102 00000100:00100000:0.0:1787440276.930458:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee080b07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+47:10538:x1874266681297152:12345-192.168.206.58@tcp:101:lfs.0 00010000:00010000:0.0:1787440276.930488:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440276.930550:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf200/0x85f5fa77adf3ca09 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fab14535dc622b1 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440276.930664:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce200/0x85f5fa77adf3ca10 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440276.930700:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce200/0x85f5fa77adf3ca10 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440276.930715:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce200/0x85f5fa77adf3ca10 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440276.930734:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce600/0x85f5fa77adf3ca17 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440276.930743:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce600/0x85f5fa77adf3ca17 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440276.930751:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce600/0x85f5fa77adf3ca17 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440276.930930:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcee00/0x85f5fa77adf3ca1e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440276.930939:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcee00/0x85f5fa77adf3ca1e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440276.930946:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcee00/0x85f5fa77adf3ca1e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787440276.930956:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1787440276.931086:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce200/0x85f5fa77adf3ca10 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440276.931094:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce200/0x85f5fa77adf3ca10 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440276.931101:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce200/0x85f5fa77adf3ca10 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440276.931117:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee04cbce200 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:0.0:1787440276.931122:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce200/0x85f5fa77adf3ca10 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440276.931130:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce200/0x85f5fa77adf3ca10 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440276.931144:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8ee0460ccd00) 00010000:00010000:0.0:1787440276.931147:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440276.931152:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce200/0x85f5fa77adf3ca10 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440276.931159:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce200/0x85f5fa77adf3ca10 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440276.931185:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce600/0x85f5fa77adf3ca17 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440276.931192:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce600/0x85f5fa77adf3ca17 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440276.931198:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce600/0x85f5fa77adf3ca17 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440276.931203:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee04cbce600 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:0.0:1787440276.931206:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce600/0x85f5fa77adf3ca17 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440276.931213:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce600/0x85f5fa77adf3ca17 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440276.931232:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8ee050ca1500) 00010000:00010000:0.0:1787440276.931235:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440276.931238:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce600/0x85f5fa77adf3ca17 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440276.931244:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce600/0x85f5fa77adf3ca17 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440276.931298:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf200/0x85f5fa77adf3ca09 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc622b1 expref: 50 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440276.931314:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcee00/0x85f5fa77adf3ca1e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc622b1 expref: 49 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440276.931322:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8ee050ca1b00) 00010000:00010000:0.0:1787440276.931324:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787440276.931327:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee04cbcee00, rc 0) 00000100:00100000:0.0:1787440276.931400:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee080b07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+49:10538:x1874266681297152:12345-192.168.206.58@tcp:101:lfs.0 Request processed in 944us (1246us total) trans 4294967391 rc 0/0 00000100:00100000:0.0:1787440276.931410:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 102 00000100:00100000:3.0:1787440276.935418:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:1.0:1787440276.936192:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681297280 00000100:00100000:1.0:1787440276.936205:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681297280 00000100:00100000:1.0:1787440276.936327:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 103 00000100:00100000:1.0:1787440276.936339:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee05035b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+49:10538:x1874266681297280:12345-192.168.206.58@tcp:54:lfs.0 00010000:00010000:1.0:1787440276.936435:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f200/0x85f5fa77adf3ca2c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440276.936472:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f200/0x85f5fa77adf3ca2c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440276.936486:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f200/0x85f5fa77adf3ca2c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440276.936572:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f200/0x85f5fa77adf3ca2c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440276.936580:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f200/0x85f5fa77adf3ca2c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440276.936588:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f200/0x85f5fa77adf3ca2c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440276.936595:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee07fb9f200 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:1.0:1787440276.936600:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f200/0x85f5fa77adf3ca2c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440276.936608:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f200/0x85f5fa77adf3ca2c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440276.936623:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8ee050ca1b00) 00010000:00010000:1.0:1787440276.936627:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787440276.936632:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f200/0x85f5fa77adf3ca2c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440276.936638:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f200/0x85f5fa77adf3ca2c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440276.936750:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee05035b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+49:10538:x1874266681297280:12345-192.168.206.58@tcp:54:lfs.0 Request processed in 412us (1348us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440276.936766:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 103 00000100:00100000:1.0:1787440276.942996:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440276.943389:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681297536 00000100:00100000:3.0:1787440276.943402:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681297536 00000100:00100000:3.0:1787440276.943477:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 28 00000100:00100000:3.0:1787440276.943489:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee0776b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+49:10538:x1874266681297536:12345-192.168.206.58@tcp:35:lfs.0 00000100:00100000:3.0:1787440276.943834:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee0776b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+50:10538:x1874266681297536:12345-192.168.206.58@tcp:35:lfs.0 Request processed in 346us (865us total) trans 4294967392 rc 0/0 00000100:00100000:3.0:1787440276.943842:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 28 00000100:00100000:0.0:1787440277.017407:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:2.0:1787440277.017553:0:6892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681297792 00000100:00100000:2.0:1787440277.017567:0:6892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681297792 00000100:00100000:2.0:1787440277.017638:0:6892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 104 00000100:00100000:2.0:1787440277.017650:0:6892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04a733480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+50:10548:x1874266681297792:12345-192.168.206.58@tcp:101:bash.0 00010000:00010000:2.0:1787440277.017681:0:6892:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440277.017685:0:6892:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787440277.017718:0:6892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce000/0x85f5fa77adf3c9ae lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62295 expref: 50 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440277.017742:0:6892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8ee0460ccd00) 00010000:00010000:2.0:1787440277.017747:0:6892:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787440277.017762:0:6892:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f600/0x85f5fa77adf3ca33 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fab14535dc622b8 expref: -99 pid: 6892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440277.017883:0:6892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86fc00/0x85f5fa77adf3ca3a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440277.017901:0:6892:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcee00/0x85f5fa77adf3ca1e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc622b1 expref: 50 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440277.017912:0:6892:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86fc00/0x85f5fa77adf3ca3a lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440277.017977:0:6892:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcee00/0x85f5fa77adf3ca1e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc622b1 expref: 50 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440277.017993:0:6892:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcee00/0x85f5fa77adf3ca1e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc622b1 expref: 50 pid: 5851 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440277.018008:0:6892:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee080b06680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6892:1874266701237632:192.168.206.58@tcp:104: 00000100:00100000:2.0:1787440277.018201:0:6892:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee07f9a8240 going to sleep for 11 seconds 00000100:00100000:3.0:1787440277.030403:0:6892:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee080b06680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6892:1874266701237632:192.168.206.58@tcp:104: 00010000:00010000:3.0:1787440277.030446:0:6892:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86fc00/0x85f5fa77adf3ca3a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440277.032291:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440277.033291:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681297920 00000100:00100000:3.0:1787440277.033307:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681297920 00010000:00010000:3.0:1787440277.033367:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcee00/0x85f5fa77adf3ca1e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc622b1 expref: 51 pid: 5851 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440277.033425:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 52 00000100:00100000:3.0:1787440277.033438:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04a731180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+51:2362:x1874266681297920:12345-192.168.206.58@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787440277.033456:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787440277.033486:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcee00/0x85f5fa77adf3ca1e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc622b1 expref: 51 pid: 5851 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440277.033532:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcee00/0x85f5fa77adf3ca1e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc622b1 expref: 51 pid: 5851 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440277.033560:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcee00/0x85f5fa77adf3ca1e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc622b1 expref: 51 pid: 5851 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440277.033579:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8ee050ca1b00) 00010000:00010000:3.0:1787440277.033584:0:5834:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86fc00/0x85f5fa77adf3ca3a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440277.033595:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86fc00/0x85f5fa77adf3ca3a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440277.033603:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86fc00/0x85f5fa77adf3ca3a lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440277.033643:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787440277.033722:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04a731180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+50:2362:x1874266681297920:12345-192.168.206.58@tcp:103:ldlm_bl.0 Request processed in 287us (1441us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440277.033731:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 52 00010000:00010000:2.0:1787440277.034539:0:6892:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86fc00/0x85f5fa77adf3ca3a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440277.034555:0:6892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86fc00/0x85f5fa77adf3ca3a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787440277.034583:0:6892:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1787440277.034786:0:6892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f600/0x85f5fa77adf3ca33 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc622b8 expref: 51 pid: 6892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440277.034809:0:6892:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86fc00/0x85f5fa77adf3ca3a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc622b8 expref: 50 pid: 6892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440277.034819:0:6892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8ee050ca1b00) 00010000:00010000:2.0:1787440277.034823:0:6892:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787440277.034826:0:6892:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee07f86fc00, rc 0) 00000100:00100000:2.0:1787440277.034882:0:6892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04a733480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+50:10548:x1874266681297792:12345-192.168.206.58@tcp:101:bash.0 Request processed in 17233us (17488us total) trans 4294967393 rc 0/0 00000100:00100000:2.0:1787440277.034891:0:6892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 104 00000100:00100000:2.0:1787440277.038668:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440277.038778:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681298176 00000100:00100000:0.0:1787440277.038791:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681298176 00000100:00100000:0.0:1787440277.038931:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 105 00000100:00100000:0.0:1787440277.038943:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee080b05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+50:10548:x1874266681298176:12345-192.168.206.58@tcp:36:bash.0 00010000:00010000:0.0:1787440277.040013:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf200/0x85f5fa77adf3ca48 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440277.040054:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf200/0x85f5fa77adf3ca48 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440277.040068:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf200/0x85f5fa77adf3ca48 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787440277.040160:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967394 00000004:00010000:0.0:1787440277.040211:0:5850:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008cfcee21 reply state 000000007dee18e2 transno 4294967395 ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf200/0x85f5fa77adf3ca48 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440277.040222:0:5850:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787440277.040813:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee080b05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+53:10548:x1874266681298176:12345-192.168.206.58@tcp:36:bash.0 Request processed in 1866us (2152us total) trans 4294967395 rc 0/0 00000100:00100000:0.0:1787440277.040824:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 105 00000020:00080000:0.0:1787440277.040831:0:5850:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787440277.042964:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf200/0x85f5fa77adf3ca48 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440277.044105:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf200/0x85f5fa77adf3ca48 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440277.044115:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf200/0x85f5fa77adf3ca48 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440277.044152:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee04cbcf200 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:3.0:1787440277.044159:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf200/0x85f5fa77adf3ca48 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440277.044168:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf200/0x85f5fa77adf3ca48 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440277.044203:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8ee050ca1b00) 00010000:00010000:3.0:1787440277.044206:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440277.044212:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf200/0x85f5fa77adf3ca48 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440277.044218:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf200/0x85f5fa77adf3ca48 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440277.044729:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440277.045422:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681298304 00000100:00100000:0.0:1787440277.045437:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681298304 00000100:00100000:2.0:1787440277.045562:0:6892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 106 00000100:00100000:2.0:1787440277.045577:0:6892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee080b06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+52:10548:x1874266681298304:12345-192.168.206.58@tcp:101:bash.0 00010000:00010000:2.0:1787440277.045610:0:6892:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440277.045644:0:6892:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86fe00/0x85f5fa77adf3ca4f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fab14535dc622bf expref: -99 pid: 6892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440277.045747:0:6892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e600/0x85f5fa77adf3ca56 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440277.045764:0:6892:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86fc00/0x85f5fa77adf3ca3a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc622b8 expref: 53 pid: 6892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440277.045774:0:6892:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e600/0x85f5fa77adf3ca56 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440277.045816:0:6892:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86fc00/0x85f5fa77adf3ca3a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc622b8 expref: 53 pid: 6892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440277.045833:0:6892:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86fc00/0x85f5fa77adf3ca3a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc622b8 expref: 53 pid: 6892 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440277.045849:0:6892:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee080b04a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6892:1874266701237760:192.168.206.58@tcp:104: 00000100:00100000:2.0:1787440277.046083:0:6892:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee07f9a8e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787440277.051419:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440277.051638:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681298432 00000100:00100000:0.0:1787440277.051651:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681298432 00010000:00010000:0.0:1787440277.051705:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86fc00/0x85f5fa77adf3ca3a lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc622b8 expref: 54 pid: 6892 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440277.051762:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 53 00000100:00100000:0.0:1787440277.051774:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee0776bb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+54:2363:x1874266681298432:12345-192.168.206.58@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787440277.051799:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787440277.051808:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86fc00/0x85f5fa77adf3ca3a lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc622b8 expref: 54 pid: 6892 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440277.051825:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86fc00/0x85f5fa77adf3ca3a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc622b8 expref: 54 pid: 6892 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440277.051873:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8ee050ca1b00) 00010000:00010000:0.0:1787440277.051879:0:5835:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e600/0x85f5fa77adf3ca56 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440277.051891:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e600/0x85f5fa77adf3ca56 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440277.051900:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e600/0x85f5fa77adf3ca56 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440277.051920:0:6892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86fc00/0x85f5fa77adf3ca3a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc622b8 expref: 54 pid: 6892 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440277.051923:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787440277.051960:0:6892:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee080b04a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6892:1874266701237760:192.168.206.58@tcp:104: 00010000:00010000:2.0:1787440277.051989:0:6892:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e600/0x85f5fa77adf3ca56 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440277.051997:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee0776bb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+53:2363:x1874266681298432:12345-192.168.206.58@tcp:103:ldlm_bl.0 Request processed in 223us (591us total) trans 0 rc 0/0 00010000:00010000:2.0:1787440277.052002:0:6892:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e600/0x85f5fa77adf3ca56 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440277.052009:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 53 00010000:00010000:2.0:1787440277.052014:0:6892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e600/0x85f5fa77adf3ca56 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787440277.052936:0:6892:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1787440277.052950:0:6892:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787440277.052991:0:6892:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e600/0x85f5fa77adf3ca56 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440277.053045:0:6892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86fe00/0x85f5fa77adf3ca4f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc622bf expref: 53 pid: 6892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440277.053069:0:6892:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e600/0x85f5fa77adf3ca56 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc622bf expref: 52 pid: 6892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440277.053080:0:6892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8ee050ca1b00) 00010000:00010000:2.0:1787440277.053084:0:6892:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787440277.053088:0:6892:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee07f86e600, rc 0) 00000100:00100000:2.0:1787440277.053216:0:6892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee080b06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+52:10548:x1874266681298304:12345-192.168.206.58@tcp:101:bash.0 Request processed in 7642us (8491us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440277.053226:0:6892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 106 00000100:00100000:1.0:1787440277.059030:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440277.059377:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681298688 00000100:00100000:0.0:1787440277.059390:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681298688 00000100:00100000:0.0:1787440277.059535:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 29 00000100:00100000:0.0:1787440277.059548:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee0776b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+52:10548:x1874266681298688:12345-192.168.206.58@tcp:35:bash.0 00000100:00100000:0.0:1787440277.059865:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee0776b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+53:10548:x1874266681298688:12345-192.168.206.58@tcp:35:bash.0 Request processed in 308us (837us total) trans 4294967396 rc 0/0 00000100:00100000:0.0:1787440277.059875:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 29 00000100:00100000:2.0:1787440277.126046:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:1.0:1787440277.126236:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681298816 00000100:00100000:1.0:1787440277.126249:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681298816 00000100:00100000:1.0:1787440277.126327:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 107 00000100:00100000:1.0:1787440277.126339:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee080b04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+53:10554:x1874266681298816:12345-192.168.206.58@tcp:101:lfs.0 00010000:00010000:1.0:1787440277.126373:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440277.126400:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f600/0x85f5fa77adf3ca5d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fab14535dc622c6 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440277.126546:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fa00/0x85f5fa77adf3ca64 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440277.126566:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fa00/0x85f5fa77adf3ca64 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440277.126580:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fa00/0x85f5fa77adf3ca64 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787440277.126653:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:1.0:1787440277.126657:0:5849:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1787440277.126680:0:5849:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fa00/0x85f5fa77adf3ca64 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440277.126711:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f600/0x85f5fa77adf3ca5d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc622c6 expref: 55 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440277.126756:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fa00/0x85f5fa77adf3ca64 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc622c6 expref: 54 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440277.126766:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8ee0460ccd00) 00010000:00010000:1.0:1787440277.126769:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787440277.126773:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee07fb9fa00, rc 0) 00000100:00100000:1.0:1787440277.126864:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee080b04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+54:10554:x1874266681298816:12345-192.168.206.58@tcp:101:lfs.0 Request processed in 527us (831us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440277.126872:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 107 00000100:00100000:1.0:1787440277.130320:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440277.132551:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681298944 00000100:00100000:0.0:1787440277.132572:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681298944 00000100:00100000:0.0:1787440277.132744:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 108 00000100:00100000:0.0:1787440277.132756:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee0776b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+54:10554:x1874266681298944:12345-192.168.206.58@tcp:101:lfs.0 00010000:00010000:0.0:1787440277.132781:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440277.132824:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce600/0x85f5fa77adf3ca6b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fab14535dc622cd expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440277.132933:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce200/0x85f5fa77adf3ca72 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440277.132951:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce200/0x85f5fa77adf3ca72 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440277.132965:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce200/0x85f5fa77adf3ca72 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440277.132983:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf200/0x85f5fa77adf3ca79 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440277.132991:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf200/0x85f5fa77adf3ca79 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440277.132998:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf200/0x85f5fa77adf3ca79 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440277.133696:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcee00/0x85f5fa77adf3ca80 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440277.133708:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcee00/0x85f5fa77adf3ca80 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440277.133717:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcee00/0x85f5fa77adf3ca80 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787440277.133761:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1787440277.133766:0:5851:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787440277.133788:0:5851:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcee00/0x85f5fa77adf3ca80 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440277.133812:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcee00/0x85f5fa77adf3ca80 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440277.133822:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce200/0x85f5fa77adf3ca72 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440277.133829:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce200/0x85f5fa77adf3ca72 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440277.133836:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce200/0x85f5fa77adf3ca72 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440277.133841:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee04cbce200 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:0.0:1787440277.133846:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce200/0x85f5fa77adf3ca72 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440277.133854:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce200/0x85f5fa77adf3ca72 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440277.133866:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8ee0460ccd00) 00010000:00010000:0.0:1787440277.133869:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440277.133874:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce200/0x85f5fa77adf3ca72 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440277.133885:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce200/0x85f5fa77adf3ca72 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440277.133898:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf200/0x85f5fa77adf3ca79 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440277.133904:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf200/0x85f5fa77adf3ca79 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440277.133916:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf200/0x85f5fa77adf3ca79 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440277.133921:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee04cbcf200 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:0.0:1787440277.133924:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf200/0x85f5fa77adf3ca79 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440277.133931:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf200/0x85f5fa77adf3ca79 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440277.133939:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8ee050ca1500) 00010000:00010000:0.0:1787440277.133942:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440277.133945:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf200/0x85f5fa77adf3ca79 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440277.133951:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf200/0x85f5fa77adf3ca79 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440277.133992:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce600/0x85f5fa77adf3ca6b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc622cd expref: 56 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440277.134007:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcee00/0x85f5fa77adf3ca80 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc622cd expref: 55 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440277.134016:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8ee050ca1b00) 00010000:00010000:0.0:1787440277.134018:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787440277.134021:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee04cbcee00, rc 0) 00000100:00100000:0.0:1787440277.134710:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee0776b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+55:10554:x1874266681298944:12345-192.168.206.58@tcp:101:lfs.0 Request processed in 1951us (4401us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440277.134735:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 108 00000100:00100000:2.0:1787440277.138783:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:2.0:1787440277.138900:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:1.0:1787440277.139093:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681299328 00000100:00100000:1.0:1787440277.139106:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681299328 00000100:00100000:1.0:1787440277.139196:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 109 00000100:00100000:1.0:1787440277.139208:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee05fc07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+55:10554:x1874266681299328:12345-192.168.206.58@tcp:101:lfs.0 00010000:00010000:1.0:1787440277.139233:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440277.139258:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f600/0x85f5fa77adf3ca87 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fab14535dc622d4 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440277.139384:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fe00/0x85f5fa77adf3ca8e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440277.139399:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e600/0x85f5fa77adf3ca56 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc622bf expref: 56 pid: 6892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440277.139407:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcee00/0x85f5fa77adf3ca80 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc622cd expref: 56 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440277.139431:0:5849:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fe00/0x85f5fa77adf3ca8e lrc: 5/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440277.139472:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcee00/0x85f5fa77adf3ca80 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc622cd expref: 56 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440277.139487:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcee00/0x85f5fa77adf3ca80 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc622cd expref: 56 pid: 5851 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440277.139540:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee0776bb100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5849:1874266701237888:192.168.206.58@tcp:104: 00010000:00010000:1.0:1787440277.139658:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e600/0x85f5fa77adf3ca56 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc622bf expref: 56 pid: 6892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440277.139668:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e600/0x85f5fa77adf3ca56 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc622bf expref: 56 pid: 6892 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440277.139677:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee0776b9500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5849:1874266701238016:192.168.206.58@tcp:104: 00000100:00100000:1.0:1787440277.139699:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee0460eb180 going to sleep for 11 seconds 00000100:00100000:3.0:1787440277.142884:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681299072 00000100:00100000:3.0:1787440277.142906:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681299072 00010000:00010000:3.0:1787440277.142965:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcee00/0x85f5fa77adf3ca80 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc622cd expref: 57 pid: 5851 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440277.143057:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 54 00000100:00100000:3.0:1787440277.143069:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee05fc06300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+57:2360:x1874266681299072:12345-192.168.206.58@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787440277.143089:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787440277.143098:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcee00/0x85f5fa77adf3ca80 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc622cd expref: 57 pid: 5851 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440277.143113:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcee00/0x85f5fa77adf3ca80 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc622cd expref: 57 pid: 5851 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440277.143191:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8ee050ca1b00) 00010000:00010000:3.0:1787440277.143198:0:5834:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fe00/0x85f5fa77adf3ca8e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440277.143209:0:5834:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fe00/0x85f5fa77adf3ca8e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440277.143216:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787440277.143527:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee05fc06300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+57:2360:x1874266681299072:12345-192.168.206.58@tcp:103:ldlm_bl.0 Request processed in 459us (4755us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440277.143536:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 54 00000100:00100000:2.0:1787440277.145270:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440277.145425:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681299456 00000100:00100000:0.0:1787440277.145438:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681299456 00010000:00010000:0.0:1787440277.145488:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e600/0x85f5fa77adf3ca56 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc622bf expref: 57 pid: 6892 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440277.145564:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 55 00000100:00100000:0.0:1787440277.145575:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee06e7e6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+57:2362:x1874266681299456:12345-192.168.206.58@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787440277.145595:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787440277.145603:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e600/0x85f5fa77adf3ca56 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc622bf expref: 57 pid: 6892 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440277.145617:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e600/0x85f5fa77adf3ca56 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc622bf expref: 57 pid: 6892 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440277.145643:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8ee050ca1b00) 00010000:00010000:0.0:1787440277.145648:0:5835:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fe00/0x85f5fa77adf3ca8e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440277.145659:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fe00/0x85f5fa77adf3ca8e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440277.145668:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fe00/0x85f5fa77adf3ca8e lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440277.145689:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787440277.145760:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee06e7e6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+57:2362:x1874266681299456:12345-192.168.206.58@tcp:103:ldlm_bl.0 Request processed in 174us (488us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440277.145786:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 55 00010000:00010000:2.0:1787440277.146773:0:5849:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.206.58@tcp) returned -22 from blocking AST (req@00000000c72817ec x1874266701237888) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcee00/0x85f5fa77adf3ca80 lrc: 1/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc622cd expref: 56 pid: 5851 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440277.146797:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcee00/0x85f5fa77adf3ca80 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc622cd expref: 56 pid: 5851 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440277.146814:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee0776bb100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5849:1874266701237888:192.168.206.58@tcp:104: 00010000:00010000:2.0:1787440277.146832:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e600/0x85f5fa77adf3ca56 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc622bf expref: 55 pid: 6892 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440277.146843:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee0776b9500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5849:1874266701238016:192.168.206.58@tcp:104: 00010000:00010000:2.0:1787440277.146973:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8ee050ca1b00) 00010000:00010000:2.0:1787440277.146983:0:5849:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fe00/0x85f5fa77adf3ca8e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440277.146993:0:5849:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fe00/0x85f5fa77adf3ca8e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440277.147001:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fe00/0x85f5fa77adf3ca8e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787440277.147025:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1787440277.147303:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f600/0x85f5fa77adf3ca87 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc622d4 expref: 56 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440277.147339:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fe00/0x85f5fa77adf3ca8e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc622d4 expref: 55 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440277.147347:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8ee050ca1b00) 00010000:00010000:2.0:1787440277.147350:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787440277.147352:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee07fb9fe00, rc 0) 00000100:00100000:2.0:1787440277.147424:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee05fc07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+55:10554:x1874266681299328:12345-192.168.206.58@tcp:101:lfs.0 Request processed in 8217us (8523us total) trans 4294967397 rc 0/0 00000100:00100000:2.0:1787440277.147432:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 109 00000100:00100000:2.0:1787440277.156236:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440277.156348:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681299712 00000100:00100000:0.0:1787440277.156361:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681299712 00000100:00100000:0.0:1787440277.156439:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 7 00000100:00100000:0.0:1787440277.156450:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee05fc05f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+55:10554:x1874266681299712:12345-192.168.206.58@tcp:103:lfs.0 00010000:00010000:0.0:1787440277.156472:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787440277.156551:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcec00/0x85f5fa77adf3c9ed lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc622aa expref: 55 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440277.156574:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8ee050ca1b00) 00010000:00010000:0.0:1787440277.156580:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787440277.156650:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee05fc05f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+54:10554:x1874266681299712:12345-192.168.206.58@tcp:103:lfs.0 Request processed in 202us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440277.156658:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 7 00000100:00100000:1.0:1787440277.159154:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:2.0:1787440277.159456:0:6892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681299840 00000100:00100000:2.0:1787440277.159470:0:6892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681299840 00000100:00100000:2.0:1787440277.159691:0:6892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 110 00000100:00100000:2.0:1787440277.159703:0:6892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee0776b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+54:10554:x1874266681299840:12345-192.168.206.58@tcp:58:lfs.0 00010000:00010000:2.0:1787440277.159835:0:6892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86fc00/0x85f5fa77adf3ca9c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440277.159868:0:6892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86fc00/0x85f5fa77adf3ca9c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440277.159883:0:6892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86fc00/0x85f5fa77adf3ca9c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787440277.160133:0:6892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:2.0:1787440277.160319:0:6892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee0776b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+54:10554:x1874266681299840:12345-192.168.206.58@tcp:58:lfs.0 Request processed in 617us (1179us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440277.160328:0:6892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 110 00000100:00100000:0.0:1787440277.163429:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:2.0:1787440277.163644:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681299968 00000100:00100000:2.0:1787440277.163655:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681299968 00000100:00100000:2.0:1787440277.163757:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 111 00000100:00100000:2.0:1787440277.163768:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04a731180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+54:10554:x1874266681299968:12345-192.168.206.58@tcp:101:lfs.0 00010000:00010000:2.0:1787440277.163795:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440277.163821:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86fe00/0x85f5fa77adf3caa3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fab14535dc622db expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440277.163907:0:5850:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86fc00/0x85f5fa77adf3ca9c lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440277.163920:0:5850:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86fe00/0x85f5fa77adf3caa3 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc622db expref: 55 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440277.163943:0:5850:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86fc00/0x85f5fa77adf3ca9c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440277.163958:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86fe00/0x85f5fa77adf3caa3 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc622db expref: 55 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440277.163974:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8ee050ca1b00) 00010000:00010000:2.0:1787440277.163977:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787440277.163981:0:5850:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86fe00/0x85f5fa77adf3caa3 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc622db expref: 55 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440277.163990:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee07f86fe00, rc 0) 00000100:00100000:2.0:1787440277.164062:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04a731180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+55:10554:x1874266681299968:12345-192.168.206.58@tcp:101:lfs.0 Request processed in 296us (647us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440277.164069:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 111 00000100:00100000:2.0:1787440277.561070:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:2.0:1787440277.561124:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440277.561238:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681300096 00000100:00100000:3.0:1787440277.561251:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681300096 00000100:00100000:3.0:1787440277.561321:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 290 00000100:00100000:3.0:1787440277.561332:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee043b4b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+13:2360:x1874266681300096:12345-192.168.206.58@tcp:400:kworker.0 00000100:00100000:3.0:1787440277.561433:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee043b4b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+13:2360:x1874266681300096:12345-192.168.206.58@tcp:400:kworker.0 Request processed in 102us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440277.561441:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 290 00000100:00100000:0.0:1787440277.561527:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681300224 00000100:00100000:0.0:1787440277.561532:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681300224 00000100:00100000:0.0:1787440277.561635:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 77 00000100:00100000:0.0:1787440277.561645:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee05fc06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+8:2360:x1874266681300224:12345-192.168.206.58@tcp:400:kworker.0 00000100:00100000:0.0:1787440277.561676:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee05fc06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+8:2360:x1874266681300224:12345-192.168.206.58@tcp:400:kworker.0 Request processed in 35us (553us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440277.561683:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 77 00000100:00080000:3.0:1787440277.561733:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787440277.566280:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440277.566416:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681300352 00000100:00100000:0.0:1787440277.566429:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681300352 00000100:00100000:0.0:1787440277.566609:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 138 00000100:00100000:0.0:1787440277.566622:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee050358e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fde7b340-91f7-42a0-a1a3-5665ea2691c9+5:2361:x1874266681300352:12345-192.168.206.58@tcp:400:kworker.0 00000100:00100000:0.0:1787440277.566752:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee050358e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fde7b340-91f7-42a0-a1a3-5665ea2691c9+5:2361:x1874266681300352:12345-192.168.206.58@tcp:400:kworker.0 Request processed in 132us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440277.566761:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 138 00000100:00080000:3.0:1787440277.566978:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787440277.596768:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787440277.788779:0:11682:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787440277.788789:0:11682:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787440277.788828:0:11682:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:0.0:1787440277.788835:0:11682:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787440277.788957:0:11682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee04a730e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11682:1874266701238144:192.168.206.58@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787440277.789126:0:11682:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee06e7c7d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787440277.794938:0:11682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee04a730e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11682:1874266701238144:192.168.206.58@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787440277.797304:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:2.0:1787440277.797421:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681300480 00000100:00100000:2.0:1787440277.797431:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681300480 00000100:00100000:2.0:1787440277.797591:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 112 00000100:00100000:2.0:1787440277.797602:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee0776bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+55:10555:x1874266681300480:12345-192.168.206.58@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787440277.797633:0:5849:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787440277.798208:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee0776bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+55:10555:x1874266681300480:12345-192.168.206.58@tcp:53:lhsmtool_posix.0 Request processed in 606us (909us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440277.798217:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 112 00000100:00100000:3.0:1787440277.807140:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440277.807762:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681300608 00000100:00100000:0.0:1787440277.807772:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681300608 00000100:00100000:0.0:1787440277.808023:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 113 00000100:00100000:0.0:1787440277.808034:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee05035b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+55:10555:x1874266681300608:12345-192.168.206.58@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1787440277.808102:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcec00/0x85f5fa77adf3caaa lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440277.808117:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcec00/0x85f5fa77adf3caaa lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440277.808141:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcec00/0x85f5fa77adf3caaa lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440277.808213:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce600/0x85f5fa77adf3cab1 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440277.808221:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce600/0x85f5fa77adf3cab1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440277.808243:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce600/0x85f5fa77adf3cab1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440277.808266:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf200/0x85f5fa77adf3cab8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440277.808273:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf200/0x85f5fa77adf3cab8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440277.808279:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf200/0x85f5fa77adf3cab8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787440277.808315:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1787440277.808319:0:5851:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787440277.808331:0:5851:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf200/0x85f5fa77adf3cab8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440277.808340:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcec00/0x85f5fa77adf3caaa lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440277.808346:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcec00/0x85f5fa77adf3caaa lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440277.808352:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcec00/0x85f5fa77adf3caaa lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440277.808357:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee04cbcec00 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:0.0:1787440277.808361:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcec00/0x85f5fa77adf3caaa lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440277.808367:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcec00/0x85f5fa77adf3caaa lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440277.808385:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ee05132e100) 00010000:00010000:0.0:1787440277.808388:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440277.808393:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcec00/0x85f5fa77adf3caaa lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440277.808398:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcec00/0x85f5fa77adf3caaa lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440277.808412:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce600/0x85f5fa77adf3cab1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440277.808418:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce600/0x85f5fa77adf3cab1 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440277.808422:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce600/0x85f5fa77adf3cab1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440277.808426:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee04cbce600 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:0.0:1787440277.808429:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce600/0x85f5fa77adf3cab1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440277.808434:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce600/0x85f5fa77adf3cab1 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440277.808439:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff8ee050ca1500) 00010000:00010000:0.0:1787440277.808441:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440277.808443:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce600/0x85f5fa77adf3cab1 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440277.808461:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce600/0x85f5fa77adf3cab1 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440277.808483:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf200/0x85f5fa77adf3cab8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440277.808489:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf200/0x85f5fa77adf3cab8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440277.808536:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf200/0x85f5fa77adf3cab8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440277.808542:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee04cbcf200 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:0.0:1787440277.808545:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf200/0x85f5fa77adf3cab8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440277.808550:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf200/0x85f5fa77adf3cab8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440277.808558:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8ee050ca1b00) 00010000:00010000:0.0:1787440277.808560:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440277.808563:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf200/0x85f5fa77adf3cab8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440277.808569:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf200/0x85f5fa77adf3cab8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440277.808863:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee05035b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+55:10555:x1874266681300608:12345-192.168.206.58@tcp:34:lhsmtool_posix.0 Request processed in 829us (1729us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440277.808873:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 113 00000100:00100000:3.0:1787440277.812149:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:2.0:1787440277.812348:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681300864 00000100:00100000:2.0:1787440277.812358:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681300864 00000100:00100000:2.0:1787440277.812421:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 114 00000100:00100000:2.0:1787440277.812431:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee050359500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+55:10555:x1874266681300864:12345-192.168.206.58@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787440277.812450:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440277.812469:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f000/0x85f5fa77adf3cabf lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fab14535dc622e2 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440277.812588:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e400/0x85f5fa77adf3cac6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440277.812602:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e400/0x85f5fa77adf3cac6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440277.812614:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e400/0x85f5fa77adf3cac6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787440277.812625:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1787440277.812714:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e400/0x85f5fa77adf3cac6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440277.812731:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e400/0x85f5fa77adf3cac6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440277.812738:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e400/0x85f5fa77adf3cac6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440277.812743:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee07f86e400 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:2.0:1787440277.812748:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e400/0x85f5fa77adf3cac6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440277.812755:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e400/0x85f5fa77adf3cac6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440277.812767:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8ee050ca1b00) 00010000:00010000:2.0:1787440277.812770:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787440277.812775:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e400/0x85f5fa77adf3cac6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440277.812781:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e400/0x85f5fa77adf3cac6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440277.812821:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f000/0x85f5fa77adf3cabf lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc622e2 expref: 57 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440277.812831:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ee05132e100) 00010000:00010000:2.0:1787440277.812833:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787440277.812837:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f000/0x85f5fa77adf3cabf lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc622e2 expref: 57 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440277.812846:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee07f86f000, rc 0) 00000100:00100000:2.0:1787440277.813037:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee050359500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+56:10555:x1874266681300864:12345-192.168.206.58@tcp:101:lhsmtool_posix.0 Request processed in 607us (896us total) trans 4294967398 rc 301/301 00000100:00100000:2.0:1787440277.813045:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 114 00000100:00100000:3.0:1787440277.821666:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:2.0:1787440277.821789:0:6892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681300992 00000100:00100000:2.0:1787440277.821800:0:6892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681300992 00000100:00100000:2.0:1787440277.821846:0:6892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 115 00000100:00100000:2.0:1787440277.821869:0:6892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee05035a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+56:10555:x1874266681300992:12345-192.168.206.58@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787440277.821922:0:6892:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787440277.822019:0:6892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee05035a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+56:10555:x1874266681300992:12345-192.168.206.58@tcp:53:lhsmtool_posix.0 Request processed in 165us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440277.822028:0:6892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 115 00000100:00100000:2.0:1787440277.826393:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:1.0:1787440277.826524:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681301248 00000100:00100000:1.0:1787440277.826533:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681301248 00000100:00100000:1.0:1787440277.826639:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 116 00000100:00100000:1.0:1787440277.826650:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee05fc04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+56:10555:x1874266681301248:12345-192.168.206.58@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787440277.826669:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440277.826682:0:5849:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1787440277.826710:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fa00/0x85f5fa77adf3ca64 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc622c6 expref: 56 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440277.826729:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8ee0460ccd00) 00010000:00010000:1.0:1787440277.826734:0:5849:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787440277.826746:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e000/0x85f5fa77adf3cad4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fab14535dc622e9 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787440277.827152:0:5849:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:1.0:1787440277.827375:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e400/0x85f5fa77adf3cadb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440277.827389:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e400/0x85f5fa77adf3cadb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440277.827399:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e400/0x85f5fa77adf3cadb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440277.827452:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e000/0x85f5fa77adf3cad4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc622e9 expref: 58 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440277.827467:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e400/0x85f5fa77adf3cadb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc622e9 expref: 57 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440277.827475:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8ee05132ea00) 00010000:00010000:1.0:1787440277.827477:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787440277.827480:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee07fb9e400, rc 0) 00000100:00100000:1.0:1787440277.827599:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee05fc04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+57:10555:x1874266681301248:12345-192.168.206.58@tcp:101:lhsmtool_posix.0 Request processed in 951us (1214us total) trans 4294967399 rc 0/0 00000100:00100000:1.0:1787440277.827618:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 116 00000100:00100000:3.0:1787440277.833269:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:2.0:1787440277.833394:0:6892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681301504 00000100:00100000:2.0:1787440277.833407:0:6892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681301504 00000100:00100000:2.0:1787440277.833598:0:6892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 117 00000100:00100000:2.0:1787440277.833609:0:6892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee05035bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+57:10555:x1874266681301504:12345-192.168.206.58@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787440277.833669:0:6892:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787440277.833695:0:6892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e400/0x85f5fa77adf3cadb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc622e9 expref: 57 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440277.833716:0:6892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8ee05132ea00) 00010000:00010000:2.0:1787440277.833726:0:6892:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787440277.833747:0:6892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f000/0x85f5fa77adf3cae9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440277.833760:0:6892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f000/0x85f5fa77adf3cae9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440277.833786:0:6892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f000/0x85f5fa77adf3cae9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440277.833802:0:6892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e400/0x85f5fa77adf3caf0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xe7b41937 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440277.833808:0:6892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e400/0x85f5fa77adf3caf0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xe7b41937 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440277.833814:0:6892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e400/0x85f5fa77adf3caf0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xe7b41937 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440277.833955:0:6892:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f000/0x85f5fa77adf3cae9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440277.833962:0:6892:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f000/0x85f5fa77adf3cae9 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440277.833968:0:6892:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f000/0x85f5fa77adf3cae9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440277.833973:0:6892:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee07f86f000 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:2.0:1787440277.833977:0:6892:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f000/0x85f5fa77adf3cae9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440277.833984:0:6892:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f000/0x85f5fa77adf3cae9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440277.833992:0:6892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8ee0460ccd00) 00010000:00010000:2.0:1787440277.833995:0:6892:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440277.833998:0:6892:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f000/0x85f5fa77adf3cae9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440277.834011:0:6892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f000/0x85f5fa77adf3cae9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440277.834021:0:6892:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e400/0x85f5fa77adf3caf0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xe7b41937 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440277.834026:0:6892:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e400/0x85f5fa77adf3caf0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xe7b41937 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440277.834032:0:6892:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e400/0x85f5fa77adf3caf0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xe7b41937 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440277.834036:0:6892:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee07f86e400 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:2.0:1787440277.834039:0:6892:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e400/0x85f5fa77adf3caf0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xe7b41937 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440277.834043:0:6892:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e400/0x85f5fa77adf3caf0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xe7b41937 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440277.834051:0:6892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xe7b41937 (ffff8ee054b3c800) 00010000:00010000:2.0:1787440277.834053:0:6892:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440277.834056:0:6892:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e400/0x85f5fa77adf3caf0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xe7b41937 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440277.834061:0:6892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e400/0x85f5fa77adf3caf0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xe7b41937 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440277.835095:0:6892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee05035bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+56:10555:x1874266681301504:12345-192.168.206.58@tcp:36:lhsmtool_posix.0 Request processed in 1481us (1829us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787440277.835112:0:6892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 117 00000100:00100000:3.0:1787440277.838417:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440277.838616:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681301632 00000100:00100000:0.0:1787440277.838625:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681301632 00000100:00100000:0.0:1787440277.838716:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 118 00000100:00100000:0.0:1787440277.838733:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee05035aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+56:10555:x1874266681301632:12345-192.168.206.58@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787440277.838752:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440277.838772:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf200/0x85f5fa77adf3caf7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fab14535dc622f0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440277.838806:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce600/0x85f5fa77adf3cafe lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440277.838818:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce600/0x85f5fa77adf3cafe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440277.838828:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce600/0x85f5fa77adf3cafe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440277.838918:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf200/0x85f5fa77adf3caf7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc622f0 expref: 58 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440277.838936:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce600/0x85f5fa77adf3cafe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc622f0 expref: 57 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440277.838945:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8ee050ca1500) 00010000:00010000:0.0:1787440277.838947:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787440277.838950:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee04cbce600, rc 0) 00000100:00100000:0.0:1787440277.839010:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee05035aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+57:10555:x1874266681301632:12345-192.168.206.58@tcp:101:lhsmtool_posix.0 Request processed in 278us (601us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440277.839017:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 118 00000100:00100000:3.0:1787440277.843067:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440277.843372:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681301888 00000100:00100000:0.0:1787440277.843384:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681301888 00000100:00100000:0.0:1787440277.843546:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 119 00000100:00100000:0.0:1787440277.843608:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee05035ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+57:10555:x1874266681301888:12345-192.168.206.58@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787440277.843746:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e000/0x85f5fa77adf3cb05 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440277.843767:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e000/0x85f5fa77adf3cb05 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440277.843780:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e000/0x85f5fa77adf3cb05 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787440277.845958:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 88 off8560 00000004:00080000:1.0:1787440277.845974:0:5851:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 376216480436ns, next at 377216477507ns, rc = 0 00000004:00010000:1.0:1787440277.846085:0:5851:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a3733c69 reply state 000000005ab7db3f transno 4294967400 ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e000/0x85f5fa77adf3cb05 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440277.846096:0:5851:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787440277.846424:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee05035ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+59:10555:x1874266681301888:12345-192.168.206.58@tcp:36:lhsmtool_posix.0 Request processed in 2787us (3311us total) trans 4294967400 rc 0/0 00000100:00100000:1.0:1787440277.846434:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 119 00010000:00010000:1.0:1787440277.848971:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e000/0x85f5fa77adf3cb05 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440277.848989:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e000/0x85f5fa77adf3cb05 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440277.848997:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e000/0x85f5fa77adf3cb05 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440277.849199:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee07fb9e000 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:1.0:1787440277.849206:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e000/0x85f5fa77adf3cb05 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440277.849227:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e000/0x85f5fa77adf3cb05 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440277.849244:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8ee050ca1500) 00010000:00010000:1.0:1787440277.849247:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787440277.849251:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e000/0x85f5fa77adf3cb05 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440277.849257:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e000/0x85f5fa77adf3cb05 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440277.849678:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:1.0:1787440277.849740:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681302016 00000100:00100000:1.0:1787440277.849750:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681302016 00000100:00100000:1.0:1787440277.849868:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 120 00000100:00100000:1.0:1787440277.849880:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee05035b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+58:10555:x1874266681302016:12345-192.168.206.58@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787440277.849903:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440277.849919:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fa00/0x85f5fa77adf3cb0c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fab14535dc622f7 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440277.849974:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fa00/0x85f5fa77adf3cb0c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc622f7 expref: 59 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440277.849985:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fa00/0x85f5fa77adf3cb0c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc622f7 expref: 59 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440277.850001:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8ee050ca1500) 00010000:00010000:1.0:1787440277.850004:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787440277.850007:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee07fb9fa00, rc 0) 00000100:00100000:1.0:1787440277.850070:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee05035b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+59:10555:x1874266681302016:12345-192.168.206.58@tcp:101:lhsmtool_posix.0 Request processed in 193us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440277.850076:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 120 00000100:00100000:3.0:1787440277.855833:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:1.0:1787440277.856010:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681302144 00000100:00100000:1.0:1787440277.856023:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681302144 00000100:00100000:1.0:1787440277.856081:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 37 00000100:00100000:1.0:1787440277.856091:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee047a23480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+8:2362:x1874266681302144:12345-192.168.206.58@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1787440277.856889:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee047a23480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+9:2362:x1874266681302144:12345-192.168.206.58@tcp:2:lhsmtool_posix.0 Request processed in 794us (1059us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1787440277.856899:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 37 00000100:00100000:3.0:1787440277.859786:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:2.0:1787440277.860163:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681302400 00000100:00100000:2.0:1787440277.860345:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681302400 00000100:00100000:2.0:1787440277.860407:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 30 00000100:00100000:2.0:1787440277.860418:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee047a22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+59:10555:x1874266681302400:12345-192.168.206.58@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787440277.861074:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee047a22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+60:10555:x1874266681302400:12345-192.168.206.58@tcp:35:lhsmtool_posix.0 Request processed in 657us (1296us total) trans 4294967401 rc 0/0 00000100:00100000:2.0:1787440277.861083:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 30 00000100:00100000:3.0:1787440277.864379:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:2.0:1787440277.864483:0:6892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681302656 00000100:00100000:2.0:1787440277.864534:0:6892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681302656 00000100:00100000:2.0:1787440277.864601:0:6892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 121 00000100:00100000:2.0:1787440277.864610:0:6892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee06e6cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+60:10555:x1874266681302656:12345-192.168.206.58@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787440277.864718:0:6892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee06e6cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+60:10555:x1874266681302656:12345-192.168.206.58@tcp:57:lhsmtool_posix.0 Request processed in 109us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440277.864726:0:6892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 121 00000100:00100000:3.0:1787440277.868635:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440277.868703:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681302784 00000100:00100000:0.0:1787440277.868713:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681302784 00000100:00100000:0.0:1787440277.868774:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 122 00000100:00100000:0.0:1787440277.868783:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee06e6cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+60:10555:x1874266681302784:12345-192.168.206.58@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787440277.868802:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440277.868821:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf200/0x85f5fa77adf3cb13 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fab14535dc622fe expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440277.868886:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcec00/0x85f5fa77adf3cb1a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440277.868900:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcec00/0x85f5fa77adf3cb1a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440277.868910:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcec00/0x85f5fa77adf3cb1a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787440277.868946:0:5850:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787440277.868964:0:5850:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcec00/0x85f5fa77adf3cb1a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440277.868989:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf200/0x85f5fa77adf3cb13 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc622fe expref: 62 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440277.869007:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcec00/0x85f5fa77adf3cb1a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc622fe expref: 61 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440277.869016:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8ee050ca1500) 00010000:00010000:0.0:1787440277.869031:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787440277.869034:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee04cbcec00, rc 0) 00000100:00100000:0.0:1787440277.869092:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee06e6cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+61:10555:x1874266681302784:12345-192.168.206.58@tcp:101:lhsmtool_posix.0 Request processed in 311us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440277.869099:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 122 00000100:00100000:2.0:1787440277.873424:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:1.0:1787440277.873624:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681302912 00000100:00100000:1.0:1787440277.873634:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681302912 00000100:00100000:1.0:1787440277.873693:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 38 00000100:00100000:1.0:1787440277.873703:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee05fc06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+9:2362:x1874266681302912:12345-192.168.206.58@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787440277.873720:0:6698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440277.873738:0:6698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002a4179b0/0x85f5fa77adf3cb21 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5fab14535dc62305 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787440277.873764:0:6698:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8a2c96, blocks: 0x1 00010000:00010000:1.0:1787440277.873782:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=376s v=(0 0) 00010000:00010000:1.0:1787440277.873787:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787440277.873796:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002a4179b0/0x85f5fa77adf3cb21 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62305 expref: 10 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440277.873816:0:6698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002a4179b0/0x85f5fa77adf3cb21 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62305 expref: 10 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440277.873862:0:6698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee07fb9e000, rc 0) 00000100:00100000:1.0:1787440277.873924:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee05fc06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+10:2362:x1874266681302912:12345-192.168.206.58@tcp:101:lhsmtool_posix.0 Request processed in 222us (508us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440277.873931:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 38 00000100:00100000:3.0:1787440277.876751:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:1.0:1787440277.876820:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681303168 00000100:00100000:1.0:1787440277.876830:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681303168 00000100:00100000:1.0:1787440277.876894:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 123 00000100:00100000:1.0:1787440277.876904:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee06e6cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+61:10555:x1874266681303168:12345-192.168.206.58@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787440277.877005:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee06e6cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+61:10555:x1874266681303168:12345-192.168.206.58@tcp:57:lhsmtool_posix.0 Request processed in 103us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440277.877013:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 123 00000100:00100000:3.0:1787440277.879542:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:2.0:1787440277.879683:0:9225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681303296 00000100:00100000:2.0:1787440277.879692:0:9225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681303296 00000100:00100000:2.0:1787440277.879749:0:9225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 39 00000100:00100000:2.0:1787440277.879759:0:9225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee06e6cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+10:10555:x1874266681303296:12345-192.168.206.58@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787440277.879774:0:9225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440277.879790:0:9225:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bc5709cc/0x85f5fa77adf3cb28 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5fab14535dc6230c expref: -99 pid: 9225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440277.879819:0:9225:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002a4179b0/0x85f5fa77adf3cb21 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62305 expref: 11 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440277.879845:0:9225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787440277.879849:0:9225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787440277.879855:0:9225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bc5709cc/0x85f5fa77adf3cb28 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6230c expref: 11 pid: 9225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440277.879887:0:9225:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002a4179b0/0x85f5fa77adf3cb21 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62305 expref: 11 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440277.879900:0:9225:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002a4179b0/0x85f5fa77adf3cb21 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62305 expref: 11 pid: 6698 timeout: 476 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440277.879913:0:9225:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee05fc04380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9225:1874266701238272:192.168.206.58@tcp:104: 00000100:00100000:2.0:1787440277.880097:0:9225:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee07f9a80c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787440277.884004:0:9225:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee05fc04380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9225:1874266701238272:192.168.206.58@tcp:104: 00000100:00100000:2.0:1787440277.884021:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00010000:00010000:3.0:1787440277.884036:0:9225:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000bc5709cc/0x85f5fa77adf3cb28 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6230c expref: 11 pid: 9225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440277.884054:0:9225:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee07f86e600, rc 0) 00000100:00100000:0.0:1787440277.884101:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681303424 00000100:00100000:3.0:1787440277.884102:0:9225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee06e6cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+11:10555:x1874266681303296:12345-192.168.206.58@tcp:101:lhsmtool_posix.0 Request processed in 4346us (4569us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440277.884111:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681303424 00000100:00100000:3.0:1787440277.884117:0:9225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 39 00010000:00010000:0.0:1787440277.884148:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002a4179b0/0x85f5fa77adf3cb21 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62305 expref: 11 pid: 6698 timeout: 476 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440277.884299:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 56 00000100:00100000:0.0:1787440277.884309:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee05fc07800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+11:2363:x1874266681303424:12345-192.168.206.58@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787440277.884323:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787440277.884347:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002a4179b0/0x85f5fa77adf3cb21 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62305 expref: 11 pid: 6698 timeout: 476 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440277.884360:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002a4179b0/0x85f5fa77adf3cb21 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62305 expref: 11 pid: 6698 timeout: 476 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440277.884382:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002a4179b0/0x85f5fa77adf3cb21 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62305 expref: 11 pid: 6698 timeout: 476 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440277.884395:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787440277.884400:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787440277.884407:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000bc5709cc/0x85f5fa77adf3cb28 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6230c expref: 10 pid: 9225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440277.884567:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bc5709cc/0x85f5fa77adf3cb28 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6230c expref: 10 pid: 9225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440277.884600:0:5835:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000bc5709cc/0x85f5fa77adf3cb28 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6230c expref: 10 pid: 9225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440277.884612:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee04a730e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5835:1874266701238400:192.168.206.58@tcp:105: 00000100:00100000:0.0:1787440277.884674:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee06e7c7d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787440277.886655:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee04a730e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5835:1874266701238400:192.168.206.58@tcp:105: 00010000:00010000:0.0:1787440277.886678:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787440277.886764:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee05fc07800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+10:2363:x1874266681303424:12345-192.168.206.58@tcp:103:ldlm_bl.0 Request processed in 2456us (2745us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440277.886773:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 56 00000100:00100000:3.0:1787440277.887721:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:1.0:1787440277.888322:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681303552 00000100:00100000:1.0:1787440277.888331:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681303552 00002000:00100000:1.0:1787440277.888377:0:6701:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff8ee06e6cd180 x1874266681303552/t0(0) o4->792563a7-4c22-4ac7-ac25-d49ef7fb41a8@192.168.206.58@tcp:438/0 lens 504/0 e 0 to 0 dl 1787440288 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787440277.888387:0:6701:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ee06e6cd180 with x1874266681303552 ext(0->12) 00002000:00010000:1.0:1787440277.888392:0:6701:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8ee06e6cd180 00000100:00100000:1.0:1787440277.888418:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 2 00000100:00100000:1.0:1787440277.888426:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee06e6cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+10:2362:x1874266681303552:12345-192.168.206.58@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1787440277.889802:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee06e6cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+12:2362:x1874266681303552:12345-192.168.206.58@tcp:4:lhsmtool_posix.0 Request processed in 1364us (2072us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1787440277.889813:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 2 00002000:00100000:1.0:1787440277.889823:0:6701:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff8ee06e6cd180 x1874266681303552/t4294967308(0) o4->792563a7-4c22-4ac7-ac25-d49ef7fb41a8@192.168.206.58@tcp:438/0 lens 504/448 e 0 to 0 dl 1787440288 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787440277.889838:0:6701:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ee06e6cd180 with x1874266681303552 ext(0->12) 00002000:00010000:1.0:1787440277.889843:0:6701:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8ee06e6cd180 00000100:00100000:2.0:1787440277.892803:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440277.892959:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681303680 00000100:00100000:0.0:1787440277.892969:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681303680 00000100:00100000:0.0:1787440277.893042:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 124 00000100:00100000:0.0:1787440277.893285:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee05fc04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+61:10555:x1874266681303680:12345-192.168.206.58@tcp:44:lhsmtool_posix.0 00000004:00080000:3.0:1787440277.916866:0:6891:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 376287370635ns, next at 377287354735ns, rc = 0 00000100:00100000:1.0:1787440277.917191:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee079915880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874266701238528:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787440277.917256:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440277.917357:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701238528 00000100:00100000:3.0:1787440277.917364:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701238528 00000100:00100000:3.0:1787440277.917414:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787440277.917424:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee0776b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3309:x1874266701238528:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787440277.917445:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787440277.917489:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee0776b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3309:x1874266701238528:12345-0@lo:13:osp-pre-0-0.0 Request processed in 67us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440277.917513:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787440277.917614:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee079915880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874266701238528:0@lo:13:osp-pre-0-0.0 00000001:00080000:1.0:1787440277.923375:0:5871:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967396 is committed 00000001:00080000:1.0:1787440277.923410:0:5871:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000004:00080000:1.0:1787440277.923414:0:5871:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000004:00080000:1.0:1787440277.923442:0:5871:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000100:00100000:2.0:1787440277.923468:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee05fc04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+44:10555:x1874266681303680:12345-192.168.206.58@tcp:44:lhsmtool_posix.0 Request processed in 30412us (30668us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440277.923479:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 124 00000001:00080000:1.0:1787440277.923693:0:5871:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967401 is committed 00000004:00080000:1.0:1787440277.923726:0:5871:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000100:00100000:0.0:1787440277.923942:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee04a733100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874266701238784:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1787440277.923993:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440277.924029:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787440277.924037:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee04a730e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874266701238656:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1787440277.924062:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440277.924090:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701238784 00000100:00100000:0.0:1787440277.924109:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701238784 00000100:00100000:0.0:1787440277.924158:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701238656 00000100:00100000:0.0:1787440277.924162:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701238656 00000100:00100000:0.0:1787440277.924199:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787440277.924207:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04a731500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3311:x1874266701238784:12345-0@lo:2:osp-syn-1-0.0 00000100:00080000:3.0:1787440277.924231:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787440277.924248:0:9225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787440277.924258:0:9225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04a732300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3309:x1874266701238656:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1787440277.924272:0:9225:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00010000:00010000:3.0:1787440277.924291:0:9225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ba78a780/0x85f5fa77adf3cb2f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440277.924310:0:9225:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ffc00b09/0x85f5fa77adf3c8f1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6226b expref: 11 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440277.924318:0:9225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:3.0:1787440277.924322:0:9225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787440277.924327:0:9225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ba78a780/0x85f5fa77adf3cb2f lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787440277.924348:0:6698:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00010000:00010000:3.0:1787440277.924352:0:9225:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ffc00b09/0x85f5fa77adf3c8f1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6226b expref: 11 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787440277.924352:0:6698:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1787440278 00002000:00010000:0.0:1787440277.924354:0:6698:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1787440277.924357:0:6698:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1787440278 -> 1787440278 00002000:00010000:0.0:1787440277.924359:0:6698:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 1 00010000:00010000:3.0:1787440277.924366:0:9225:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ffc00b09/0x85f5fa77adf3c8f1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6226b expref: 11 pid: 6695 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440277.924377:0:9225:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee079915180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9225:1874266701238912:192.168.206.58@tcp:104: 00000100:00100000:0.0:1787440277.924408:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04a731500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3311:x1874266701238784:12345-0@lo:2:osp-syn-1-0.0 Request processed in 201us (414us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1787440277.924414:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787440277.924426:0:9225:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee047f960c0 going to sleep for 11 seconds 00000020:00080000:1.0:1787440277.924571:0:5871:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8ee047f969c0 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:1.0:1787440277.924576:0:5871:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8ee0776f4300 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8ee047f96d80 00000020:00080000:1.0:1787440277.924579:0:5871:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8ee0776f4f00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8ee047fec400 00000020:00080000:1.0:1787440277.924608:0:5871:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8ee0478b6540 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:1.0:1787440277.924611:0:5871:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8ee05077bd00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8ee0478b6840 00000020:00080000:1.0:1787440277.924614:0:5871:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8ee05077ba00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8ee07f95bc00 00000020:00080000:3.0:1787440277.924673:0:5882:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000004:00080000:0.0:1787440277.924716:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8ee04a733100/2, rc 0, transno 4294967309 00000100:00100000:0.0:1787440277.924722:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee04a733100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874266701238784:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1787440277.924731:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787440277.924736:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee05fc06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874266701239040:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1787440277.924774:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:3.0:1787440277.924838:0:5882:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:0.0:1787440277.924948:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701239040 00000100:00100000:0.0:1787440277.924953:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701239040 00000100:00100000:0.0:1787440277.924975:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787440277.924981:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04a733b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3311:x1874266701239040:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1787440277.924996:0:6697:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00002000:00010000:0.0:1787440277.925018:0:6697:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a8a2c94, atime: 0x6a8a2c95, ctime: 0x6a8a2c94, blocks: 0x1 00010000:00010000:0.0:1787440277.925024:0:6697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000072740441/0x85f5fa77adf3cb36 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440277.925045:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=376s v=(0 0) 00010000:00010000:0.0:1787440277.925049:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787440277.925055:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000072740441/0x85f5fa77adf3cb36 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440277.925069:0:6697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000072740441/0x85f5fa77adf3cb36 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440277.925079:0:6697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000072740441/0x85f5fa77adf3cb36 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440277.925085:0:6697:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000072740441/0x85f5fa77adf3cb36 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440277.925112:0:6697:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787440277.925719:0:5837:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787440277.925727:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000072740441/0x85f5fa77adf3cb36 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440277.925743:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee04cbcf200 already unused, calling callback (ffffffffc15b52a0) 00010000:00010000:3.0:1787440277.925747:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000072740441/0x85f5fa77adf3cb36 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440277.925755:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000072740441/0x85f5fa77adf3cb36 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440277.925770:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000072740441/0x85f5fa77adf3cb36 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440277.925776:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000072740441/0x85f5fa77adf3cb36 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440277.925807:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787440277.925809:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787440277.925811:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787440277.925892:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440277.925928:0:6698:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:3.0:1787440277.925936:0:6698:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:0.0:1787440277.926117:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04a733b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+9:3311:x1874266701239040:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1134us (1340us total) trans 4294967304 rc 0/0 00000004:00080000:1.0:1787440277.926124:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8ee05fc06d80/2, rc 0, transno 4294967304 00000100:00100000:1.0:1787440277.926129:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee05fc06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874266701239040:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1787440277.926200:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787440277.926218:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681303808 00000100:00100000:0.0:1787440277.926222:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681303808 00000100:00100000:0.0:1787440277.926246:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 43 00000100:00100000:0.0:1787440277.926253:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee05fc05c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+12:2360:x1874266681303808:12345-192.168.206.58@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1787440277.927459:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440277.927487:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681303936 00000100:00100000:3.0:1787440277.927507:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681303936 00000100:00100000:0.0:1787440277.927528:0:9225:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee079915180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9225:1874266701238912:192.168.206.58@tcp:104: 00010000:00010000:3.0:1787440277.927533:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ffc00b09/0x85f5fa77adf3c8f1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6226b expref: 13 pid: 6695 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440277.927546:0:9225:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ba78a780/0x85f5fa77adf3cb2f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440277.927560:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 57 00000100:00100000:3.0:1787440277.927566:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee079914e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+13:2362:x1874266681303936:12345-192.168.206.58@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787440277.927582:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787440277.927588:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ffc00b09/0x85f5fa77adf3c8f1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6226b expref: 13 pid: 6695 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440277.927600:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ffc00b09/0x85f5fa77adf3c8f1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6226b expref: 13 pid: 6695 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440277.927620:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ffc00b09/0x85f5fa77adf3c8f1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6226b expref: 13 pid: 6695 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440277.927634:0:5836:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787440277.927638:0:5836:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787440277.927644:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ba78a780/0x85f5fa77adf3cb2f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440277.927653:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ba78a780/0x85f5fa77adf3cb2f lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440277.927768:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787440277.927814:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee079914e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+12:2362:x1874266681303936:12345-192.168.206.58@tcp:103:ldlm_bl.0 Request processed in 247us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440277.927821:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 57 00010000:00010000:0.0:1787440277.929176:0:9225:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ba78a780/0x85f5fa77adf3cb2f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440277.929191:0:9225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ba78a780/0x85f5fa77adf3cb2f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440277.929202:0:9225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ba78a780/0x85f5fa77adf3cb2f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440277.929214:0:9225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ba78a780/0x85f5fa77adf3cb2f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440277.929240:0:9225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787440277.930128:0:9225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04a732300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3309:x1874266701238656:12345-0@lo:6:osp-syn-1-0.0 Request processed in 5868us (6061us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1787440277.930138:0:9225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000004:00080000:0.0:1787440277.930258:0:3309:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8ee04a730e00/2, rc 0, transno 4294967310 00000100:00100000:0.0:1787440277.930265:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee04a730e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874266701238656:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1787440277.930275:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787440277.930282:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ba78a780/0x85f5fa77adf3cb2f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440277.930305:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee049e94800 already unused, calling callback (ffffffffc15b52a0) 00010000:00010000:3.0:1787440277.930310:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ba78a780/0x85f5fa77adf3cb2f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440277.930319:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ba78a780/0x85f5fa77adf3cb2f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440277.930336:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ba78a780/0x85f5fa77adf3cb2f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440277.930343:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ba78a780/0x85f5fa77adf3cb2f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440277.930360:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787440277.930361:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787440277.930363:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787440277.952800:0:7640:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000001:00080000:1.0:1787440277.952817:0:7640:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00000001:00080000:1.0:1787440277.952824:0:7640:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000100:00100000:0.0:1787440277.952905:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee05fc05c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+6:2360:x1874266681303808:12345-192.168.206.58@tcp:16:lhsmtool_posix.0 Request processed in 26646us (27010us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440277.952917:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 43 00000100:00100000:3.0:1787440277.955308:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:2.0:1787440277.955394:0:6892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681304192 00000100:00100000:2.0:1787440277.955404:0:6892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681304192 00000100:00100000:1.0:1787440277.955536:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 125 00000100:00100000:1.0:1787440277.955562:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee079917b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+15:10555:x1874266681304192:12345-192.168.206.58@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787440277.955612:0:5851:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787440277.955638:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcec00/0x85f5fa77adf3cb1a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc622fe expref: 15 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440277.955656:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8ee050ca1500) 00010000:00010000:1.0:1787440277.955661:0:5851:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787440277.955689:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f600/0x85f5fa77adf3cb3d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440277.955702:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f600/0x85f5fa77adf3cb3d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440277.955712:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f600/0x85f5fa77adf3cb3d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787440277.955995:0:5851:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a3e74b8c reply state 00000000903704e6 transno 4294967402 ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f600/0x85f5fa77adf3cb3d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440277.956004:0:5851:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787440277.956129:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee079917b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+16:10555:x1874266681304192:12345-192.168.206.58@tcp:36:lhsmtool_posix.0 Request processed in 569us (826us total) trans 4294967402 rc 0/0 00000100:00100000:1.0:1787440277.956136:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 125 00010000:00010000:3.0:1787440277.958314:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f600/0x85f5fa77adf3cb3d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440277.958329:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f600/0x85f5fa77adf3cb3d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440277.958336:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f600/0x85f5fa77adf3cb3d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440277.958342:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee07fb9f600 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:3.0:1787440277.958358:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f600/0x85f5fa77adf3cb3d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440277.958366:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f600/0x85f5fa77adf3cb3d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440277.958381:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8ee050ca1500) 00010000:00010000:3.0:1787440277.958384:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440277.958401:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f600/0x85f5fa77adf3cb3d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440277.958408:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f600/0x85f5fa77adf3cb3d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440277.958768:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:1.0:1787440277.958889:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681304320 00000100:00100000:1.0:1787440277.958898:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681304320 00000100:00100000:1.0:1787440277.958957:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 44 00000100:00100000:1.0:1787440277.958966:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee05fc05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+6:2363:x1874266681304320:12345-192.168.206.58@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1787440277.959186:0:6698:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:1.0:1787440277.959190:0:6698:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 1787440278 -> 1787440277 00002000:00010000:1.0:1787440277.959200:0:6698:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1787440277 00002000:00010000:1.0:1787440277.959202:0:6698:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1787440278 -> 1787440277 00002000:00010000:1.0:1787440277.959204:0:6698:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1787440277.959264:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee05fc05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+7:2363:x1874266681304320:12345-192.168.206.58@tcp:2:lhsmtool_posix.0 Request processed in 299us (499us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1787440277.959272:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 44 00000100:00100000:2.0:1787440277.962005:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:1.0:1787440277.962148:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681304576 00000100:00100000:1.0:1787440277.962155:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681304576 00000100:00100000:1.0:1787440277.962246:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 126 00000100:00100000:1.0:1787440277.962255:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee05fc04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+15:10555:x1874266681304576:12345-192.168.206.58@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1787440277.962314:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f000/0x85f5fa77adf3cb44 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440277.962329:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce600/0x85f5fa77adf3cafe lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc622f0 expref: 15 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440277.962339:0:5849:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f000/0x85f5fa77adf3cb44 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440277.962368:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce600/0x85f5fa77adf3cafe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc622f0 expref: 15 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440277.962379:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce600/0x85f5fa77adf3cafe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc622f0 expref: 15 pid: 5850 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440277.962403:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee0776bb480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5849:1874266701239168:192.168.206.58@tcp:104: 00000100:00100000:1.0:1787440277.962477:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee0460eb3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787440277.966780:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee0776bb480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5849:1874266701239168:192.168.206.58@tcp:104: 00010000:00010000:1.0:1787440277.966827:0:5849:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f000/0x85f5fa77adf3cb44 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440277.968044:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440277.968281:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681304704 00000100:00100000:3.0:1787440277.968289:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681304704 00010000:00010000:3.0:1787440277.968331:0:6711:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce600/0x85f5fa77adf3cafe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc622f0 expref: 16 pid: 5850 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440277.968373:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 58 00000100:00100000:3.0:1787440277.968383:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee05fc07480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+16:2363:x1874266681304704:12345-192.168.206.58@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787440277.968406:0:6711:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787440277.968420:0:6711:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce600/0x85f5fa77adf3cafe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc622f0 expref: 16 pid: 5850 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440277.968433:0:6711:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce600/0x85f5fa77adf3cafe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc622f0 expref: 16 pid: 5850 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440277.968465:0:6711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce600/0x85f5fa77adf3cafe lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc622f0 expref: 16 pid: 5850 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440277.968678:0:6711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8ee050ca1500) 00010000:00010000:3.0:1787440277.968683:0:6711:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f000/0x85f5fa77adf3cb44 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440277.968701:0:6711:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f000/0x85f5fa77adf3cb44 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440277.968709:0:6711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f000/0x85f5fa77adf3cb44 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440277.968740:0:6711:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787440277.968798:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee05fc07480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+15:2363:x1874266681304704:12345-192.168.206.58@tcp:103:ldlm_bl.0 Request processed in 415us (757us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440277.968805:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 58 00010000:00010000:1.0:1787440277.968928:0:5849:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f000/0x85f5fa77adf3cb44 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440277.968937:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f000/0x85f5fa77adf3cb44 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440277.968979:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f000/0x85f5fa77adf3cb44 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440277.968985:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f000/0x85f5fa77adf3cb44 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440277.969114:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f000/0x85f5fa77adf3cb44 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440277.969121:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee07fb9f000 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:1.0:1787440277.969125:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f000/0x85f5fa77adf3cb44 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440277.969133:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f000/0x85f5fa77adf3cb44 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440277.969144:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8ee050ca1500) 00010000:00010000:1.0:1787440277.969146:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1787440277.969150:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f000/0x85f5fa77adf3cb44 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440277.969156:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f000/0x85f5fa77adf3cb44 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440277.969236:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee05fc04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+14:10555:x1874266681304576:12345-192.168.206.58@tcp:55:lhsmtool_posix.0 Request processed in 6982us (7240us total) trans 0 rc -22/-22 00000100:00100000:1.0:1787440277.969244:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 126 00000100:00100000:2.0:1787440277.971232:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440277.971326:0:12016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681304832 00000100:00100000:3.0:1787440277.971334:0:12016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681304832 00000100:00100000:3.0:1787440277.971389:0:12016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 45 00000100:00100000:3.0:1787440277.971398:0:12016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee05fc05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+7:2362:x1874266681304832:12345-192.168.206.58@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1787440277.971640:0:12016:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000ba78a780/0x85f5fa77adf3cb4b lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440277.971662:0:12016:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000bc5709cc/0x85f5fa77adf3cb28 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6230c expref: 7 pid: 9225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440277.971671:0:12016:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787440277.971674:0:12016:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787440277.971679:0:12016:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ba78a780/0x85f5fa77adf3cb4b lrc: 4/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440277.971803:0:12016:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000bc5709cc/0x85f5fa77adf3cb28 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6230c expref: 7 pid: 9225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440277.971818:0:12016:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000bc5709cc/0x85f5fa77adf3cb28 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6230c expref: 7 pid: 9225 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440277.971832:0:12016:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee05fc04e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12016:1874266701239296:192.168.206.58@tcp:104: 00000100:00100000:2.0:1787440277.971939:0:12016:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee07f9a8600 going to sleep for 11 seconds 00000100:00100000:0.0:1787440277.974916:0:12016:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee05fc04e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12016:1874266701239296:192.168.206.58@tcp:104: 00010000:00010000:0.0:1787440277.974943:0:12016:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ba78a780/0x85f5fa77adf3cb4b lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440277.974958:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440277.975155:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681304960 00000100:00100000:3.0:1787440277.975162:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681304960 00010000:00010000:3.0:1787440277.975205:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000bc5709cc/0x85f5fa77adf3cb28 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6230c expref: 8 pid: 9225 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440277.975281:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 59 00000100:00100000:3.0:1787440277.975290:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee05fc07100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+8:2363:x1874266681304960:12345-192.168.206.58@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787440277.975303:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787440277.975326:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000bc5709cc/0x85f5fa77adf3cb28 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6230c expref: 8 pid: 9225 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440277.975339:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000bc5709cc/0x85f5fa77adf3cb28 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6230c expref: 8 pid: 9225 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440277.975361:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bc5709cc/0x85f5fa77adf3cb28 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6230c expref: 8 pid: 9225 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440277.975378:0:5836:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787440277.975382:0:5836:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787440277.975387:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ba78a780/0x85f5fa77adf3cb4b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440277.975396:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ba78a780/0x85f5fa77adf3cb4b lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440277.975446:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787440277.975528:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee05fc07100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+7:2363:x1874266681304960:12345-192.168.206.58@tcp:103:ldlm_bl.0 Request processed in 239us (570us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440277.975536:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 59 00010000:00010000:1.0:1787440277.975643:0:12016:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ba78a780/0x85f5fa77adf3cb4b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440277.975655:0:12016:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ba78a780/0x85f5fa77adf3cb4b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440277.975681:0:12016:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000ba78a780/0x85f5fa77adf3cb4b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440277.975691:0:12016:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ba78a780/0x85f5fa77adf3cb4b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440277.975699:0:12016:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ba78a780/0x85f5fa77adf3cb4b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440277.975706:0:12016:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee049e94800 already unused, calling callback (ffffffffc15b52a0) 00010000:00010000:1.0:1787440277.975710:0:12016:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ba78a780/0x85f5fa77adf3cb4b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440277.975719:0:12016:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ba78a780/0x85f5fa77adf3cb4b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440277.975744:0:12016:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ba78a780/0x85f5fa77adf3cb4b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440277.975752:0:12016:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ba78a780/0x85f5fa77adf3cb4b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440277.975802:0:12016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee05fc05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+6:2362:x1874266681304832:12345-192.168.206.58@tcp:1:lhsmtool_posix.0 Request processed in 4405us (4576us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440277.975812:0:12016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 45 00000100:00100000:2.0:1787440277.980368:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440277.983352:0:6892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681305216 00000100:00100000:3.0:1787440277.983371:0:6892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681305216 00000100:00100000:2.0:1787440277.983557:0:6892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 127 00000100:00100000:2.0:1787440277.983569:0:6892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee05fc05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+14:10555:x1874266681305216:12345-192.168.206.58@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1787440277.983780:0:6892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86ec00/0x85f5fa77adf3cb52 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440277.983797:0:6892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86ec00/0x85f5fa77adf3cb52 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440277.983809:0:6892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86ec00/0x85f5fa77adf3cb52 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440277.984009:0:6892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e200/0x85f5fa77adf3cb59 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440277.984021:0:6892:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fa00/0x85f5fa77adf3cb0c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc622f7 expref: 15 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440277.984030:0:6892:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e200/0x85f5fa77adf3cb59 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440277.984073:0:6892:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fa00/0x85f5fa77adf3cb0c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc622f7 expref: 15 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440277.984086:0:6892:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fa00/0x85f5fa77adf3cb0c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc622f7 expref: 15 pid: 5849 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440277.984100:0:6892:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee05fc04e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6892:1874266701239424:192.168.206.58@tcp:104: 00000100:00100000:2.0:1787440277.984228:0:6892:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee07f9a8000 going to sleep for 11 seconds 00000100:00100000:0.0:1787440277.988200:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:1.0:1787440277.988289:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681305344 00000100:00100000:1.0:1787440277.988297:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681305344 00010000:00010000:1.0:1787440277.988333:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fa00/0x85f5fa77adf3cb0c lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc622f7 expref: 16 pid: 5849 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440277.988373:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 60 00000100:00100000:1.0:1787440277.988382:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04a731f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+16:2363:x1874266681305344:12345-192.168.206.58@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787440277.988404:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787440277.988411:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fa00/0x85f5fa77adf3cb0c lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc622f7 expref: 16 pid: 5849 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440277.988424:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fa00/0x85f5fa77adf3cb0c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc622f7 expref: 16 pid: 5849 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440277.988445:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8ee050ca1500) 00010000:00010000:1.0:1787440277.988540:0:5835:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e200/0x85f5fa77adf3cb59 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440277.988562:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e200/0x85f5fa77adf3cb59 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440277.988569:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e200/0x85f5fa77adf3cb59 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440277.988588:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787440277.988642:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04a731f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+16:2363:x1874266681305344:12345-192.168.206.58@tcp:103:ldlm_bl.0 Request processed in 261us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440277.988651:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 60 00010000:00010000:2.0:1787440277.988825:0:6892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fa00/0x85f5fa77adf3cb0c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc622f7 expref: 15 pid: 5849 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440277.988842:0:6892:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee05fc04e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6892:1874266701239424:192.168.206.58@tcp:104: 00010000:00010000:2.0:1787440277.988862:0:6892:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e200/0x85f5fa77adf3cb59 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440277.988871:0:6892:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e200/0x85f5fa77adf3cb59 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440277.988877:0:6892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e200/0x85f5fa77adf3cb59 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787440277.989043:0:6892:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:2.0:1787440277.989734:0:6892:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000001:00080000:2.0:1787440277.989791:0:6892:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:2.0:1787440277.989867:0:6892:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee05fc04e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6892:1874266701239552:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1787440277.989918:0:6892:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440277.989946:0:6892:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee07f9a8a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787440277.990380:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701239552 00000100:00100000:1.0:1787440277.990387:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701239552 00000100:00100000:1.0:1787440277.990422:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787440277.990428:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee05fc04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6892:x1874266701239552:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1787440277.990598:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee05fc04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6892:x1874266701239552:12345-0@lo:1000:mdt00_003.0 Request processed in 164us (675us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440277.990606:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787440277.990630:0:6892:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967309 gen 2 00000004:00080000:0.0:1787440277.990636:0:6892:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967309 00000004:00080000:0.0:1787440277.990651:0:6892:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8ee04a733100, transno 4294967309 00000100:00100000:0.0:1787440277.990747:0:6892:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff8ee04a730e00 x1874266701238656/t4294967310(4294967310) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1787440293 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787440277.990760:0:6892:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee05fc04e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6892:1874266701239552:0@lo:1000:mdt00_003.0 00000001:00080000:0.0:1787440277.991432:0:6892:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967406 00000100:00100000:0.0:1787440277.991643:0:6892:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee04a732a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6892:1874266701239680:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1787440277.991693:0:6892:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440277.991722:0:6892:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee06e7c7600 going to sleep for 11 seconds 00000100:00100000:2.0:1787440277.991773:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701239680 00000100:00100000:2.0:1787440277.991779:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701239680 00000100:00100000:2.0:1787440277.991858:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787440277.992137:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04a730700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6892:x1874266701239680:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1787440277.992306:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04a730700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6892:x1874266701239680:12345-0@lo:1000:mdt00_003.0 Request processed in 174us (613us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1787440277.992312:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787440277.992368:0:6892:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee04a732a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6892:1874266701239680:0@lo:1000:mdt00_003.0 00010000:00010000:0.0:1787440277.992393:0:6892:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e200/0x85f5fa77adf3cb59 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440277.992400:0:6892:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e200/0x85f5fa77adf3cb59 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440277.992405:0:6892:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e200/0x85f5fa77adf3cb59 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440277.992409:0:6892:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee07f86e200 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:0.0:1787440277.992412:0:6892:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e200/0x85f5fa77adf3cb59 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440277.992417:0:6892:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e200/0x85f5fa77adf3cb59 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440277.992436:0:6892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8ee050ca1500) 00010000:00010000:0.0:1787440277.992438:0:6892:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787440277.992441:0:6892:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e200/0x85f5fa77adf3cb59 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440277.992446:0:6892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e200/0x85f5fa77adf3cb59 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440277.992472:0:6892:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86fc00/0x85f5fa77adf3ca9c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440277.992479:0:6892:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86fc00/0x85f5fa77adf3ca9c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440277.992484:0:6892:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86fc00/0x85f5fa77adf3ca9c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440277.992489:0:6892:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee07f86fc00 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:0.0:1787440277.992562:0:6892:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86fc00/0x85f5fa77adf3ca9c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440277.992569:0:6892:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86fc00/0x85f5fa77adf3ca9c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440277.992578:0:6892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8ee050ca1b00) 00010000:00010000:0.0:1787440277.992580:0:6892:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787440277.992587:0:6892:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86fe00/0x85f5fa77adf3caa3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc622db expref: 18 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440277.992598:0:6892:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86fe00/0x85f5fa77adf3caa3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc622db expref: 18 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440277.992614:0:6892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86fe00/0x85f5fa77adf3caa3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc622db expref: 18 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440277.992639:0:6892:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86fe00/0x85f5fa77adf3caa3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc622db expref: 18 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440277.992651:0:6892:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee04a732680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6892:1874266701239808:192.168.206.58@tcp:105: 00000100:00100000:0.0:1787440277.992717:0:6892:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee06e7c7600 going to sleep for 11 seconds 00000100:00100000:2.0:1787440277.995243:0:6892:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee04a732680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6892:1874266701239808:192.168.206.58@tcp:105: 00010000:00010000:2.0:1787440277.995269:0:6892:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86fc00/0x85f5fa77adf3ca9c lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440277.995279:0:6892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86fc00/0x85f5fa77adf3ca9c lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440277.995307:0:6892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f000/0x85f5fa77adf3cb60 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440277.995319:0:6892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f000/0x85f5fa77adf3cb60 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440277.995329:0:6892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f000/0x85f5fa77adf3cb60 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440277.995339:0:6892:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f000/0x85f5fa77adf3cb60 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440277.995345:0:6892:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f000/0x85f5fa77adf3cb60 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440277.995351:0:6892:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f000/0x85f5fa77adf3cb60 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440277.995372:0:6892:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee07f86f000 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:2.0:1787440277.995375:0:6892:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f000/0x85f5fa77adf3cb60 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440277.995381:0:6892:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f000/0x85f5fa77adf3cb60 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440277.995391:0:6892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8ee050ca1b00) 00010000:00010000:2.0:1787440277.995394:0:6892:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440277.995398:0:6892:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f000/0x85f5fa77adf3cb60 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440277.995403:0:6892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f000/0x85f5fa77adf3cb60 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440277.995413:0:6892:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86ec00/0x85f5fa77adf3cb52 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440277.995419:0:6892:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86ec00/0x85f5fa77adf3cb52 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440277.995425:0:6892:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86ec00/0x85f5fa77adf3cb52 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440277.995430:0:6892:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee07f86ec00 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:2.0:1787440277.995433:0:6892:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86ec00/0x85f5fa77adf3cb52 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440277.995439:0:6892:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86ec00/0x85f5fa77adf3cb52 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440277.995457:0:6892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8ee050ca1b00) 00010000:00010000:2.0:1787440277.995459:0:6892:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787440277.995463:0:6892:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86ec00/0x85f5fa77adf3cb52 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440277.995468:0:6892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86ec00/0x85f5fa77adf3cb52 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440277.995718:0:6892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee05fc05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+18:10555:x1874266681305216:12345-192.168.206.58@tcp:57:lhsmtool_posix.0 Request processed in 12151us (15358us total) trans 4294967407 rc 0/0 00000100:00100000:2.0:1787440277.995730:0:6892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 127 00000020:00080000:2.0:1787440277.995735:0:6892:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:3.0:1787440277.995847:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000040:00080000:1.0:1787440277.996702:0:11682:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787440277.996708:0:11682:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:2.0:1787440277.997572:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681305472 00000100:00100000:2.0:1787440277.997582:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681305472 00000100:00100000:2.0:1787440277.997632:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 31 00000100:00100000:2.0:1787440277.997641:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee079914700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+18:10554:x1874266681305472:12345-192.168.206.58@tcp:49:lfs.0 00000100:00100000:2.0:1787440277.997752:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee079914700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+18:10554:x1874266681305472:12345-192.168.206.58@tcp:49:lfs.0 Request processed in 112us (1906us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440277.997759:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 31 00000100:00100000:3.0:1787440277.997831:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000040:00080000:1.0:1787440277.998431:0:11682:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:1.0:1787440277.998441:0:11682:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787440277.998674:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681305728 00000100:00100000:2.0:1787440277.998680:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681305728 00000100:00100000:2.0:1787440277.998747:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 32 00000100:00100000:2.0:1787440277.998755:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee079baf050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+18:10555:x1874266681305728:12345-192.168.206.58@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1787440277.999333:0:5853:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1787440277.999433:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967408 00010000:00010000:2.0:1787440277.999474:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e400/0x85f5fa77adf3cb67 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440277.999528:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e400/0x85f5fa77adf3cb67 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440277.999540:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e400/0x85f5fa77adf3cb67 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440277.999548:0:5853:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e400/0x85f5fa77adf3cb67 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440277.999554:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e400/0x85f5fa77adf3cb67 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440277.999561:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e400/0x85f5fa77adf3cb67 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440277.999584:0:5853:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787440277.999627:0:5837:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787440277.999635:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e400/0x85f5fa77adf3cb67 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440277.999643:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee07f86e400 already unused, calling callback (ffffffffc15b52a0) 00010000:00010000:3.0:1787440277.999647:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e400/0x85f5fa77adf3cb67 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440277.999655:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e400/0x85f5fa77adf3cb67 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440277.999661:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee079baf050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+20:10555:x1874266681305728:12345-192.168.206.58@tcp:35:lhsmtool_posix.0 Request processed in 903us (1827us total) trans 4294967409 rc 0/0 00000100:00100000:2.0:1787440277.999671:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 32 00010000:00010000:3.0:1787440277.999672:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8ee054b3c900) 00000020:00080000:2.0:1787440277.999676:0:5853:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787440277.999677:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787440277.999683:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e400/0x85f5fa77adf3cb67 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440277.999689:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e400/0x85f5fa77adf3cb67 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440277.999707:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787440277.999710:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787440277.999719:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787440278.000095:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:1.0:1787440278.000318:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681305984 00000100:00100000:1.0:1787440278.000325:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681305984 00000100:00100000:1.0:1787440278.000403:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 128 00000100:00100000:1.0:1787440278.000412:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee079916680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+20:10554:x1874266681305984:12345-192.168.206.58@tcp:58:lfs.0 00000040:00080000:1.0:1787440278.000594:0:5850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:1.0:1787440278.000690:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee079916680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+20:10554:x1874266681305984:12345-192.168.206.58@tcp:58:lfs.0 Request processed in 279us (596us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440278.000704:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 128 00000100:00100000:1.0:1787440278.036116:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:2.0:1787440278.036248:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681306112 00000100:00100000:2.0:1787440278.036268:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681306112 00000100:00100000:2.0:1787440278.036344:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 129 00000100:00100000:2.0:1787440278.036355:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee0776bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+20:10557:x1874266681306112:12345-192.168.206.58@tcp:101:lfs.0 00010000:00010000:2.0:1787440278.036378:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440278.036395:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86ec00/0x85f5fa77adf3cb6e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fab14535dc62313 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440278.036480:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f000/0x85f5fa77adf3cb75 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440278.036539:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f000/0x85f5fa77adf3cb75 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440278.036550:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f000/0x85f5fa77adf3cb75 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440278.036564:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86fc00/0x85f5fa77adf3cb7c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440278.036572:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86fc00/0x85f5fa77adf3cb7c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440278.036578:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86fc00/0x85f5fa77adf3cb7c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1787440278.036691:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787440278.038568:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f600/0x85f5fa77adf3cb83 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440278.038592:0:5851:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fe00/0x85f5fa77adf3ca8e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc622d4 expref: 21 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440278.038600:0:5851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f600/0x85f5fa77adf3cb83 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440278.038639:0:5851:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fe00/0x85f5fa77adf3ca8e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc622d4 expref: 21 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440278.038655:0:5851:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fe00/0x85f5fa77adf3ca8e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc622d4 expref: 21 pid: 5849 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440278.038686:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee05fc06300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5851:1874266701239936:192.168.206.58@tcp:104: 00000100:00100000:2.0:1787440278.040019:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee07f9a8b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787440278.041834:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:1.0:1787440278.041969:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681306368 00000100:00100000:1.0:1787440278.041985:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681306368 00000100:00100000:2.0:1787440278.042370:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee05fc06300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5851:1874266701239936:192.168.206.58@tcp:104: 00010000:00010000:2.0:1787440278.042408:0:5851:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f600/0x85f5fa77adf3cb83 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440278.043039:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 33 00000100:00100000:1.0:1787440278.043058:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04a730380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+22:5600:x1874266681306368:12345-192.168.206.58@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1787440278.043423:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04a730380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+23:5600:x1874266681306368:12345-192.168.206.58@tcp:35:ldlm_bl.0 Request processed in 369us (1601us total) trans 4294967410 rc 0/0 00000100:00100000:1.0:1787440278.043434:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 33 00000100:00100000:3.0:1787440278.050376:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:2.0:1787440278.050733:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681306496 00000100:00100000:2.0:1787440278.050747:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681306496 00010000:00010000:2.0:1787440278.050798:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fe00/0x85f5fa77adf3ca8e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc622d4 expref: 23 pid: 5849 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440278.050847:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 61 00000100:00100000:2.0:1787440278.051392:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee06e7e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+23:2363:x1874266681306496:12345-192.168.206.58@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787440278.051415:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787440278.051423:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fe00/0x85f5fa77adf3ca8e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc622d4 expref: 23 pid: 5849 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440278.051439:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fe00/0x85f5fa77adf3ca8e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc622d4 expref: 23 pid: 5849 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440278.051466:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fe00/0x85f5fa77adf3ca8e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc622d4 expref: 23 pid: 5849 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440278.051487:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8ee050ca1b00) 00010000:00010000:2.0:1787440278.051568:0:5834:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f600/0x85f5fa77adf3cb83 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440278.051597:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f600/0x85f5fa77adf3cb83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440278.051606:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f600/0x85f5fa77adf3cb83 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440278.051650:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787440278.051733:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee06e7e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+22:2363:x1874266681306496:12345-192.168.206.58@tcp:103:ldlm_bl.0 Request processed in 347us (1371us total) trans 0 rc 0/0 00010000:00010000:0.0:1787440278.051796:0:5851:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f600/0x85f5fa77adf3cb83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440278.051806:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f600/0x85f5fa77adf3cb83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787440278.051871:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1787440278.051877:0:5851:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787440278.051899:0:5851:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f600/0x85f5fa77adf3cb83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440278.051914:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f600/0x85f5fa77adf3cb83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440278.051926:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f000/0x85f5fa77adf3cb75 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440278.051933:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f000/0x85f5fa77adf3cb75 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440278.051953:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f000/0x85f5fa77adf3cb75 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440278.051960:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee07f86f000 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:0.0:1787440278.051965:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f000/0x85f5fa77adf3cb75 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440278.051975:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f000/0x85f5fa77adf3cb75 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440278.051986:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8ee0460ccd00) 00010000:00010000:0.0:1787440278.051989:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440278.051993:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f000/0x85f5fa77adf3cb75 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440278.051999:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f000/0x85f5fa77adf3cb75 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440278.052013:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86fc00/0x85f5fa77adf3cb7c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440278.052020:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86fc00/0x85f5fa77adf3cb7c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440278.052026:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86fc00/0x85f5fa77adf3cb7c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440278.052032:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee07f86fc00 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:0.0:1787440278.052035:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86fc00/0x85f5fa77adf3cb7c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440278.052051:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86fc00/0x85f5fa77adf3cb7c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440278.052061:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8ee054b3c800) 00010000:00010000:0.0:1787440278.052064:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440278.052067:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86fc00/0x85f5fa77adf3cb7c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440278.052073:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86fc00/0x85f5fa77adf3cb7c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440278.052117:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86ec00/0x85f5fa77adf3cb6e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62313 expref: 23 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440278.052134:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f600/0x85f5fa77adf3cb83 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62313 expref: 22 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440278.052141:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8ee050ca1b00) 00010000:00010000:0.0:1787440278.052143:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787440278.052145:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee07f86f600, rc 0) 00000100:00100000:0.0:1787440278.052188:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee0776bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+22:10557:x1874266681306112:12345-192.168.206.58@tcp:101:lfs.0 Request processed in 15836us (16081us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440278.052197:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 129 00000100:00100000:2.0:1787440278.053553:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 61 00000001:00080000:3.0:1787440278.460871:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000001:00080000:3.0:1787440278.460892:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000040:00080000:3.0:1787440278.608317:0:12056:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787440278.608324:0:12056:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787440278.608374:0:12056:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1787440278.608380:0:12056:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1787440278.621512:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787440278.942245:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee0776b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:168176ea-29d1-49de-a254-317e90d54802:3309:1874266701240064:0@lo:400:kworker.0 00000100:00100000:2.0:1787440278.942279:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee0776b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1874266701240320:0@lo:400:kworker.0 00000100:00100000:3.0:1787440278.942351:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee0776ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874266701240192:0@lo:400:kworker.0 00000100:00100000:1.0:1787440278.942409:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee0776b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1874266701240448:0@lo:400:kworker.0 00000100:00100000:0.0:1787440278.943709:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440278.943792:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440278.943878:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701240320 00000100:00100000:2.0:1787440278.943885:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701240320 00000100:00100000:0.0:1787440278.943936:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee0776b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1874266701240576:0@lo:400:kworker.0 00000100:00100000:2.0:1787440278.943947:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1787440278.943958:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee05fc05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874266701240320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787440278.943984:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440278.944026:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787440278.944033:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee07f9f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874266701240704:0@lo:400:kworker.0 00000100:00100000:2.0:1787440278.946403:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee05fc05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874266701240320:12345-0@lo:400:kworker.0 Request processed in 2440us (2604us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440278.946417:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1787440278.946449:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701240576 00000100:00100000:2.0:1787440278.946457:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701240576 00000100:00100000:0.0:1787440278.946474:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440278.946523:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1787440278.946556:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701240704 00000100:00100000:0.0:1787440278.946561:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701240704 00000100:00100000:3.0:1787440278.946643:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440278.946660:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787440278.946668:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04a730000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3309:x1874266701240704:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1787440278.946701:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787440278.946717:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701240064 00000100:00100000:3.0:1787440278.946722:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701240064 00000100:00100000:3.0:1787440278.946753:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:3.0:1787440278.946760:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee043b48450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:168176ea-29d1-49de-a254-317e90d54802+19:3309:x1874266701240064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440278.946815:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee043b48450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:168176ea-29d1-49de-a254-317e90d54802+19:3309:x1874266701240064:12345-0@lo:400:kworker.0 Request processed in 56us (3111us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440278.946822:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:0.0:1787440278.946874:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04a730000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3309:x1874266701240704:12345-0@lo:400:kworker.0 Request processed in 207us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440278.946881:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1787440278.946893:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee0776b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1874266701240320:0@lo:400:kworker.0 00000100:00100000:0.0:1787440278.946907:0:6892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701240192 00000100:00100000:0.0:1787440278.946913:0:6892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701240192 00000100:00100000:1.0:1787440278.947191:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440278.947248:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee07f9f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874266701240704:0@lo:400:kworker.0 00000100:00100000:1.0:1787440278.947263:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee0776b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:168176ea-29d1-49de-a254-317e90d54802:3309:1874266701240064:0@lo:400:kworker.0 00000100:00100000:3.0:1787440278.947268:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701240448 00000100:00100000:3.0:1787440278.947274:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701240448 00000100:00100000:3.0:1787440278.947308:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00080000:1.0:1787440278.947312:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787440278.947317:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee07f9f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1874266701240448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440278.947356:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee07f9f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1874266701240448:12345-0@lo:400:kworker.0 Request processed in 41us (166us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440278.947377:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1787440278.947556:0:3312:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:1.0:1787440278.947562:0:3312:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967304 00000004:00080000:1.0:1787440278.947580:0:3312:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8ee077ec0e00, transno 4294967301 00000004:00080000:1.0:1787440278.947600:0:3312:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967304 00000004:00080000:1.0:1787440278.947623:0:3312:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8ee05fc06d80, transno 4294967304 00000100:00100000:1.0:1787440278.947629:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee0776b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1874266701240448:0@lo:400:kworker.0 00000100:00100000:2.0:1787440278.948003:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04a733800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1874266701240576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787440278.948021:0:6892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1787440278.948033:0:6892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee079914e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874266701240192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787440278.948071:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04a733800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1874266701240576:12345-0@lo:400:kworker.0 Request processed in 73us (4086us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440278.948089:0:6892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee079914e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874266701240192:12345-0@lo:400:kworker.0 Request processed in 59us (1447us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440278.948332:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee0776b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1874266701240576:0@lo:400:kworker.0 00000100:00100000:1.0:1787440278.948371:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee0776ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874266701240192:0@lo:400:kworker.0 00000100:00100000:2.0:1787440278.948463:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1787440278.948472:0:6892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000040:00080000:1.0:1787440279.004732:0:11682:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787440279.004752:0:11682:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787440279.004804:0:11682:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1787440279.004811:0:11682:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787440279.004923:0:11682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee07f9f3480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11682:1874266701240832:192.168.206.58@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787440279.005041:0:11682:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee047d4cf00 going to sleep for 11 seconds 00000100:00100000:3.0:1787440279.009910:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:1.0:1787440279.010179:0:11682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee07f9f3480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11682:1874266701240832:192.168.206.58@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787440279.010228:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681306624 00000100:00100000:0.0:1787440279.010237:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681306624 00000100:00100000:0.0:1787440279.010298:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 130 00000100:00100000:0.0:1787440279.010310:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee079914700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+21:10569:x1874266681306624:12345-192.168.206.58@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787440279.010344:0:5850:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787440279.010434:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee079914700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+21:10569:x1874266681306624:12345-192.168.206.58@tcp:53:lhsmtool_posix.0 Request processed in 127us (531us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440279.010442:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 130 00000100:00100000:3.0:1787440279.014259:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:2.0:1787440279.014530:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681306880 00000100:00100000:2.0:1787440279.014553:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681306880 00000100:00100000:2.0:1787440279.014624:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 131 00000100:00100000:2.0:1787440279.014634:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee079915180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+21:10569:x1874266681306880:12345-192.168.206.58@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787440279.014653:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440279.014674:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e600/0x85f5fa77adf3cb8a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fab14535dc6231a expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440279.014775:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e200/0x85f5fa77adf3cb91 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440279.014789:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e200/0x85f5fa77adf3cb91 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440279.014803:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e200/0x85f5fa77adf3cb91 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787440279.014814:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1787440279.015256:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e600/0x85f5fa77adf3cb8a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6231a expref: 24 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440279.015278:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e200/0x85f5fa77adf3cb91 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6231a expref: 23 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440279.015287:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8ee050ca1b00) 00010000:00010000:2.0:1787440279.015290:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787440279.015293:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee07f86e200, rc 0) 00000100:00100000:2.0:1787440279.015403:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee079915180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+23:10569:x1874266681306880:12345-192.168.206.58@tcp:101:lhsmtool_posix.0 Request processed in 770us (1151us total) trans 4294967411 rc 0/0 00000100:00100000:2.0:1787440279.015411:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 131 00000100:00100000:3.0:1787440279.022809:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440279.022919:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440279.023003:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681307264 00000100:00100000:0.0:1787440279.023015:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681307264 00000100:00100000:0.0:1787440279.023086:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 132 00000100:00100000:0.0:1787440279.023095:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee079915880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+23:10569:x1874266681307264:12345-192.168.206.58@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787440279.023190:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf600/0x85f5fa77adf3cb9f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440279.023206:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf600/0x85f5fa77adf3cb9f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440279.023217:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf600/0x85f5fa77adf3cb9f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440279.023392:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf600/0x85f5fa77adf3cb9f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440279.023400:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf600/0x85f5fa77adf3cb9f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440279.023406:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf600/0x85f5fa77adf3cb9f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440279.023412:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee04cbcf600 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:0.0:1787440279.023428:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf600/0x85f5fa77adf3cb9f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440279.023435:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf600/0x85f5fa77adf3cb9f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440279.023455:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8ee050ca1b00) 00010000:00010000:0.0:1787440279.023458:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787440279.023463:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf600/0x85f5fa77adf3cb9f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440279.023685:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf600/0x85f5fa77adf3cb9f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440279.023832:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee079915880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+24:10569:x1874266681307264:12345-192.168.206.58@tcp:57:lhsmtool_posix.0 Request processed in 736us (1030us total) trans 4294967412 rc 0/0 00000100:00100000:0.0:1787440279.023840:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 132 00000100:00100000:1.0:1787440279.023941:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681307008 00000100:00100000:1.0:1787440279.023946:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681307008 00000100:00100000:1.0:1787440279.023985:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 8 00000100:00100000:1.0:1787440279.023993:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee0776ba300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+25:2362:x1874266681307008:12345-192.168.206.58@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787440279.024004:0:6711:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787440279.024019:0:6711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e200/0x85f5fa77adf3cb91 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6231a expref: 25 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440279.024032:0:6711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8ee050ca1b00) 00010000:00010000:1.0:1787440279.024035:0:6711:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787440279.024057:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee0776ba300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+24:2362:x1874266681307008:12345-192.168.206.58@tcp:103:ldlm_bl.0 Request processed in 65us (1139us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440279.024064:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 8 00000040:00080000:1.0:1787440279.024186:0:11682:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787440279.024191:0:11682:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787440279.026022:0:11682:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1787440279.026035:0:11682:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787440279.027997:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:2.0:1787440279.028117:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681307520 00000100:00100000:2.0:1787440279.028130:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681307520 00000100:00100000:2.0:1787440279.028203:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 34 00000100:00100000:2.0:1787440279.028213:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee0776b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+23:10569:x1874266681307520:12345-192.168.206.58@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787440279.028467:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee0776b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+24:10569:x1874266681307520:12345-192.168.206.58@tcp:35:lhsmtool_posix.0 Request processed in 255us (478us total) trans 4294967413 rc 0/0 00000100:00100000:2.0:1787440279.028476:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 34 00000100:00100000:2.0:1787440279.452701:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee0776b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874266701240960:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787440279.452767:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440279.452814:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701240960 00000100:00100000:3.0:1787440279.452822:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701240960 00000100:00080000:1.0:1787440279.452867:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787440279.452896:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787440279.452905:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee05fc07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3311:x1874266701240960:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787440279.452923:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3856662528 00000100:00100000:3.0:1787440279.452970:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee05fc07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3311:x1874266701240960:12345-0@lo:13:osp-pre-1-0.0 Request processed in 66us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440279.452977:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787440279.453019:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee0776b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874266701240960:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787440279.644775:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787440280.457672:0:12107:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787440280.457680:0:12107:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787440280.457722:0:12107:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1787440280.457735:0:12107:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787440280.519739:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440280.519836:0:6892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681307776 00000100:00100000:3.0:1787440280.519844:0:6892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681307776 00000100:00100000:3.0:1787440280.519902:0:6892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 133 00000100:00100000:3.0:1787440280.519912:0:6892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee0776b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+24:10589:x1874266681307776:12345-192.168.206.58@tcp:101:lfs.0 00010000:00010000:3.0:1787440280.519932:0:6892:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440280.519950:0:6892:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95200/0x85f5fa77adf3cba6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fab14535dc62321 expref: -99 pid: 6892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440280.520046:0:6892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94e00/0x85f5fa77adf3cbad lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440280.520067:0:6892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94e00/0x85f5fa77adf3cbad lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440280.520078:0:6892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94e00/0x85f5fa77adf3cbad lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787440280.520089:0:6892:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1787440280.520220:0:6892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95200/0x85f5fa77adf3cba6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62321 expref: 27 pid: 6892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440280.520238:0:6892:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94e00/0x85f5fa77adf3cbad lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62321 expref: 26 pid: 6892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440280.520246:0:6892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8ee050ca1b00) 00010000:00010000:3.0:1787440280.520249:0:6892:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1787440280.520251:0:6892:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee049e94e00, rc 0) 00000100:00100000:3.0:1787440280.520302:0:6892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee0776b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+26:10589:x1874266681307776:12345-192.168.206.58@tcp:101:lfs.0 Request processed in 392us (568us total) trans 4294967414 rc 0/0 00000100:00100000:3.0:1787440280.520310:0:6892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 133 00000100:00080000:3.0:1787440280.520332:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787440280.522826:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440280.522913:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681307904 00000100:00100000:3.0:1787440280.522923:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681307904 00000100:00100000:3.0:1787440280.522975:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 134 00000100:00100000:3.0:1787440280.522985:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04a732d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+26:10589:x1874266681307904:12345-192.168.206.58@tcp:54:lfs.0 00010000:00010000:3.0:1787440280.523050:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94000/0x85f5fa77adf3cbbb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440280.523068:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94000/0x85f5fa77adf3cbbb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440280.523088:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94000/0x85f5fa77adf3cbbb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440280.523112:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94000/0x85f5fa77adf3cbbb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440280.523119:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94000/0x85f5fa77adf3cbbb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440280.523127:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94000/0x85f5fa77adf3cbbb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440280.523133:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee049e94000 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:3.0:1787440280.523138:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94000/0x85f5fa77adf3cbbb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440280.523146:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94000/0x85f5fa77adf3cbbb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440280.523245:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8ee050ca1b00) 00010000:00010000:3.0:1787440280.523248:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787440280.523253:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94000/0x85f5fa77adf3cbbb lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440280.523260:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94000/0x85f5fa77adf3cbbb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440280.523337:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04a732d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+26:10589:x1874266681307904:12345-192.168.206.58@tcp:54:lfs.0 Request processed in 352us (516us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440280.523345:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 134 00000100:00100000:3.0:1787440280.561542:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:1.0:1787440280.561629:0:12016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681308032 00000100:00100000:1.0:1787440280.561639:0:12016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681308032 00000100:00080000:3.0:1787440280.561689:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787440280.561710:0:12016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 46 00000100:00100000:1.0:1787440280.561721:0:12016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee0776b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+6:2363:x1874266681308032:12345-192.168.206.58@tcp:101:cat.0 00010000:00010000:1.0:1787440280.561737:0:12016:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440280.561755:0:12016:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000024ff31d3/0x85f5fa77adf3cbc2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5fab14535dc62328 expref: -99 pid: 12016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787440280.561781:0:12016:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a8a2c95, atime: 0x6a8a2c95, ctime: 0x6a8a2c95, blocks: 0xb 00010000:00010000:1.0:1787440280.561799:0:12016:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=378s v=(0 0) 00010000:00010000:1.0:1787440280.561804:0:12016:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787440280.561811:0:12016:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000024ff31d3/0x85f5fa77adf3cbc2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62328 expref: 7 pid: 12016 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440280.561826:0:12016:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000024ff31d3/0x85f5fa77adf3cbc2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62328 expref: 7 pid: 12016 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440280.561836:0:12016:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee07fb9ec00, rc 0) 00000100:00100000:1.0:1787440280.561907:0:12016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee0776b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+7:2363:x1874266681308032:12345-192.168.206.58@tcp:101:cat.0 Request processed in 187us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440280.561914:0:12016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 46 00000100:00100000:0.0:1787440280.564368:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:1.0:1787440280.564439:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681308160 00000100:00100000:1.0:1787440280.564457:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681308160 00002000:00100000:1.0:1787440280.564516:0:6703:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff8ee04a731f80 x1874266681308160/t0(0) o3->792563a7-4c22-4ac7-ac25-d49ef7fb41a8@192.168.206.58@tcp:441/0 lens 488/0 e 0 to 0 dl 1787440291 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787440280.564526:0:6703:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ee04a731f80 with x1874266681308160 ext(0->4095) 00002000:00010000:1.0:1787440280.564541:0:6703:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8ee04a731f80 00000100:00100000:1.0:1787440280.564575:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 3 00000100:00100000:1.0:1787440280.564584:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04a731f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+7:2362:x1874266681308160:12345-192.168.206.58@tcp:3:cat.0 00000100:00100000:1.0:1787440280.564791:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04a731f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+7:2362:x1874266681308160:12345-192.168.206.58@tcp:3:cat.0 Request processed in 208us (430us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787440280.564798:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 3 00002000:00100000:1.0:1787440280.564803:0:6703:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff8ee04a731f80 x1874266681308160/t0(0) o3->792563a7-4c22-4ac7-ac25-d49ef7fb41a8@192.168.206.58@tcp:441/0 lens 488/4536 e 0 to 0 dl 1787440291 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787440280.564811:0:6703:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ee04a731f80 with x1874266681308160 ext(0->4095) 00002000:00010000:1.0:1787440280.564814:0:6703:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8ee04a731f80 00010000:00010000:3.0:1787440280.668755:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787440281.692786:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787440282.681723:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440282.681759:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440282.681785:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440282.681803:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440282.681822:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440282.681854:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681308288 00000100:00100000:3.0:1787440282.681862:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681308288 00000100:00100000:3.0:1787440282.682326:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 292 00000100:00100000:3.0:1787440282.682336:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee06d270050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+13:2363:x1874266681308288:12345-192.168.206.58@tcp:400:kworker.0 00000100:00100000:3.0:1787440282.682402:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee06d270050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+13:2363:x1874266681308288:12345-192.168.206.58@tcp:400:kworker.0 Request processed in 68us (686us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440282.682410:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 292 00000100:00100000:3.0:1787440282.682446:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681308544 00000100:00100000:3.0:1787440282.682451:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681308544 00000100:00100000:3.0:1787440282.682523:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681308672 00000100:00100000:3.0:1787440282.682527:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681308672 00000100:00100000:3.0:1787440282.682551:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 80 00000100:00100000:3.0:1787440282.682558:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee0776b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+5:2363:x1874266681308544:12345-192.168.206.58@tcp:400:kworker.0 00000100:00100000:3.0:1787440282.682585:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee0776b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+5:2363:x1874266681308544:12345-192.168.206.58@tcp:400:kworker.0 Request processed in 28us (825us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440282.682592:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 80 00000100:00100000:3.0:1787440282.682605:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 81 00000100:00100000:3.0:1787440282.682612:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee077ec0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+7:2363:x1874266681308672:12345-192.168.206.58@tcp:400:kworker.0 00000100:00100000:3.0:1787440282.682635:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee077ec0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+7:2363:x1874266681308672:12345-192.168.206.58@tcp:400:kworker.0 Request processed in 25us (812us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440282.682649:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 81 00000100:00100000:3.0:1787440282.682668:0:6892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681308800 00000100:00100000:3.0:1787440282.682672:0:6892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681308800 00000100:00100000:3.0:1787440282.682697:0:6892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681308416 00000100:00100000:3.0:1787440282.682700:0:6892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681308416 00000100:00100000:3.0:1787440282.682719:0:6892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 142 00000100:00100000:3.0:1787440282.682725:0:6892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee05fb62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fde7b340-91f7-42a0-a1a3-5665ea2691c9+5:2363:x1874266681308800:12345-192.168.206.58@tcp:400:kworker.0 00000100:00100000:3.0:1787440282.682754:0:6892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee05fb62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fde7b340-91f7-42a0-a1a3-5665ea2691c9+5:2363:x1874266681308800:12345-192.168.206.58@tcp:400:kworker.0 Request processed in 29us (968us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440282.682759:0:6892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 142 00000100:00100000:3.0:1787440282.682772:0:6892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 143 00000100:00100000:3.0:1787440282.682778:0:6892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee05fb62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+26:2363:x1874266681308416:12345-192.168.206.58@tcp:400:kworker.0 00000100:00100000:3.0:1787440282.682802:0:6892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee05fb62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+26:2363:x1874266681308416:12345-192.168.206.58@tcp:400:kworker.0 Request processed in 25us (998us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440282.682807:0:6892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 143 00000100:00080000:3.0:1787440282.683298:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787440282.683304:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787440282.683306:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787440282.719070:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787440283.036819:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787440283.036844:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee077ec0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874266701241088:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787440283.036921:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440283.037161:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701241088 00000100:00100000:3.0:1787440283.037168:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701241088 00000100:00100000:3.0:1787440283.037235:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787440283.037244:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee05fc07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874266701241088:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787440283.037276:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787440283.037323:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee05fc07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874266701241088:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440283.037330:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787440283.037390:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee077ec0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874266701241088:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787440283.037543:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:1.0:1787440283.088635:0:5871:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967412 is committed 00000020:00080000:1.0:1787440283.088652:0:5871:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8ee06e7c7480 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:1.0:1787440283.088657:0:5871:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8ee04532bb00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8ee06e7c7000 00000020:00080000:1.0:1787440283.088661:0:5871:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8ee04532b200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8ee077286800 00000001:00080000:1.0:1787440283.088690:0:5871:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000001:00080000:1.0:1787440283.088712:0:5871:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:1.0:1787440283.088723:0:5871:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000004:00080000:1.0:1787440283.088729:0:5871:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:3.0:1787440283.089174:0:5882:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:3.0:1787440283.089357:0:5882:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000001:00080000:0.0:1787440283.122025:0:7640:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000001:00080000:0.0:1787440283.122047:0:7640:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00000001:00080000:0.0:1787440283.122053:0:7640:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967312 is committed 00010000:00010000:3.0:1787440283.740777:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787440284.060718:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee07f9f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:168176ea-29d1-49de-a254-317e90d54802:3309:1874266701241216:0@lo:400:kworker.0 00000100:00100000:2.0:1787440284.060796:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440284.060891:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701241216 00000100:00100000:3.0:1787440284.060900:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701241216 00000100:00100000:3.0:1787440284.061375:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:3.0:1787440284.061389:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee06d273850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:168176ea-29d1-49de-a254-317e90d54802+19:3309:x1874266701241216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440284.062342:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee07f9f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874266701241344:0@lo:400:kworker.0 00000100:00100000:1.0:1787440284.062395:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440284.062426:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee07f9f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1874266701241856:0@lo:400:kworker.0 00000100:00100000:3.0:1787440284.062649:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee06d273850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:168176ea-29d1-49de-a254-317e90d54802+19:3309:x1874266701241216:12345-0@lo:400:kworker.0 Request processed in 1261us (1850us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440284.062651:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee07f9f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:168176ea-29d1-49de-a254-317e90d54802:3309:1874266701241216:0@lo:400:kworker.0 00000100:00100000:3.0:1787440284.062667:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:2.0:1787440284.062678:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee07f9f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1874266701241728:0@lo:400:kworker.0 00000100:00100000:2.0:1787440284.062774:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440284.062818:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440284.062834:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701241344 00000100:00100000:3.0:1787440284.062841:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701241344 00000100:00100000:2.0:1787440284.062850:0:12016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701241856 00000100:00100000:2.0:1787440284.062856:0:12016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701241856 00000100:00100000:1.0:1787440284.062867:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee07f9f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1874266701241472:0@lo:400:kworker.0 00000100:00100000:3.0:1787440284.062884:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701241728 00000100:00100000:3.0:1787440284.062889:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701241728 00000100:00100000:1.0:1787440284.062899:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440284.062927:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701241472 00000100:00100000:3.0:1787440284.062931:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701241472 00000100:00100000:1.0:1787440284.062936:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787440284.062962:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1787440284.062971:0:12016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787440284.062974:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee07f9f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874266701241344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787440284.062984:0:12016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee07f9f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3310:x1874266701241856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440284.063038:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee07f9f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874266701241344:12345-0@lo:400:kworker.0 Request processed in 67us (642us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440284.063040:0:12016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee07f9f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3310:x1874266701241856:12345-0@lo:400:kworker.0 Request processed in 60us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440284.063050:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1787440284.063060:0:12016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787440284.063073:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1787440284.063082:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee05fc07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1874266701241728:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1787440284.063086:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787440284.063091:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787440284.063131:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee05fc07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1874266701241728:12345-0@lo:400:kworker.0 Request processed in 44us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440284.063152:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1787440284.063152:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee07f9f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1874266701241728:0@lo:400:kworker.0 00000100:00100000:1.0:1787440284.063179:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee07f9f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874266701241600:0@lo:400:kworker.0 00000100:00100000:1.0:1787440284.063214:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440284.065301:0:6892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1787440284.065320:0:6892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee07f9f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874266701241472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440284.065637:0:6892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee07f9f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874266701241472:12345-0@lo:400:kworker.0 Request processed in 326us (2738us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440284.065646:0:6892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1787440284.065686:0:9225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701241600 00000100:00100000:1.0:1787440284.065693:0:9225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701241600 00000100:00100000:1.0:1787440284.065908:0:9225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1787440284.065917:0:9225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee07f9f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1874266701241600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440284.065964:0:9225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee07f9f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1874266701241600:12345-0@lo:400:kworker.0 Request processed in 49us (2750us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440284.065971:0:9225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1787440284.066019:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee07f9f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874266701241600:0@lo:400:kworker.0 00000100:00100000:1.0:1787440284.066615:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee07f9f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1874266701241472:0@lo:400:kworker.0 00000100:00100000:1.0:1787440284.066660:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee07f9f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874266701241344:0@lo:400:kworker.0 00000100:00100000:1.0:1787440284.066671:0:3310:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:1.0:1787440284.066675:0:3310:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8ee04a730e00, transno 4294967310 00000004:00080000:1.0:1787440284.066697:0:3310:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:1.0:1787440284.066722:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee07f9f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1874266701241856:0@lo:400:kworker.0 00000100:00100000:3.0:1787440284.388088:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:1.0:1787440284.388189:0:6892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681308928 00000100:00100000:1.0:1787440284.388199:0:6892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681308928 00000100:00100000:1.0:1787440284.388273:0:6892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 135 00000100:00100000:1.0:1787440284.388298:0:6892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee077ec0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+13:10243:x1874266681308928:12345-192.168.206.58@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1787440284.388393:0:6892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee077ec0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+13:10243:x1874266681308928:12345-192.168.206.58@tcp:60:lhsmtool_posix.0 Request processed in 98us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440284.388401:0:6892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 135 00000100:00080000:2.0:1787440284.388480:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787440284.401322:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:1.0:1787440284.401660:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681309184 00000100:00100000:1.0:1787440284.401670:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681309184 00000100:00100000:1.0:1787440284.401732:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 35 00000100:00100000:1.0:1787440284.401741:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee077ec1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+13:10243:x1874266681309184:12345-192.168.206.58@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787440284.402227:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee077ec1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+14:10243:x1874266681309184:12345-192.168.206.58@tcp:35:lhsmtool_posix.0 Request processed in 485us (912us total) trans 4294967415 rc 0/0 00000100:00100000:1.0:1787440284.402236:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 35 00000100:00100000:1.0:1787440284.572931:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee077ec3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874266701241984:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787440284.572996:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440284.575390:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701241984 00000100:00100000:0.0:1787440284.575404:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701241984 00000100:00100000:0.0:1787440284.575564:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787440284.575584:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee07f9f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874266701241984:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787440284.575632:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787440284.575726:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee07f9f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874266701241984:12345-0@lo:13:osp-pre-1-0.0 Request processed in 153us (2729us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440284.575734:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787440284.575801:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee077ec3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874266701241984:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787440284.764806:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787440285.788676:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787440286.813078:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787440287.196788:0:11682:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787440287.196795:0:11682:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787440287.197041:0:11682:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:2.0:1787440287.197047:0:11682:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787440287.761670:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440287.761958:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681309312 00000100:00100000:0.0:1787440287.761970:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681309312 00000100:00100000:0.0:1787440287.762078:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 136 00000100:00100000:0.0:1787440287.762090:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee077ec1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fde7b340-91f7-42a0-a1a3-5665ea2691c9+5:11042:x1874266681309312:12345-192.168.206.58@tcp:101:lsof.0 00010000:00010000:0.0:1787440287.762115:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440287.762168:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf200/0x85f5fa77adf3cbc9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fab14535dc6232f expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440287.762249:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfe00/0x85f5fa77adf3cbd0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440287.762266:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfe00/0x85f5fa77adf3cbd0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440287.762282:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfe00/0x85f5fa77adf3cbd0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787440287.762560:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1787440287.762566:0:5849:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1787440287.762679:0:5849:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfe00/0x85f5fa77adf3cbd0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440287.762708:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf200/0x85f5fa77adf3cbc9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6232f expref: 7 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440287.762727:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfe00/0x85f5fa77adf3cbd0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6232f expref: 6 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440287.762736:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ee054b3c600) 00010000:00010000:0.0:1787440287.762740:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787440287.762744:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee04cbcfe00, rc 0) 00000100:00080000:2.0:1787440287.763042:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787440287.763144:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee077ec1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fde7b340-91f7-42a0-a1a3-5665ea2691c9+6:11042:x1874266681309312:12345-192.168.206.58@tcp:101:lsof.0 Request processed in 1055us (1487us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440287.763154:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 136 00000100:00100000:3.0:1787440287.802543:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440287.802590:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440287.802619:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440287.802732:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:1.0:1787440287.802838:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681309568 00000100:00100000:1.0:1787440287.802850:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681309568 00000100:00100000:1.0:1787440287.802932:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 147 00000100:00100000:1.0:1787440287.802943:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee077ec1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+14:2363:x1874266681309568:12345-192.168.206.58@tcp:400:kworker.0 00000100:00100000:1.0:1787440287.803037:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee077ec1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+14:2363:x1874266681309568:12345-192.168.206.58@tcp:400:kworker.0 Request processed in 96us (545us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440287.803046:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 147 00000100:00100000:0.0:1787440287.803197:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681309824 00000100:00100000:0.0:1787440287.803219:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681309824 00000100:00100000:0.0:1787440287.803266:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681309696 00000100:00100000:0.0:1787440287.803269:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681309696 00000100:00100000:0.0:1787440287.803292:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 84 00000100:00100000:0.0:1787440287.803300:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee077ec3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+6:2363:x1874266681309824:12345-192.168.206.58@tcp:400:kworker.0 00000100:00100000:0.0:1787440287.803333:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee077ec3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+6:2363:x1874266681309824:12345-192.168.206.58@tcp:400:kworker.0 Request processed in 35us (743us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440287.803339:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 84 00000100:00100000:0.0:1787440287.803353:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 85 00000100:00100000:0.0:1787440287.803359:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee077ec3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+5:2363:x1874266681309696:12345-192.168.206.58@tcp:400:kworker.0 00000100:00100000:0.0:1787440287.803382:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee077ec3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+5:2363:x1874266681309696:12345-192.168.206.58@tcp:400:kworker.0 Request processed in 24us (723us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440287.803388:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 85 00000100:00100000:2.0:1787440287.803462:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681309440 00000100:00100000:2.0:1787440287.803466:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681309440 00000100:00100000:2.0:1787440287.803532:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 294 00000100:00100000:2.0:1787440287.803540:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04a699c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+13:2363:x1874266681309440:12345-192.168.206.58@tcp:400:kworker.0 00000100:00100000:2.0:1787440287.803570:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04a699c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+13:2363:x1874266681309440:12345-192.168.206.58@tcp:400:kworker.0 Request processed in 32us (951us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440287.803575:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 294 00000100:00080000:3.0:1787440287.803943:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787440287.803949:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787440287.803952:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787440287.837343:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787440288.159414:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee04a732680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1874266701242112:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787440288.159487:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440288.159888:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701242112 00000100:00100000:0.0:1787440288.159896:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701242112 00000100:00100000:0.0:1787440288.159958:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787440288.159967:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee05fc06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874266701242112:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787440288.159998:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787440288.160054:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee05fc06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874266701242112:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (567us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440288.160061:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787440288.160103:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee04a732680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1874266701242112:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787440288.160340:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:1.0:1787440288.225412:0:5871:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00000020:00080000:1.0:1787440288.225734:0:5871:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:3.0:1787440288.225916:0:5882:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:3.0:1787440288.225964:0:5882:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:0.0:1787440288.860758:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787440289.183083:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee04a731880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1874266701242496:0@lo:400:kworker.0 00000100:00100000:3.0:1787440289.183188:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440289.183274:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701242496 00000100:00100000:3.0:1787440289.183281:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701242496 00000100:00100000:3.0:1787440289.183338:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1787440289.183348:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee0773ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874266701242496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440289.183397:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee0773ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874266701242496:12345-0@lo:400:kworker.0 Request processed in 51us (209us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440289.183403:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00080000:3.0:1787440289.183423:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787440289.183448:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee04a731880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1874266701242496:0@lo:400:kworker.0 00000100:00100000:2.0:1787440289.183681:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee04a732680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:168176ea-29d1-49de-a254-317e90d54802:3309:1874266701242240:0@lo:400:kworker.0 00000100:00100000:2.0:1787440289.183716:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440289.183756:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee04a732a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1874266701242752:0@lo:400:kworker.0 00000100:00100000:2.0:1787440289.183778:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440289.183810:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787440289.183816:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee04a733100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874266701242368:0@lo:400:kworker.0 00000100:00100000:2.0:1787440289.183838:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440289.183855:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee050358700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874266701242880:0@lo:400:kworker.0 00000100:00100000:2.0:1787440289.183880:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440289.183907:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701242752 00000100:00100000:2.0:1787440289.183912:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701242752 00000100:00100000:2.0:1787440289.183942:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701242368 00000100:00100000:2.0:1787440289.183945:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701242368 00000100:00100000:2.0:1787440289.183960:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1787440289.183966:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee05fc06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1874266701242752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787440289.184013:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee05fc06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1874266701242752:12345-0@lo:400:kworker.0 Request processed in 47us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440289.184019:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1787440289.184034:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1787440289.184040:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee05fc04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874266701242368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787440289.184063:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee05fc04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874266701242368:12345-0@lo:400:kworker.0 Request processed in 24us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440289.184068:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1787440289.184090:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701242880 00000100:00100000:2.0:1787440289.184094:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701242880 00000100:00100000:2.0:1787440289.184133:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1787440289.184140:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee047a22d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1874266701242880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787440289.184390:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee047a22d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1874266701242880:12345-0@lo:400:kworker.0 Request processed in 251us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440289.184396:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:2.0:1787440289.184413:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787440289.184423:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787440289.184447:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee04a733100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874266701242368:0@lo:400:kworker.0 00000100:00100000:2.0:1787440289.184455:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee050358700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874266701242880:0@lo:400:kworker.0 00000100:00100000:2.0:1787440289.184462:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee04a732a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1874266701242752:0@lo:400:kworker.0 00000100:00100000:0.0:1787440289.184705:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee04a730e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1874266701242624:0@lo:400:kworker.0 00000100:00100000:0.0:1787440289.184750:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440289.184880:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701242240 00000100:00100000:3.0:1787440289.184884:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701242240 00000100:00100000:3.0:1787440289.184921:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:3.0:1787440289.184933:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee06d273450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:168176ea-29d1-49de-a254-317e90d54802+19:3309:x1874266701242240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440289.184985:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee06d273450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:168176ea-29d1-49de-a254-317e90d54802+19:3309:x1874266701242240:12345-0@lo:400:kworker.0 Request processed in 45us (1261us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440289.184991:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:1.0:1787440289.185179:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee04a732680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:168176ea-29d1-49de-a254-317e90d54802:3309:1874266701242240:0@lo:400:kworker.0 00000100:00100000:2.0:1787440289.185350:0:12016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701242624 00000100:00100000:2.0:1787440289.185355:0:12016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701242624 00000100:00100000:2.0:1787440289.185390:0:12016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1787440289.185397:0:12016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee05035a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3312:x1874266701242624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787440289.185444:0:12016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee05035a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3312:x1874266701242624:12345-0@lo:400:kworker.0 Request processed in 48us (694us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440289.185450:0:12016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1787440289.185554:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee04a730e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1874266701242624:0@lo:400:kworker.0 00000100:00100000:1.0:1787440289.693055:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787440289.693089:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee0773fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1874266701243008:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787440289.693165:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440289.693488:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701243008 00000100:00100000:3.0:1787440289.693514:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701243008 00000100:00100000:3.0:1787440289.693566:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787440289.693575:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee07f9f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874266701243008:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787440289.693608:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787440289.693661:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee07f9f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874266701243008:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (496us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440289.693668:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787440289.694026:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee0773fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1874266701243008:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787440289.884692:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787440290.908845:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787440291.743033:0:12306:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 19:11:30 (1787440290) 00010000:00010000:3.0:1787440291.932649:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787440292.934543:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440292.934581:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440292.934613:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440292.934628:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681309952 00000100:00100000:0.0:1787440292.934637:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681309952 00000100:00100000:3.0:1787440292.934642:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440292.934662:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440292.934685:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 296 00000100:00100000:0.0:1787440292.934705:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee06d270c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+13:2362:x1874266681309952:12345-192.168.206.58@tcp:400:kworker.0 00000100:00100000:0.0:1787440292.934877:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee06d270c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+13:2362:x1874266681309952:12345-192.168.206.58@tcp:400:kworker.0 Request processed in 182us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440292.934886:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 296 00000100:00100000:1.0:1787440292.936947:0:9225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681310208 00000100:00100000:1.0:1787440292.936961:0:9225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681310208 00000100:00100000:1.0:1787440292.937034:0:9225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681310336 00000100:00100000:1.0:1787440292.937038:0:9225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681310336 00000100:00100000:1.0:1787440292.937066:0:9225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 88 00000100:00100000:1.0:1787440292.937076:0:9225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee0773fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+5:2362:x1874266681310208:12345-192.168.206.58@tcp:400:kworker.0 00000100:00100000:1.0:1787440292.937165:0:9225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee0773fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+5:2362:x1874266681310208:12345-192.168.206.58@tcp:400:kworker.0 Request processed in 89us (2582us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440292.937172:0:9225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 88 00000100:00100000:1.0:1787440292.937188:0:9225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 89 00000100:00100000:1.0:1787440292.937194:0:9225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee0773fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+6:2362:x1874266681310336:12345-192.168.206.58@tcp:400:kworker.0 00000100:00100000:1.0:1787440292.937219:0:9225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee0773fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+6:2362:x1874266681310336:12345-192.168.206.58@tcp:400:kworker.0 Request processed in 26us (2555us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440292.937225:0:9225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 89 00000100:00080000:3.0:1787440292.937226:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787440292.937230:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787440292.938600:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681310464 00000100:00100000:2.0:1787440292.938611:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681310464 00000100:00100000:2.0:1787440292.938676:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681310080 00000100:00100000:2.0:1787440292.938679:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681310080 00000100:00100000:2.0:1787440292.938716:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 151 00000100:00100000:2.0:1787440292.938725:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee0773fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fde7b340-91f7-42a0-a1a3-5665ea2691c9+6:2362:x1874266681310464:12345-192.168.206.58@tcp:400:kworker.0 00000100:00100000:2.0:1787440292.938797:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee0773fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fde7b340-91f7-42a0-a1a3-5665ea2691c9+6:2362:x1874266681310464:12345-192.168.206.58@tcp:400:kworker.0 Request processed in 73us (4183us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440292.938804:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 151 00000100:00100000:2.0:1787440292.938819:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 152 00000100:00100000:2.0:1787440292.938826:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee0773fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+13:2362:x1874266681310080:12345-192.168.206.58@tcp:400:kworker.0 00000100:00100000:2.0:1787440292.938869:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee0773fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+13:2362:x1874266681310080:12345-192.168.206.58@tcp:400:kworker.0 Request processed in 44us (4226us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440292.938875:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 152 00000100:00080000:2.0:1787440292.940590:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787440292.958004:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787440293.278254:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787440293.278275:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee0773ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874266701243136:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787440293.278345:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440293.278415:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701243136 00000100:00100000:3.0:1787440293.278422:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701243136 00000100:00100000:3.0:1787440293.278487:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787440293.278523:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee080df2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874266701243136:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787440293.278556:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787440293.278606:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee080df2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874266701243136:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440293.278613:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787440293.278821:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee0773ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874266701243136:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787440293.279192:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787440293.472446:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:2.0:1787440293.475153:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681310720 00000100:00100000:2.0:1787440293.475168:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681310720 00000100:00100000:2.0:1787440293.475257:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 137 00000100:00100000:2.0:1787440293.475268:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee0773ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+13:11307:x1874266681310720:12345-192.168.206.58@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787440293.475288:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440293.475307:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e600/0x85f5fa77adf3cbd7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fab14535dc62336 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440293.475376:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e400/0x85f5fa77adf3cbde lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440293.475537:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e400/0x85f5fa77adf3cbde lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440293.475551:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e400/0x85f5fa77adf3cbde lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440293.475587:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f000/0x85f5fa77adf3cbe5 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440293.475596:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f000/0x85f5fa77adf3cbe5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440293.475602:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f000/0x85f5fa77adf3cbe5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440293.476627:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86fc00/0x85f5fa77adf3cbec lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440293.476640:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86fc00/0x85f5fa77adf3cbec lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440293.476649:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86fc00/0x85f5fa77adf3cbec lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787440293.476661:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:2.0:1787440293.477134:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e400/0x85f5fa77adf3cbde lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440293.477143:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e400/0x85f5fa77adf3cbde lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440293.477149:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e400/0x85f5fa77adf3cbde lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440293.477154:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee07f86e400 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:2.0:1787440293.477159:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e400/0x85f5fa77adf3cbde lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440293.477167:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e400/0x85f5fa77adf3cbde lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440293.477179:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8ee0460ccf00) 00010000:00010000:2.0:1787440293.477182:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440293.477187:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e400/0x85f5fa77adf3cbde lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440293.477203:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e400/0x85f5fa77adf3cbde lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440293.477218:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f000/0x85f5fa77adf3cbe5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440293.477237:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f000/0x85f5fa77adf3cbe5 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440293.477242:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f000/0x85f5fa77adf3cbe5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440293.477248:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee07f86f000 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:2.0:1787440293.477251:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f000/0x85f5fa77adf3cbe5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440293.477257:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f000/0x85f5fa77adf3cbe5 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440293.477264:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8ee054b3c400) 00010000:00010000:2.0:1787440293.477267:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440293.477270:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f000/0x85f5fa77adf3cbe5 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440293.477276:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f000/0x85f5fa77adf3cbe5 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440293.479047:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e600/0x85f5fa77adf3cbd7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62336 expref: 16 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440293.479070:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86fc00/0x85f5fa77adf3cbec lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62336 expref: 15 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440293.479086:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ee05132e100) 00010000:00010000:2.0:1787440293.479100:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440293.479104:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee07f86fc00, rc 0) 00000100:00100000:2.0:1787440293.479178:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee0773ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+15:11307:x1874266681310720:12345-192.168.206.58@tcp:101:lhsmtool_posix.0 Request processed in 3912us (6739us total) trans 4294967416 rc 0/0 00000100:00100000:2.0:1787440293.479186:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 137 00000100:00100000:2.0:1787440293.483635:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:1.0:1787440293.483834:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681310976 00000100:00100000:1.0:1787440293.483845:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681310976 00000100:00100000:1.0:1787440293.483901:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 138 00000100:00100000:1.0:1787440293.483911:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee047a21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+15:11307:x1874266681310976:12345-192.168.206.58@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1787440293.484024:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee047a21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+15:11307:x1874266681310976:12345-192.168.206.58@tcp:59:lhsmtool_posix.0 Request processed in 114us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440293.484033:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 138 00000100:00100000:1.0:1787440293.493721:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:2.0:1787440293.493782:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681310848 00000100:00100000:2.0:1787440293.493808:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681310848 00000100:00100000:2.0:1787440293.493872:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 9 00000100:00100000:2.0:1787440293.493883:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee07f9f3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+15:2363:x1874266681310848:12345-192.168.206.58@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787440293.493897:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787440293.493922:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86fc00/0x85f5fa77adf3cbec lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62336 expref: 15 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440293.493940:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ee05132e100) 00010000:00010000:2.0:1787440293.493944:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787440293.493994:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee07f9f3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+14:2363:x1874266681310848:12345-192.168.206.58@tcp:103:ldlm_bl.0 Request processed in 114us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440293.494001:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 9 00010000:00010000:3.0:1787440293.981144:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787440294.300866:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee0773fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:168176ea-29d1-49de-a254-317e90d54802:3309:1874266701243264:0@lo:400:kworker.0 00000100:00100000:1.0:1787440294.300957:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440294.301022:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee0773fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1874266701243776:0@lo:400:kworker.0 00000100:00100000:1.0:1787440294.301051:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440294.301075:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1787440294.301081:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee0773fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874266701243392:0@lo:400:kworker.0 00000100:00100000:1.0:1787440294.301114:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440294.301139:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee0773ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874266701243904:0@lo:400:kworker.0 00000100:00100000:1.0:1787440294.301164:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440294.301194:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701243904 00000100:00100000:1.0:1787440294.301201:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701243904 00000100:00100000:1.0:1787440294.301250:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1787440294.301258:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee07f9f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1874266701243904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440294.301305:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee07f9f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1874266701243904:12345-0@lo:400:kworker.0 Request processed in 47us (140us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440294.301312:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1787440294.301353:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee0773ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874266701243904:0@lo:400:kworker.0 00000100:00100000:0.0:1787440294.301472:0:6892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701243776 00000100:00100000:0.0:1787440294.301477:0:6892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701243776 00000100:00100000:0.0:1787440294.301534:0:6892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701243392 00000100:00100000:0.0:1787440294.301538:0:6892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701243392 00000100:00100000:0.0:1787440294.301557:0:6892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1787440294.301564:0:6892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee07f9f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1874266701243776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787440294.301607:0:6892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee07f9f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1874266701243776:12345-0@lo:400:kworker.0 Request processed in 43us (554us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440294.301613:0:6892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1787440294.301626:0:6892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1787440294.301632:0:6892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee07f9f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874266701243392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787440294.301658:0:6892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee07f9f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874266701243392:12345-0@lo:400:kworker.0 Request processed in 27us (544us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440294.301663:0:6892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1787440294.301692:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee0773fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874266701243392:0@lo:400:kworker.0 00000100:00100000:0.0:1787440294.301701:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee0773fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1874266701243776:0@lo:400:kworker.0 00000100:00100000:3.0:1787440294.301780:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701243264 00000100:00100000:3.0:1787440294.301785:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701243264 00000100:00100000:3.0:1787440294.301822:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:3.0:1787440294.301829:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee06d271c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:168176ea-29d1-49de-a254-317e90d54802+19:3309:x1874266701243264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440294.301865:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee06d271c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:168176ea-29d1-49de-a254-317e90d54802+19:3309:x1874266701243264:12345-0@lo:400:kworker.0 Request processed in 37us (909us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440294.301871:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:0.0:1787440294.301950:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee0773fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:168176ea-29d1-49de-a254-317e90d54802:3309:1874266701243264:0@lo:400:kworker.0 00000100:00100000:2.0:1787440294.302063:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee0773fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1874266701243520:0@lo:400:kworker.0 00000100:00100000:2.0:1787440294.302105:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440294.302141:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787440294.302147:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee0773fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874266701243648:0@lo:400:kworker.0 00000100:00100000:2.0:1787440294.302180:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440294.302218:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701243520 00000100:00100000:2.0:1787440294.302222:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701243520 00000100:00100000:2.0:1787440294.302248:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1787440294.302254:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee047a20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874266701243520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787440294.302287:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee047a20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874266701243520:12345-0@lo:400:kworker.0 Request processed in 33us (181us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440294.302293:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00080000:2.0:1787440294.302308:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787440294.302312:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787440294.302336:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee0773fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1874266701243520:0@lo:400:kworker.0 00000100:00100000:3.0:1787440294.302422:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701243648 00000100:00100000:3.0:1787440294.302426:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701243648 00000100:00100000:3.0:1787440294.302452:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1787440294.302458:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee047a23100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1874266701243648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440294.302488:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee047a23100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1874266701243648:12345-0@lo:400:kworker.0 Request processed in 31us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440294.302509:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1787440294.302651:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee0773fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874266701243648:0@lo:400:kworker.0 00000040:00080000:1.0:1787440294.364710:0:11682:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787440294.364718:0:11682:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787440294.364752:0:11682:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:1.0:1787440294.364758:0:11682:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787440294.812773:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787440294.812797:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee0773fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1874266701244032:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787440294.812868:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440294.813056:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701244032 00000100:00100000:3.0:1787440294.813063:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701244032 00000100:00100000:3.0:1787440294.813130:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787440294.813139:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee07f9f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874266701244032:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787440294.813181:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787440294.813230:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee07f9f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874266701244032:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440294.813237:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787440294.813314:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee0773fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1874266701244032:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787440295.006119:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787440295.869251:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440295.869772:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681311104 00000100:00100000:0.0:1787440295.869782:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681311104 00000100:00100000:0.0:1787440295.869851:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 139 00000100:00100000:0.0:1787440295.869862:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee0773fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+14:11350:x1874266681311104:12345-192.168.206.58@tcp:101:lfs.0 00010000:00010000:0.0:1787440295.869882:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440295.869904:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce200/0x85f5fa77adf3cbfa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fab14535dc6233d expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440295.869964:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce600/0x85f5fa77adf3cc01 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440295.869978:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce600/0x85f5fa77adf3cc01 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440295.869990:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce600/0x85f5fa77adf3cc01 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440295.870006:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcec00/0x85f5fa77adf3cc08 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440295.870013:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcec00/0x85f5fa77adf3cc08 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440295.870020:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcec00/0x85f5fa77adf3cc08 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440295.870347:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce600/0x85f5fa77adf3cc01 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440295.870355:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce600/0x85f5fa77adf3cc01 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440295.870371:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce600/0x85f5fa77adf3cc01 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440295.870377:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee04cbce600 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:0.0:1787440295.870381:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce600/0x85f5fa77adf3cc01 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440295.870388:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce600/0x85f5fa77adf3cc01 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440295.870401:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ee054b3c600) 00010000:00010000:0.0:1787440295.870404:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440295.870409:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce600/0x85f5fa77adf3cc01 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440295.870414:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce600/0x85f5fa77adf3cc01 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440295.870425:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcec00/0x85f5fa77adf3cc08 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440295.870432:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcec00/0x85f5fa77adf3cc08 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440295.870438:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcec00/0x85f5fa77adf3cc08 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440295.870442:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee04cbcec00 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:0.0:1787440295.870445:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcec00/0x85f5fa77adf3cc08 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440295.870461:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcec00/0x85f5fa77adf3cc08 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440295.870469:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8ee050ca1600) 00010000:00010000:0.0:1787440295.870472:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440295.870475:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcec00/0x85f5fa77adf3cc08 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440295.870480:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcec00/0x85f5fa77adf3cc08 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440295.870537:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce200/0x85f5fa77adf3cbfa lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6233d expref: 15 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440295.870548:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ee054b3c600) 00010000:00010000:0.0:1787440295.870551:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440295.870554:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce200/0x85f5fa77adf3cbfa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6233d expref: 15 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440295.870564:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee04cbce200, rc 0) 00000100:00100000:0.0:1787440295.870621:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee0773fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+14:11350:x1874266681311104:12345-192.168.206.58@tcp:101:lfs.0 Request processed in 762us (1380us total) trans 0 rc 301/301 00000100:00100000:0.0:1787440295.870629:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 139 00000100:00080000:1.0:1787440295.872110:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787440295.877618:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:1.0:1787440295.877749:0:6892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681311360 00000100:00100000:1.0:1787440295.877760:0:6892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681311360 00000100:00100000:1.0:1787440295.877823:0:6892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 140 00000100:00100000:1.0:1787440295.877833:0:6892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee050358700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+14:11350:x1874266681311360:12345-192.168.206.58@tcp:36:lfs.0 00010000:00010000:1.0:1787440295.877893:0:6892:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787440295.877919:0:6892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86ee00/0x85f5fa77adf3c578 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62176 expref: 14 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440295.877937:0:6892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ee054b3c600) 00010000:00010000:1.0:1787440295.877942:0:6892:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787440295.878253:0:6892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9ea00/0x85f5fa77adf3cc0f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440295.878268:0:6892:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfe00/0x85f5fa77adf3cbd0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6232f expref: 5 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440295.878277:0:6892:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9ea00/0x85f5fa77adf3cc0f lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440295.878311:0:6892:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfe00/0x85f5fa77adf3cbd0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6232f expref: 5 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440295.878325:0:6892:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfe00/0x85f5fa77adf3cbd0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6232f expref: 5 pid: 5849 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440295.878340:0:6892:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee07f9f2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6892:1874266701244160:192.168.206.58@tcp:104: 00000100:00100000:1.0:1787440295.878436:0:6892:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee047c02000 going to sleep for 11 seconds 00000100:00100000:1.0:1787440295.881413:0:6892:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee07f9f2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6892:1874266701244160:192.168.206.58@tcp:104: 00010000:00010000:1.0:1787440295.881467:0:6892:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9ea00/0x85f5fa77adf3cc0f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440295.882850:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:1.0:1787440295.883069:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681311488 00000100:00100000:1.0:1787440295.883086:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681311488 00010000:00010000:1.0:1787440295.883144:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfe00/0x85f5fa77adf3cbd0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6232f expref: 6 pid: 5849 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440295.883184:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 62 00000100:00100000:1.0:1787440295.883194:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee080b04700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fde7b340-91f7-42a0-a1a3-5665ea2691c9+6:2363:x1874266681311488:12345-192.168.206.58@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787440295.883208:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787440295.883214:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfe00/0x85f5fa77adf3cbd0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6232f expref: 6 pid: 5849 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440295.883227:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfe00/0x85f5fa77adf3cbd0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6232f expref: 6 pid: 5849 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440295.883248:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfe00/0x85f5fa77adf3cbd0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6232f expref: 6 pid: 5849 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440295.883262:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ee054b3c600) 00010000:00010000:1.0:1787440295.883268:0:5835:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9ea00/0x85f5fa77adf3cc0f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440295.883276:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9ea00/0x85f5fa77adf3cc0f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440295.883284:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9ea00/0x85f5fa77adf3cc0f lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440295.883323:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787440295.883369:0:6892:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9ea00/0x85f5fa77adf3cc0f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440295.883375:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee080b04700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fde7b340-91f7-42a0-a1a3-5665ea2691c9+5:2363:x1874266681311488:12345-192.168.206.58@tcp:103:ldlm_bl.0 Request processed in 181us (530us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440295.883387:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 62 00010000:00010000:0.0:1787440295.883397:0:6892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9ea00/0x85f5fa77adf3cc0f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440295.883421:0:6892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce200/0x85f5fa77adf3cc16 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440295.883432:0:6892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce200/0x85f5fa77adf3cc16 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440295.883441:0:6892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce200/0x85f5fa77adf3cc16 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1787440295.883471:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00200000:0.0:1787440295.884890:0:6892:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:0.0:1787440295.884905:0:6892:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9ea00/0x85f5fa77adf3cc0f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440295.885259:0:6892:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9ea00/0x85f5fa77adf3cc0f lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440295.885269:0:6892:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9ea00/0x85f5fa77adf3cc0f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440295.885275:0:6892:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee07fb9ea00 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:0.0:1787440295.885280:0:6892:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9ea00/0x85f5fa77adf3cc0f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440295.885338:0:6892:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9ea00/0x85f5fa77adf3cc0f lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440295.885355:0:6892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ee054b3c600) 00010000:00010000:0.0:1787440295.885358:0:6892:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440295.885369:0:6892:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9ea00/0x85f5fa77adf3cc0f lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440295.885376:0:6892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9ea00/0x85f5fa77adf3cc0f lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787440295.885394:0:6892:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bbfe7fa2 reply state 00000000744102e8 transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce200/0x85f5fa77adf3cc16 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440295.885404:0:6892:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787440295.885525:0:6892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee050358700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+15:11350:x1874266681311360:12345-192.168.206.58@tcp:36:lfs.0 Request processed in 7689us (7913us total) trans 4294967417 rc 0/0 00000100:00100000:0.0:1787440295.885535:0:6892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 140 00010000:00010000:1.0:1787440295.892971:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce200/0x85f5fa77adf3cc16 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440295.892988:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce200/0x85f5fa77adf3cc16 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440295.892997:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce200/0x85f5fa77adf3cc16 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440295.893004:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee04cbce200 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:1.0:1787440295.893009:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce200/0x85f5fa77adf3cc16 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440295.893017:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce200/0x85f5fa77adf3cc16 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440295.893047:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8ee050ca1600) 00010000:00010000:1.0:1787440295.893050:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440295.893055:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce200/0x85f5fa77adf3cc16 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440295.893062:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce200/0x85f5fa77adf3cc16 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440295.973054:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:2.0:1787440295.973898:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681311616 00000100:00100000:2.0:1787440295.973908:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681311616 00000100:00100000:2.0:1787440295.974424:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 141 00000100:00100000:2.0:1787440295.974436:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee047a21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+14:11358:x1874266681311616:12345-192.168.206.58@tcp:101:lctl.0 00010000:00010000:2.0:1787440295.974461:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440295.974483:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f000/0x85f5fa77adf3cc1d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fab14535dc62344 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440295.974585:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e600/0x85f5fa77adf3cc24 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440295.974599:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e600/0x85f5fa77adf3cc24 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440295.974622:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e600/0x85f5fa77adf3cc24 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787440295.974694:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1787440295.974698:0:5851:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:2.0:1787440295.974727:0:5851:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e600/0x85f5fa77adf3cc24 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440295.974753:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f000/0x85f5fa77adf3cc1d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62344 expref: 16 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440295.974782:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e600/0x85f5fa77adf3cc24 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62344 expref: 15 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440295.974791:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ee054b3cb00) 00010000:00010000:2.0:1787440295.974795:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787440295.974799:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee07f86e600, rc 0) 00000100:00100000:2.0:1787440295.974863:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee047a21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+15:11358:x1874266681311616:12345-192.168.206.58@tcp:101:lctl.0 Request processed in 430us (1816us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440295.974870:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 141 00010000:00010000:3.0:1787440296.028775:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787440296.051340:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:1.0:1787440296.051682:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681311744 00000100:00100000:1.0:1787440296.051691:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681311744 00000100:00100000:1.0:1787440296.051758:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 142 00000100:00100000:1.0:1787440296.051777:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee080b07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+15:11364:x1874266681311744:12345-192.168.206.58@tcp:101:bash.0 00010000:00010000:1.0:1787440296.051796:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440296.051816:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e800/0x85f5fa77adf3cc2b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fab14535dc6234b expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440296.051872:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f200/0x85f5fa77adf3cc32 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440296.051886:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f200/0x85f5fa77adf3cc32 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440296.051896:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f200/0x85f5fa77adf3cc32 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440296.051910:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9ee00/0x85f5fa77adf3cc39 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440296.051917:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9ee00/0x85f5fa77adf3cc39 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440296.051923:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9ee00/0x85f5fa77adf3cc39 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440296.052037:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e600/0x85f5fa77adf3cc40 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440296.052046:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e600/0x85f5fa77adf3cc40 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440296.052053:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e600/0x85f5fa77adf3cc40 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787440296.052104:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:1.0:1787440296.052109:0:5849:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787440296.052130:0:5849:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e600/0x85f5fa77adf3cc40 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440296.052141:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f200/0x85f5fa77adf3cc32 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440296.052148:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f200/0x85f5fa77adf3cc32 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440296.052155:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f200/0x85f5fa77adf3cc32 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440296.052161:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee07fb9f200 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:1.0:1787440296.052165:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f200/0x85f5fa77adf3cc32 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440296.052173:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f200/0x85f5fa77adf3cc32 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440296.052184:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ee054b3cb00) 00010000:00010000:1.0:1787440296.052187:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440296.052191:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f200/0x85f5fa77adf3cc32 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440296.052197:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f200/0x85f5fa77adf3cc32 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440296.052209:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9ee00/0x85f5fa77adf3cc39 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440296.052225:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9ee00/0x85f5fa77adf3cc39 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440296.052231:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9ee00/0x85f5fa77adf3cc39 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440296.052236:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee07fb9ee00 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:1.0:1787440296.052239:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9ee00/0x85f5fa77adf3cc39 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440296.052244:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9ee00/0x85f5fa77adf3cc39 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440296.052252:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8ee05132e700) 00010000:00010000:1.0:1787440296.052254:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440296.052257:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9ee00/0x85f5fa77adf3cc39 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440296.052262:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9ee00/0x85f5fa77adf3cc39 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440296.052292:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e800/0x85f5fa77adf3cc2b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6234b expref: 17 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440296.052305:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e600/0x85f5fa77adf3cc40 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6234b expref: 16 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440296.052312:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8ee05132ea00) 00010000:00010000:1.0:1787440296.052314:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1787440296.052322:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee07fb9e600, rc 0) 00000100:00100000:1.0:1787440296.052389:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee080b07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+16:11364:x1874266681311744:12345-192.168.206.58@tcp:101:bash.0 Request processed in 614us (1057us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440296.052396:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 142 00000100:00100000:1.0:1787440296.056782:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:2.0:1787440296.056901:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681312000 00000100:00100000:2.0:1787440296.056911:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681312000 00000100:00100000:2.0:1787440296.056981:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 143 00000100:00100000:2.0:1787440296.056991:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee07f9f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+16:11364:x1874266681312000:12345-192.168.206.58@tcp:101:bash.0 00010000:00010000:2.0:1787440296.057010:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440296.057032:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86fc00/0x85f5fa77adf3cc47 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fab14535dc62352 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440296.057326:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e200/0x85f5fa77adf3cc4e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440296.057341:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e200/0x85f5fa77adf3cc4e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440296.057352:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e200/0x85f5fa77adf3cc4e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440296.057408:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f000/0x85f5fa77adf3cc55 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440296.057418:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f000/0x85f5fa77adf3cc55 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440296.057425:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f000/0x85f5fa77adf3cc55 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787440296.058721:0:5851:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:2.0:1787440296.059066:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e400/0x85f5fa77adf3cc5c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440296.059162:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e400/0x85f5fa77adf3cc5c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440296.059175:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e400/0x85f5fa77adf3cc5c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440296.059215:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e200/0x85f5fa77adf3cc4e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440296.059234:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e200/0x85f5fa77adf3cc4e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440296.059241:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e200/0x85f5fa77adf3cc4e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440296.059247:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee07f86e200 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:2.0:1787440296.059251:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e200/0x85f5fa77adf3cc4e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440296.059258:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e200/0x85f5fa77adf3cc4e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440296.059272:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8ee05132ea00) 00010000:00010000:2.0:1787440296.059275:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440296.059279:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e200/0x85f5fa77adf3cc4e lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440296.059285:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e200/0x85f5fa77adf3cc4e lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787440296.059300:0:5851:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c7a3d210 reply state 000000005d7a0d8d transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f000/0x85f5fa77adf3cc55 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440296.059309:0:5851:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787440296.059343:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86fc00/0x85f5fa77adf3cc47 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62352 expref: 19 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440296.059357:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e400/0x85f5fa77adf3cc5c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62352 expref: 18 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440296.059374:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ee054b3cd00) 00010000:00010000:2.0:1787440296.059376:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787440296.059615:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee07f86e400, rc 0) 00000100:00100000:2.0:1787440296.059754:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee07f9f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+19:11364:x1874266681312000:12345-192.168.206.58@tcp:101:bash.0 Request processed in 2762us (2990us total) trans 4294967418 rc 0/0 00000100:00100000:2.0:1787440296.059762:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 143 00010000:00010000:3.0:1787440296.062117:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f000/0x85f5fa77adf3cc55 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440296.062132:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f000/0x85f5fa77adf3cc55 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440296.062141:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f000/0x85f5fa77adf3cc55 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440296.062146:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee07f86f000 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:3.0:1787440296.062151:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f000/0x85f5fa77adf3cc55 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440296.062159:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f000/0x85f5fa77adf3cc55 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440296.062174:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8ee054b3c800) 00010000:00010000:3.0:1787440296.062177:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440296.062181:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f000/0x85f5fa77adf3cc55 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440296.062186:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f000/0x85f5fa77adf3cc55 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440296.064792:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:2.0:1787440296.064868:0:12016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681312128 00000100:00100000:2.0:1787440296.064877:0:12016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681312128 00000100:00100000:2.0:1787440296.064966:0:12016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 47 00000100:00100000:2.0:1787440296.064978:0:12016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee07f9f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+5:2363:x1874266681312128:12345-192.168.206.58@tcp:101:bash.0 00010000:00010000:2.0:1787440296.064995:0:12016:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440296.065016:0:12016:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e1e0d9b4/0x85f5fa77adf3cc6a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5fab14535dc62359 expref: -99 pid: 12016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787440296.065044:0:12016:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787440296.065063:0:12016:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=394s v=(0 0) 00010000:00010000:2.0:1787440296.065214:0:12016:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787440296.065227:0:12016:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e1e0d9b4/0x85f5fa77adf3cc6a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62359 expref: 6 pid: 12016 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440296.065250:0:12016:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e1e0d9b4/0x85f5fa77adf3cc6a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62359 expref: 6 pid: 12016 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440296.065264:0:12016:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee07f86ee00, rc 0) 00000100:00100000:2.0:1787440296.065330:0:12016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee07f9f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+6:2363:x1874266681312128:12345-192.168.206.58@tcp:101:bash.0 Request processed in 355us (545us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440296.065350:0:12016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 47 00000100:00080000:1.0:1787440296.065656:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787440296.068556:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:1.0:1787440296.068776:0:9225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681312256 00000100:00100000:1.0:1787440296.068785:0:9225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681312256 00000100:00100000:1.0:1787440296.068840:0:9225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 48 00000100:00100000:1.0:1787440296.068850:0:9225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee05fcdf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+6:11364:x1874266681312256:12345-192.168.206.58@tcp:101:bash.0 00010000:00010000:1.0:1787440296.068868:0:9225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440296.068887:0:9225:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001a91b948/0x85f5fa77adf3cc71 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5fab14535dc62360 expref: -99 pid: 9225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440296.068929:0:9225:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e1e0d9b4/0x85f5fa77adf3cc6a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62359 expref: 7 pid: 12016 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440296.068939:0:9225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787440296.068943:0:9225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787440296.068949:0:9225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001a91b948/0x85f5fa77adf3cc71 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62360 expref: 7 pid: 9225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440296.068981:0:9225:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e1e0d9b4/0x85f5fa77adf3cc6a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62359 expref: 7 pid: 12016 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440296.068995:0:9225:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e1e0d9b4/0x85f5fa77adf3cc6a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62359 expref: 7 pid: 12016 timeout: 494 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440296.069019:0:9225:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee07f9f1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9225:1874266701244288:192.168.206.58@tcp:104: 00000100:00100000:1.0:1787440296.069334:0:9225:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee047c02000 going to sleep for 11 seconds 00000100:00100000:0.0:1787440296.073902:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440296.074017:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681312384 00000100:00100000:3.0:1787440296.074047:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681312384 00010000:00010000:3.0:1787440296.074096:0:6711:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e1e0d9b4/0x85f5fa77adf3cc6a lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62359 expref: 8 pid: 12016 timeout: 494 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440296.074138:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 63 00000100:00100000:3.0:1787440296.074149:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee080b04380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+8:2362:x1874266681312384:12345-192.168.206.58@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787440296.074163:0:6711:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787440296.074188:0:6711:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e1e0d9b4/0x85f5fa77adf3cc6a lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62359 expref: 8 pid: 12016 timeout: 494 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440296.074210:0:9225:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee07f9f1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9225:1874266701244288:192.168.206.58@tcp:104: 00010000:00010000:3.0:1787440296.074211:0:6711:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e1e0d9b4/0x85f5fa77adf3cc6a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62359 expref: 8 pid: 12016 timeout: 494 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440296.074241:0:6711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e1e0d9b4/0x85f5fa77adf3cc6a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62359 expref: 8 pid: 12016 timeout: 494 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440296.074250:0:9225:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001a91b948/0x85f5fa77adf3cc71 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 5 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62360 expref: 8 pid: 9225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440296.074260:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787440296.074266:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787440296.074274:0:6711:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001a91b948/0x85f5fa77adf3cc71 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62360 expref: 7 pid: 9225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440296.074285:0:6711:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001a91b948/0x85f5fa77adf3cc71 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62360 expref: 7 pid: 9225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440296.074299:0:9225:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee07fb9e800, rc 0) 00010000:00010000:3.0:1787440296.074319:0:6711:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000001a91b948/0x85f5fa77adf3cc71 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62360 expref: 7 pid: 9225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440296.074345:0:6711:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee0773ff100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:6711:1874266701244416:192.168.206.58@tcp:105: 00000100:00100000:1.0:1787440296.074461:0:9225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee05fcdf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+7:11364:x1874266681312256:12345-192.168.206.58@tcp:101:bash.0 Request processed in 5611us (5912us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440296.074469:0:9225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 48 00000100:00100000:3.0:1787440296.075579:0:6711:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee047ed2a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787440296.078884:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440296.078920:0:6711:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee0773ff100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:6711:1874266701244416:192.168.206.58@tcp:105: 00010000:00010000:3.0:1787440296.078943:0:6711:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787440296.079002:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee080b04380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+6:2362:x1874266681312384:12345-192.168.206.58@tcp:103:ldlm_bl.0 Request processed in 4855us (5109us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440296.079012:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 63 00000100:00100000:0.0:1787440296.079039:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681312640 00000100:00100000:0.0:1787440296.079046:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681312640 00000100:00100000:0.0:1787440296.079117:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 36 00000100:00100000:0.0:1787440296.079127:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee05fcdc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+18:11364:x1874266681312640:12345-192.168.206.58@tcp:35:bash.0 00000100:00100000:0.0:1787440296.079437:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee05fcdc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+19:11364:x1874266681312640:12345-192.168.206.58@tcp:35:bash.0 Request processed in 311us (563us total) trans 4294967419 rc 0/0 00000100:00100000:0.0:1787440296.079445:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 36 00000100:00100000:2.0:1787440296.181467:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:1.0:1787440296.181861:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681312896 00000100:00100000:1.0:1787440296.181870:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681312896 00000100:00100000:1.0:1787440296.181926:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 144 00000100:00100000:1.0:1787440296.181935:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee05fcded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+19:11374:x1874266681312896:12345-192.168.206.58@tcp:101:lfs.0 00010000:00010000:1.0:1787440296.181958:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440296.181978:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fe00/0x85f5fa77adf3cc78 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fab14535dc62367 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787440296.182106:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:1.0:1787440296.182218:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fe00/0x85f5fa77adf3cc78 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62367 expref: 21 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440296.182233:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ee054b3cb00) 00010000:00010000:1.0:1787440296.182236:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787440296.182254:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fe00/0x85f5fa77adf3cc78 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62367 expref: 21 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440296.182269:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee07fb9fe00, rc 0) 00000100:00100000:1.0:1787440296.182336:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee05fcded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+20:11374:x1874266681312896:12345-192.168.206.58@tcp:101:lfs.0 Request processed in 402us (889us total) trans 4294967420 rc 301/301 00000100:00100000:1.0:1787440296.182344:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 144 00000100:00100000:1.0:1787440296.185576:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440296.185677:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681313152 00000100:00100000:0.0:1787440296.185687:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681313152 00000100:00100000:0.0:1787440296.185745:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 37 00000100:00100000:0.0:1787440296.185755:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee07f9f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+20:11374:x1874266681313152:12345-192.168.206.58@tcp:35:lfs.0 00000100:00100000:0.0:1787440296.186063:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee07f9f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+21:11374:x1874266681313152:12345-192.168.206.58@tcp:35:lfs.0 Request processed in 308us (493us total) trans 4294967421 rc 0/0 00000100:00100000:0.0:1787440296.186097:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 37 00000100:00100000:0.0:1787440296.285113:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:2.0:1787440296.285248:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681313280 00000100:00100000:2.0:1787440296.285261:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681313280 00000100:00100000:2.0:1787440296.285372:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 145 00000100:00100000:2.0:1787440296.285383:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee080b06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+21:11380:x1874266681313280:12345-192.168.206.58@tcp:101:lfs.0 00010000:00010000:2.0:1787440296.285416:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440296.285444:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86ec00/0x85f5fa77adf3cc86 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fab14535dc6236e expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440296.285587:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86ee00/0x85f5fa77adf3cc8d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440296.285605:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86ee00/0x85f5fa77adf3cc8d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440296.285619:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86ee00/0x85f5fa77adf3cc8d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787440296.285693:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:2.0:1787440296.285698:0:5850:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787440296.285725:0:5850:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86ee00/0x85f5fa77adf3cc8d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440296.285771:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86ec00/0x85f5fa77adf3cc86 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6236e expref: 23 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440296.285819:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86ee00/0x85f5fa77adf3cc8d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6236e expref: 22 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440296.285829:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8ee05132ea00) 00010000:00010000:2.0:1787440296.285833:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787440296.285837:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee07f86ee00, rc 0) 00000100:00100000:2.0:1787440296.285910:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee080b06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+22:11380:x1874266681313280:12345-192.168.206.58@tcp:101:lfs.0 Request processed in 529us (810us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440296.285919:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 145 00000100:00100000:2.0:1787440296.291438:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440296.291672:0:6892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681313536 00000100:00100000:0.0:1787440296.291684:0:6892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681313536 00000100:00100000:0.0:1787440296.291771:0:6892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 146 00000100:00100000:0.0:1787440296.291784:0:6892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee05fcddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+22:11380:x1874266681313536:12345-192.168.206.58@tcp:101:lfs.0 00010000:00010000:0.0:1787440296.291815:0:6892:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440296.291847:0:6892:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcee00/0x85f5fa77adf3cc94 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fab14535dc62375 expref: -99 pid: 6892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440296.291996:0:6892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce600/0x85f5fa77adf3cc9b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440296.292015:0:6892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce600/0x85f5fa77adf3cc9b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440296.292041:0:6892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce600/0x85f5fa77adf3cc9b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787440296.292055:0:6892:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1787440296.292415:0:6892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcee00/0x85f5fa77adf3cc94 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62375 expref: 25 pid: 6892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440296.292438:0:6892:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce600/0x85f5fa77adf3cc9b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62375 expref: 24 pid: 6892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440296.292627:0:6892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ee054b3cd00) 00010000:00010000:0.0:1787440296.292631:0:6892:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787440296.292653:0:6892:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee04cbce600, rc 0) 00000100:00100000:0.0:1787440296.292889:0:6892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee05fcddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+24:11380:x1874266681313536:12345-192.168.206.58@tcp:101:lfs.0 Request processed in 1107us (1463us total) trans 4294967422 rc 0/0 00000100:00100000:0.0:1787440296.292899:0:6892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 146 00000100:00100000:1.0:1787440296.298630:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:1.0:1787440296.298681:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440296.298776:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681313920 00000100:00100000:3.0:1787440296.298789:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681313920 00000100:00100000:3.0:1787440296.298867:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 10 00000100:00100000:3.0:1787440296.298878:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee07f9f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+24:2360:x1874266681313920:12345-192.168.206.58@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787440296.298898:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787440296.298931:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce600/0x85f5fa77adf3cc9b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62375 expref: 24 pid: 6892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440296.298953:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ee054b3cd00) 00010000:00010000:3.0:1787440296.298958:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787440296.299019:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee07f9f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+23:2360:x1874266681313920:12345-192.168.206.58@tcp:103:ldlm_bl.0 Request processed in 143us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440296.299036:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 10 00000100:00100000:0.0:1787440296.299749:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681313792 00000100:00100000:0.0:1787440296.299771:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681313792 00000100:00100000:0.0:1787440296.299819:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 147 00000100:00100000:0.0:1787440296.299830:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee07f9f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+23:11380:x1874266681313792:12345-192.168.206.58@tcp:101:lfs.0 00010000:00010000:0.0:1787440296.299858:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440296.299880:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcec00/0x85f5fa77adf3cca9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fab14535dc6237c expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440296.300002:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce200/0x85f5fa77adf3ccb0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440296.300029:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce200/0x85f5fa77adf3ccb0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440296.300043:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce200/0x85f5fa77adf3ccb0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787440296.300057:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1787440296.300295:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcec00/0x85f5fa77adf3cca9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6237c expref: 26 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440296.300317:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce200/0x85f5fa77adf3ccb0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6237c expref: 25 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440296.300327:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ee054b3cd00) 00010000:00010000:0.0:1787440296.300347:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787440296.300351:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee04cbce200, rc 0) 00000100:00100000:0.0:1787440296.300474:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee07f9f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+25:11380:x1874266681313792:12345-192.168.206.58@tcp:101:lfs.0 Request processed in 646us (1857us total) trans 4294967423 rc 0/0 00000100:00100000:0.0:1787440296.300482:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 147 00000100:00100000:1.0:1787440296.309042:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:2.0:1787440296.309167:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681314048 00000100:00100000:2.0:1787440296.309180:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681314048 00000100:00100000:2.0:1787440296.309250:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 49 00000100:00100000:2.0:1787440296.309261:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee07f9f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+6:2363:x1874266681314048:12345-192.168.206.58@tcp:1:lfs.0 00010000:00010000:2.0:1787440296.309320:0:6698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e22ee83a/0x85f5fa77adf3ccbe lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440296.309345:0:6698:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001a91b948/0x85f5fa77adf3cc71 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62360 expref: 6 pid: 9225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440296.309355:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787440296.309360:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787440296.309365:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e22ee83a/0x85f5fa77adf3ccbe lrc: 4/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440296.309434:0:6698:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001a91b948/0x85f5fa77adf3cc71 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62360 expref: 6 pid: 9225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440296.309451:0:6698:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001a91b948/0x85f5fa77adf3cc71 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62360 expref: 6 pid: 9225 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440296.309468:0:6698:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee05fcdd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6698:1874266701244544:192.168.206.58@tcp:104: 00000100:00100000:2.0:1787440296.309643:0:6698:0:(client.c:2715:ptlrpc_set_wait()) set ffff8edf411529c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787440296.313085:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440296.313193:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681314176 00000100:00100000:0.0:1787440296.313204:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681314176 00002000:00100000:0.0:1787440296.313257:0:6702:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff8ee0773ff100 x1874266681314176/t0(0) o4->792563a7-4c22-4ac7-ac25-d49ef7fb41a8@192.168.206.58@tcp:457/0 lens 504/0 e 0 to 0 dl 1787440307 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787440296.313270:0:6702:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ee0773ff100 with x1874266681314176 ext(0->12) 00010000:00010000:0.0:1787440296.313280:0:6702:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000001a91b948/0x85f5fa77adf3cc71 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62360 expref: 7 pid: 9225 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440296.313299:0:6702:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000001a91b948/0x85f5fa77adf3cc71 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62360 expref: 7 pid: 9225 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787440296.313307:0:6702:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8ee0773ff100 00000100:00100000:0.0:1787440296.313340:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 2 00000100:00100000:0.0:1787440296.313349:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee0773ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+7:2362:x1874266681314176:12345-192.168.206.58@tcp:4:lfs.0 00000100:00100000:0.0:1787440296.313958:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee0773ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+9:2362:x1874266681314176:12345-192.168.206.58@tcp:4:lfs.0 Request processed in 607us (895us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1787440296.313968:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 2 00002000:00100000:0.0:1787440296.313976:0:6702:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff8ee0773ff100 x1874266681314176/t4294967305(0) o4->792563a7-4c22-4ac7-ac25-d49ef7fb41a8@192.168.206.58@tcp:457/0 lens 504/448 e 0 to 0 dl 1787440307 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787440296.313986:0:6702:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ee0773ff100 with x1874266681314176 ext(0->12) 00010000:00010000:0.0:1787440296.313998:0:6702:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000001a91b948/0x85f5fa77adf3cc71 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62360 expref: 9 pid: 9225 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440296.314013:0:6702:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000001a91b948/0x85f5fa77adf3cc71 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62360 expref: 9 pid: 9225 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787440296.314021:0:6702:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8ee0773ff100 00000100:00100000:2.0:1787440296.314400:0:6698:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee05fcdd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6698:1874266701244544:192.168.206.58@tcp:104: 00010000:00010000:2.0:1787440296.314431:0:6698:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e22ee83a/0x85f5fa77adf3ccbe lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440296.317831:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:2.0:1787440296.317986:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681314304 00000100:00100000:2.0:1787440296.317998:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681314304 00010000:00010000:2.0:1787440296.318063:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001a91b948/0x85f5fa77adf3cc71 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62360 expref: 9 pid: 9225 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440296.318135:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 64 00000100:00100000:2.0:1787440296.318146:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee07f9f2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+9:2362:x1874266681314304:12345-192.168.206.58@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787440296.318167:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1787440296.318193:0:5834:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1787440296.318196:0:5834:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1787440296 00002000:00010000:2.0:1787440296.318199:0:5834:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1787440296 00002000:00010000:2.0:1787440296.318202:0:5834:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1787440296 00010000:00010000:2.0:1787440296.318228:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001a91b948/0x85f5fa77adf3cc71 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62360 expref: 9 pid: 9225 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440296.318245:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001a91b948/0x85f5fa77adf3cc71 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62360 expref: 9 pid: 9225 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440296.318277:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001a91b948/0x85f5fa77adf3cc71 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62360 expref: 9 pid: 9225 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440296.318299:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787440296.318304:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787440296.318310:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e22ee83a/0x85f5fa77adf3ccbe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440296.318321:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e22ee83a/0x85f5fa77adf3ccbe lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440296.318425:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787440296.318560:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee07f9f2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+8:2362:x1874266681314304:12345-192.168.206.58@tcp:103:ldlm_bl.0 Request processed in 415us (743us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440296.318569:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 64 00010000:00010000:0.0:1787440296.321465:0:6698:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e22ee83a/0x85f5fa77adf3ccbe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440296.321513:0:6698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e22ee83a/0x85f5fa77adf3ccbe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440296.321563:0:6698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e22ee83a/0x85f5fa77adf3ccbe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440296.321572:0:6698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e22ee83a/0x85f5fa77adf3ccbe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440296.321581:0:6698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e22ee83a/0x85f5fa77adf3ccbe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440296.321588:0:6698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee07f86fc00 already unused, calling callback (ffffffffc15b52a0) 00010000:00010000:0.0:1787440296.321593:0:6698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e22ee83a/0x85f5fa77adf3ccbe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440296.321603:0:6698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e22ee83a/0x85f5fa77adf3ccbe lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440296.321648:0:6698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e22ee83a/0x85f5fa77adf3ccbe lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440296.321657:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e22ee83a/0x85f5fa77adf3ccbe lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440296.321794:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee07f9f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+7:2363:x1874266681314048:12345-192.168.206.58@tcp:1:lfs.0 Request processed in 12527us (12758us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440296.321804:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 49 00000100:00100000:1.0:1787440296.329462:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:2.0:1787440296.329601:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681314560 00000100:00100000:2.0:1787440296.329614:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681314560 00000100:00100000:2.0:1787440296.329676:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 38 00000100:00100000:2.0:1787440296.329688:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee079bad850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+25:11380:x1874266681314560:12345-192.168.206.58@tcp:35:lfs.0 00000004:00010000:2.0:1787440296.329785:0:5852:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce200/0x85f5fa77adf3ccb0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6237c expref: 25 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787440296.330184:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:2.0:1787440296.330235:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00000001:00080000:2.0:1787440296.330935:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00010000:00010000:2.0:1787440296.331010:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f000/0x85f5fa77adf3ccc5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440296.331032:0:5852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e400/0x85f5fa77adf3cc5c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62352 expref: 29 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440296.331041:0:5852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f000/0x85f5fa77adf3ccc5 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440296.331099:0:5852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e400/0x85f5fa77adf3cc5c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62352 expref: 29 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440296.331119:0:5852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e400/0x85f5fa77adf3cc5c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62352 expref: 29 pid: 5851 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440296.331136:0:5852:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee05fcdd880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5852:1874266701244672:192.168.206.58@tcp:104: 00000100:00100000:2.0:1787440296.331244:0:5852:0:(client.c:2715:ptlrpc_set_wait()) set ffff8edf411529c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787440296.334537:0:5852:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee05fcdd880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5852:1874266701244672:192.168.206.58@tcp:104: 00010000:00010000:2.0:1787440296.334581:0:5852:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f000/0x85f5fa77adf3ccc5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440296.337235:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440296.337349:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681314688 00000100:00100000:3.0:1787440296.337361:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681314688 00010000:00010000:3.0:1787440296.337412:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e400/0x85f5fa77adf3cc5c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62352 expref: 30 pid: 5851 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440296.337602:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 65 00000100:00100000:3.0:1787440296.337615:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee06e7e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+30:2363:x1874266681314688:12345-192.168.206.58@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787440296.337635:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787440296.337644:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e400/0x85f5fa77adf3cc5c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62352 expref: 30 pid: 5851 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440296.337659:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e400/0x85f5fa77adf3cc5c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62352 expref: 30 pid: 5851 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440296.337689:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e400/0x85f5fa77adf3cc5c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62352 expref: 30 pid: 5851 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440296.337711:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ee054b3cd00) 00010000:00010000:3.0:1787440296.337717:0:5836:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f000/0x85f5fa77adf3ccc5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440296.337729:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f000/0x85f5fa77adf3ccc5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440296.337737:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f000/0x85f5fa77adf3ccc5 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440296.337785:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787440296.337935:0:5852:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f000/0x85f5fa77adf3ccc5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440296.337945:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f000/0x85f5fa77adf3ccc5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440296.338161:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee06e7e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+29:2363:x1874266681314688:12345-192.168.206.58@tcp:103:ldlm_bl.0 Request processed in 547us (937us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440296.338171:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 65 00000001:00080000:2.0:1787440296.338298:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000001:00080000:2.0:1787440296.338565:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:2.0:1787440296.338686:0:5852:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee05fcdd880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5852:1874266701244800:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1787440296.338748:0:5852:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440296.338784:0:5852:0:(client.c:2715:ptlrpc_set_wait()) set ffff8edf41152c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787440296.338813:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701244800 00000100:00100000:2.0:1787440296.338819:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701244800 00000100:00100000:2.0:1787440296.338869:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787440296.338877:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee05fcdca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5852:x1874266701244800:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1787440296.338978:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee05fcdca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5852:x1874266701244800:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 100us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440296.338986:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787440296.339035:0:5852:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee05fcdd880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5852:1874266701244800:0@lo:1000:mdt_rdpg00_000.0 00000100:00080000:1.0:1787440296.340605:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:2.0:1787440296.340851:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00000100:00100000:2.0:1787440296.340967:0:5852:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee05fcdd880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5852:1874266701244928:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1787440296.342861:0:5852:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440296.342957:0:5852:0:(client.c:2715:ptlrpc_set_wait()) set ffff8edf411529c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787440296.343008:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701244928 00000100:00100000:0.0:1787440296.343372:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701244928 00000100:00100000:0.0:1787440296.343483:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787440296.343528:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee05fcdf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5852:x1874266701244928:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1787440296.344020:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee05fcdf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5852:x1874266701244928:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 527us (1168us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1787440296.344040:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787440296.344366:0:5852:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee05fcdd880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5852:1874266701244928:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1787440296.344475:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:2.0:1787440296.344877:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f000/0x85f5fa77adf3ccc5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440296.344890:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f000/0x85f5fa77adf3ccc5 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440296.344899:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f000/0x85f5fa77adf3ccc5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440296.344906:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee07f86f000 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:2.0:1787440296.344919:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f000/0x85f5fa77adf3ccc5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440296.344928:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f000/0x85f5fa77adf3ccc5 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440296.344947:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ee054b3cd00) 00010000:00010000:2.0:1787440296.344951:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1787440296.344956:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f000/0x85f5fa77adf3ccc5 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440296.344962:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f000/0x85f5fa77adf3ccc5 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787440296.345627:0:5852:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1787440296.345832:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00000004:00080000:2.0:1787440296.345847:0:5852:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 394716353517ns, next at 395716350312ns, rc = 0 00000001:00080000:2.0:1787440296.345856:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967431 00010000:00010000:2.0:1787440296.345909:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ee054b3cd00) 00010000:00010000:2.0:1787440296.345913:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787440296.345924:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce200/0x85f5fa77adf3ccb0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6237c expref: 33 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440296.346281:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee079bad850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+32:11380:x1874266681314560:12345-192.168.206.58@tcp:35:lfs.0 Request processed in 16592us (16831us total) trans 4294967432 rc 0/0 00000100:00100000:2.0:1787440296.346292:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 38 00000020:00080000:2.0:1787440296.346299:0:5852:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1787440296.350638:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440296.350737:0:6892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681314816 00000100:00100000:0.0:1787440296.350750:0:6892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681314816 00000100:00100000:0.0:1787440296.350834:0:6892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 148 00000100:00100000:0.0:1787440296.350845:0:6892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee07f9f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+32:11380:x1874266681314816:12345-192.168.206.58@tcp:101:lfs.0 00010000:00010000:0.0:1787440296.350873:0:6892:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440296.350900:0:6892:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcee00/0x85f5fa77adf3cccc lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fab14535dc62383 expref: -99 pid: 6892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440296.350978:0:6892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcee00/0x85f5fa77adf3cccc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62383 expref: 33 pid: 6892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440296.351015:0:6892:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcee00/0x85f5fa77adf3cccc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62383 expref: 33 pid: 6892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440296.351039:0:6892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ee050ca1c00) 00010000:00010000:0.0:1787440296.351042:0:6892:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787440296.351046:0:6892:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee04cbcee00, rc 0) 00000100:00100000:0.0:1787440296.351135:0:6892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee07f9f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+33:11380:x1874266681314816:12345-192.168.206.58@tcp:101:lfs.0 Request processed in 291us (510us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440296.351143:0:6892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 148 00000100:00100000:2.0:1787440296.355319:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440296.355479:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681315072 00000100:00100000:0.0:1787440296.355743:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681315072 00000100:00100000:1.0:1787440296.356038:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 39 00000100:00100000:1.0:1787440296.356051:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee05fcdc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+33:11380:x1874266681315072:12345-192.168.206.58@tcp:35:lfs.0 00000100:00100000:1.0:1787440296.356583:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee05fcdc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+34:11380:x1874266681315072:12345-192.168.206.58@tcp:35:lfs.0 Request processed in 530us (1276us total) trans 4294967433 rc 0/0 00000100:00100000:1.0:1787440296.356593:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 39 00000100:00100000:2.0:1787440296.456009:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440296.456238:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681315328 00000100:00100000:0.0:1787440296.456252:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681315328 00000100:00100000:0.0:1787440296.456332:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 149 00000100:00100000:0.0:1787440296.456346:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee05fcdd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+34:11390:x1874266681315328:12345-192.168.206.58@tcp:101:lfs.0 00010000:00010000:0.0:1787440296.456381:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440296.456409:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfe00/0x85f5fa77adf3ccd3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fab14535dc6238a expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787440296.456734:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:0.0:1787440296.457010:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfe00/0x85f5fa77adf3ccd3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6238a expref: 36 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440296.457028:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ee054b3cb00) 00010000:00010000:0.0:1787440296.457031:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787440296.457036:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfe00/0x85f5fa77adf3ccd3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6238a expref: 36 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440296.457071:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee04cbcfe00, rc 0) 00000100:00100000:0.0:1787440296.457340:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee05fcdd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+35:11390:x1874266681315328:12345-192.168.206.58@tcp:101:lfs.0 Request processed in 996us (1344us total) trans 4294967434 rc 301/301 00000100:00100000:0.0:1787440296.457350:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 149 00000100:00100000:2.0:1787440296.462183:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440296.462306:0:6892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681315456 00000100:00100000:0.0:1787440296.462320:0:6892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681315456 00000100:00100000:0.0:1787440296.462435:0:6892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 150 00000100:00100000:0.0:1787440296.462460:0:6892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee05fcdce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+35:11390:x1874266681315456:12345-192.168.206.58@tcp:34:lfs.0 00010000:00010000:0.0:1787440296.462587:0:6892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf200/0x85f5fa77adf3cce1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440296.462609:0:6892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf200/0x85f5fa77adf3cce1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440296.462623:0:6892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf200/0x85f5fa77adf3cce1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440296.462641:0:6892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce000/0x85f5fa77adf3cce8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440296.462649:0:6892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce000/0x85f5fa77adf3cce8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440296.462655:0:6892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce000/0x85f5fa77adf3cce8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440296.462786:0:6892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce800/0x85f5fa77adf3ccef lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440296.462807:0:6892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce800/0x85f5fa77adf3ccef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440296.462814:0:6892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce800/0x85f5fa77adf3ccef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787440296.462867:0:6892:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce800/0x85f5fa77adf3ccef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440296.462884:0:6892:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf200/0x85f5fa77adf3cce1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440296.462891:0:6892:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf200/0x85f5fa77adf3cce1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440296.462898:0:6892:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf200/0x85f5fa77adf3cce1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440296.462904:0:6892:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee04cbcf200 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:0.0:1787440296.462909:0:6892:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf200/0x85f5fa77adf3cce1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440296.462917:0:6892:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf200/0x85f5fa77adf3cce1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440296.462932:0:6892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8ee05132ea00) 00010000:00010000:0.0:1787440296.462936:0:6892:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440296.462940:0:6892:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf200/0x85f5fa77adf3cce1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440296.462946:0:6892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf200/0x85f5fa77adf3cce1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440296.462969:0:6892:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce000/0x85f5fa77adf3cce8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440296.462975:0:6892:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce000/0x85f5fa77adf3cce8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440296.462982:0:6892:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce000/0x85f5fa77adf3cce8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440296.462987:0:6892:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee04cbce000 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:0.0:1787440296.462990:0:6892:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce000/0x85f5fa77adf3cce8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440296.462997:0:6892:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce000/0x85f5fa77adf3cce8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440296.463004:0:6892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8ee050ca1500) 00010000:00010000:0.0:1787440296.463007:0:6892:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440296.463010:0:6892:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce000/0x85f5fa77adf3cce8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440296.463016:0:6892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce000/0x85f5fa77adf3cce8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440296.463044:0:6892:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce800/0x85f5fa77adf3ccef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440296.463050:0:6892:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce800/0x85f5fa77adf3ccef lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440296.463056:0:6892:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce800/0x85f5fa77adf3ccef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440296.463069:0:6892:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee04cbce800 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:0.0:1787440296.463318:0:6892:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce800/0x85f5fa77adf3ccef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440296.463328:0:6892:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce800/0x85f5fa77adf3ccef lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440296.463337:0:6892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ee050ca1c00) 00010000:00010000:0.0:1787440296.463339:0:6892:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440296.463343:0:6892:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce800/0x85f5fa77adf3ccef lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440296.463349:0:6892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce800/0x85f5fa77adf3ccef lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440296.463457:0:6892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee05fcdce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+35:11390:x1874266681315456:12345-192.168.206.58@tcp:34:lfs.0 Request processed in 1009us (1287us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440296.463466:0:6892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 150 00000100:00100000:2.0:1787440296.468149:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440296.468793:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681315712 00000100:00100000:0.0:1787440296.468807:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681315712 00000100:00100000:0.0:1787440296.468886:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 40 00000100:00100000:0.0:1787440296.468897:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee05fcdf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+35:11390:x1874266681315712:12345-192.168.206.58@tcp:35:lfs.0 00000100:00100000:0.0:1787440296.469251:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee05fcdf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+36:11390:x1874266681315712:12345-192.168.206.58@tcp:35:lfs.0 Request processed in 355us (1114us total) trans 4294967435 rc 0/0 00000100:00100000:0.0:1787440296.469259:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 40 00000100:00100000:2.0:1787440296.527748:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440296.527926:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681315968 00000100:00100000:0.0:1787440296.527939:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681315968 00000100:00100000:0.0:1787440296.528015:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 151 00000100:00100000:0.0:1787440296.528054:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee05fcdd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+36:11393:x1874266681315968:12345-192.168.206.58@tcp:101:lfs.0 00010000:00010000:0.0:1787440296.528098:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440296.528125:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce800/0x85f5fa77adf3ccf6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fab14535dc62391 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440296.528221:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce000/0x85f5fa77adf3ccfd lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440296.528240:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce000/0x85f5fa77adf3ccfd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440296.528253:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce000/0x85f5fa77adf3ccfd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440296.528270:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf200/0x85f5fa77adf3cd04 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440296.528278:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf200/0x85f5fa77adf3cd04 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440296.528285:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf200/0x85f5fa77adf3cd04 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440296.528451:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfe00/0x85f5fa77adf3cd0b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440296.528461:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfe00/0x85f5fa77adf3cd0b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440296.528469:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfe00/0x85f5fa77adf3cd0b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787440296.528533:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1787440296.528651:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce000/0x85f5fa77adf3ccfd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440296.528660:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce000/0x85f5fa77adf3ccfd lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440296.528667:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce000/0x85f5fa77adf3ccfd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440296.528674:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee04cbce000 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:0.0:1787440296.528679:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce000/0x85f5fa77adf3ccfd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440296.528688:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce000/0x85f5fa77adf3ccfd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440296.528701:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8ee05132ea00) 00010000:00010000:0.0:1787440296.528705:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440296.528710:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce000/0x85f5fa77adf3ccfd lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440296.528717:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce000/0x85f5fa77adf3ccfd lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440296.528731:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf200/0x85f5fa77adf3cd04 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440296.528738:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf200/0x85f5fa77adf3cd04 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440296.528903:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf200/0x85f5fa77adf3cd04 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440296.528910:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee04cbcf200 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:0.0:1787440296.528913:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf200/0x85f5fa77adf3cd04 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440296.528919:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf200/0x85f5fa77adf3cd04 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440296.528927:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8ee050ca1500) 00010000:00010000:0.0:1787440296.528930:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440296.528933:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf200/0x85f5fa77adf3cd04 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440296.528939:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf200/0x85f5fa77adf3cd04 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440296.528994:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce800/0x85f5fa77adf3ccf6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62391 expref: 39 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440296.529009:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfe00/0x85f5fa77adf3cd0b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62391 expref: 38 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440296.529069:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ee050ca1c00) 00010000:00010000:0.0:1787440296.529081:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787440296.529084:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee04cbcfe00, rc 0) 00000100:00100000:0.0:1787440296.529303:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee05fcdd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+38:11393:x1874266681315968:12345-192.168.206.58@tcp:101:lfs.0 Request processed in 1251us (1569us total) trans 4294967436 rc 0/0 00000100:00100000:0.0:1787440296.529322:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 151 00000100:00100000:2.0:1787440296.545222:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:1.0:1787440296.545330:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681316096 00000100:00100000:1.0:1787440296.545343:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681316096 00000100:00100000:1.0:1787440296.545453:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 152 00000100:00100000:1.0:1787440296.545465:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee05fcde300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+38:11393:x1874266681316096:12345-192.168.206.58@tcp:54:lfs.0 00010000:00010000:1.0:1787440296.545593:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e400/0x85f5fa77adf3cd19 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440296.545632:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e400/0x85f5fa77adf3cd19 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440296.545647:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e400/0x85f5fa77adf3cd19 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440296.545682:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e400/0x85f5fa77adf3cd19 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440296.545689:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e400/0x85f5fa77adf3cd19 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440296.545696:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e400/0x85f5fa77adf3cd19 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440296.545702:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee07fb9e400 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:1.0:1787440296.545706:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e400/0x85f5fa77adf3cd19 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440296.545714:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e400/0x85f5fa77adf3cd19 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440296.545727:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ee050ca1c00) 00010000:00010000:1.0:1787440296.545731:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787440296.545736:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e400/0x85f5fa77adf3cd19 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440296.545742:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e400/0x85f5fa77adf3cd19 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440296.545832:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee05fcde300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+38:11393:x1874266681316096:12345-192.168.206.58@tcp:54:lfs.0 Request processed in 369us (624us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440296.545845:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 152 00000100:00100000:3.0:1787440296.547966:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440296.548047:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681316352 00000100:00100000:3.0:1787440296.548060:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681316352 00000100:00100000:3.0:1787440296.548133:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 41 00000100:00100000:3.0:1787440296.548144:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee0773fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+38:11393:x1874266681316352:12345-192.168.206.58@tcp:35:lfs.0 00000100:00100000:3.0:1787440296.548422:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee0773fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+39:11393:x1874266681316352:12345-192.168.206.58@tcp:35:lfs.0 Request processed in 280us (469us total) trans 4294967437 rc 0/0 00000100:00100000:3.0:1787440296.548431:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 41 00000100:00100000:2.0:1787440296.873230:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440296.873368:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681316608 00000100:00100000:0.0:1787440296.873381:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681316608 00000100:00100000:0.0:1787440296.873463:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 153 00000100:00100000:0.0:1787440296.873475:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee05fcdfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+39:11424:x1874266681316608:12345-192.168.206.58@tcp:101:cat.0 00010000:00010000:0.0:1787440296.873542:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440296.873567:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce800/0x85f5fa77adf3cd20 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fab14535dc62398 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440296.873689:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf200/0x85f5fa77adf3cd27 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440296.873707:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf200/0x85f5fa77adf3cd27 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440296.873723:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf200/0x85f5fa77adf3cd27 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787440296.873736:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1787440296.873891:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce800/0x85f5fa77adf3cd20 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62398 expref: 42 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440296.873913:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf200/0x85f5fa77adf3cd27 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62398 expref: 41 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440296.873924:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ee050ca1c00) 00010000:00010000:0.0:1787440296.873927:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787440296.873932:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee04cbcf200, rc 0) 00000100:00100000:0.0:1787440296.874023:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee05fcdfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+41:11424:x1874266681316608:12345-192.168.206.58@tcp:101:cat.0 Request processed in 550us (805us total) trans 4294967438 rc 0/0 00000100:00100000:0.0:1787440296.874031:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 153 00000100:00100000:2.0:1787440296.880475:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440296.885054:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681316736 00000100:00100000:3.0:1787440296.885086:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681316736 00000100:00100000:3.0:1787440296.885306:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 11 00000100:00100000:3.0:1787440296.885319:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee05fcddf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+41:2362:x1874266681316736:12345-192.168.206.58@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787440296.885340:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787440296.885375:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf200/0x85f5fa77adf3cd27 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62398 expref: 41 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440296.885399:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ee050ca1c00) 00010000:00010000:3.0:1787440296.885405:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787440296.886153:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:1.0:1787440296.886254:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee05fcddf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+40:2362:x1874266681316736:12345-192.168.206.58@tcp:103:ldlm_bl.0 Request processed in 936us (5803us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440296.886266:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 11 00000100:00100000:1.0:1787440296.887308:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681316992 00000100:00100000:1.0:1787440296.887320:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681316992 00000100:00100000:1.0:1787440296.887465:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 42 00000100:00100000:1.0:1787440296.887477:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee05fcdea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+40:11424:x1874266681316992:12345-192.168.206.58@tcp:35:cat.0 00000100:00100000:1.0:1787440296.887984:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee05fcdea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+41:11424:x1874266681316992:12345-192.168.206.58@tcp:35:cat.0 Request processed in 507us (1832us total) trans 4294967439 rc 0/0 00000100:00100000:1.0:1787440296.887993:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 42 00000100:00100000:3.0:1787440296.941629:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440296.941857:0:6892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681317248 00000100:00100000:0.0:1787440296.941871:0:6892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681317248 00000100:00100000:0.0:1787440296.941946:0:6892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 154 00000100:00100000:0.0:1787440296.941957:0:6892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee0773fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+41:11430:x1874266681317248:12345-192.168.206.58@tcp:101:dd.0 00010000:00010000:0.0:1787440296.941989:0:6892:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440296.941993:0:6892:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787440296.942039:0:6892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86ee00/0x85f5fa77adf3cc8d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6236e expref: 41 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440296.942066:0:6892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8ee05132ea00) 00010000:00010000:0.0:1787440296.942082:0:6892:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787440296.942098:0:6892:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce800/0x85f5fa77adf3cd35 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fab14535dc6239f expref: -99 pid: 6892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440296.942220:0:6892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce000/0x85f5fa77adf3cd3c lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440296.942235:0:6892:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfe00/0x85f5fa77adf3cd0b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62391 expref: 41 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440296.942244:0:6892:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce000/0x85f5fa77adf3cd3c lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440296.942290:0:6892:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfe00/0x85f5fa77adf3cd0b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62391 expref: 41 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440296.942329:0:6892:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfe00/0x85f5fa77adf3cd0b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62391 expref: 41 pid: 5850 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440296.942345:0:6892:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee080b06a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6892:1874266701245056:192.168.206.58@tcp:104: 00000100:00100000:0.0:1787440296.942869:0:6892:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee0460eb480 going to sleep for 11 seconds 00000100:00100000:2.0:1787440296.946597:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440296.946873:0:6892:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee080b06a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6892:1874266701245056:192.168.206.58@tcp:104: 00010000:00010000:0.0:1787440296.946908:0:6892:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce000/0x85f5fa77adf3cd3c lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440296.947011:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681317376 00000100:00100000:1.0:1787440296.947099:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681317376 00010000:00010000:1.0:1787440296.947150:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfe00/0x85f5fa77adf3cd0b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62391 expref: 42 pid: 5850 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440296.947236:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 66 00000100:00100000:1.0:1787440296.947246:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee05fcdc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+42:2363:x1874266681317376:12345-192.168.206.58@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787440296.947267:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787440296.947275:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfe00/0x85f5fa77adf3cd0b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62391 expref: 42 pid: 5850 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440296.947290:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfe00/0x85f5fa77adf3cd0b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62391 expref: 42 pid: 5850 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440296.947319:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfe00/0x85f5fa77adf3cd0b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62391 expref: 42 pid: 5850 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440296.947359:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ee050ca1c00) 00010000:00010000:1.0:1787440296.947365:0:5835:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce000/0x85f5fa77adf3cd3c lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440296.947376:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce000/0x85f5fa77adf3cd3c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440296.947385:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce000/0x85f5fa77adf3cd3c lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440296.947422:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787440296.947679:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee05fcdc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+41:2363:x1874266681317376:12345-192.168.206.58@tcp:103:ldlm_bl.0 Request processed in 432us (1094us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440296.947688:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 66 00010000:00010000:2.0:1787440296.948384:0:6892:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce000/0x85f5fa77adf3cd3c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440296.948397:0:6892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce000/0x85f5fa77adf3cd3c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787440296.948421:0:6892:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1787440296.948660:0:6892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce800/0x85f5fa77adf3cd35 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6239f expref: 42 pid: 6892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440296.948681:0:6892:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce000/0x85f5fa77adf3cd3c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6239f expref: 41 pid: 6892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440296.948690:0:6892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ee050ca1c00) 00010000:00010000:2.0:1787440296.948693:0:6892:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787440296.948696:0:6892:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee04cbce000, rc 0) 00000100:00100000:2.0:1787440296.948768:0:6892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee0773fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+41:11430:x1874266681317248:12345-192.168.206.58@tcp:101:dd.0 Request processed in 6800us (7141us total) trans 4294967440 rc 0/0 00000100:00100000:2.0:1787440296.948777:0:6892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 154 00000100:00100000:2.0:1787440296.952227:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440296.952326:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681317632 00000100:00100000:0.0:1787440296.952339:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681317632 00000100:00100000:0.0:1787440296.952410:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 155 00000100:00100000:0.0:1787440296.952420:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee05fcde680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+41:11430:x1874266681317632:12345-192.168.206.58@tcp:36:dd.0 00010000:00010000:0.0:1787440296.953096:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf600/0x85f5fa77adf3cd4a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440296.953118:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf600/0x85f5fa77adf3cd4a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440296.953132:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf600/0x85f5fa77adf3cd4a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787440296.953201:0:5851:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967441 00000004:00010000:0.0:1787440296.953227:0:5851:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bf3bb670 reply state 00000000a00feebd transno 4294967442 ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf600/0x85f5fa77adf3cd4a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440296.953237:0:5851:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787440296.953403:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee05fcde680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+44:11430:x1874266681317632:12345-192.168.206.58@tcp:36:dd.0 Request processed in 982us (1188us total) trans 4294967442 rc 0/0 00000100:00100000:0.0:1787440296.953411:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 155 00000020:00080000:0.0:1787440296.953417:0:5851:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787440296.962309:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf600/0x85f5fa77adf3cd4a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440296.962329:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf600/0x85f5fa77adf3cd4a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440296.962339:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf600/0x85f5fa77adf3cd4a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440296.962361:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee04cbcf600 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:3.0:1787440296.962367:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf600/0x85f5fa77adf3cd4a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440296.962375:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf600/0x85f5fa77adf3cd4a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440296.962395:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ee050ca1c00) 00010000:00010000:3.0:1787440296.962399:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440296.962404:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf600/0x85f5fa77adf3cd4a lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440296.962411:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf600/0x85f5fa77adf3cd4a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440297.054313:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787440297.166285:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:1.0:1787440297.166422:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681317760 00000100:00100000:1.0:1787440297.166434:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681317760 00000100:00100000:1.0:1787440297.166581:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 156 00000100:00100000:1.0:1787440297.166594:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee05fcdc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+43:11444:x1874266681317760:12345-192.168.206.58@tcp:101:stat.0 00010000:00010000:1.0:1787440297.166626:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440297.166653:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e400/0x85f5fa77adf3cd51 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fab14535dc623a6 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440297.166739:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e000/0x85f5fa77adf3cd58 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440297.166768:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e000/0x85f5fa77adf3cd58 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440297.166803:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e000/0x85f5fa77adf3cd58 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440297.166821:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f600/0x85f5fa77adf3cd5f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440297.166829:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f600/0x85f5fa77adf3cd5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440297.166836:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f600/0x85f5fa77adf3cd5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440297.166956:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e800/0x85f5fa77adf3cd66 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440297.166968:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce000/0x85f5fa77adf3cd3c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6239f expref: 44 pid: 6892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440297.166978:0:5849:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e800/0x85f5fa77adf3cd66 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1787440297.167184:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787440297.167233:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce000/0x85f5fa77adf3cd3c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6239f expref: 44 pid: 6892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440297.167252:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce000/0x85f5fa77adf3cd3c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6239f expref: 44 pid: 6892 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440297.167271:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee07f9f1880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5849:1874266701245184:192.168.206.58@tcp:104: 00000100:00100000:1.0:1787440297.167396:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee047c02000 going to sleep for 11 seconds 00000100:00100000:2.0:1787440297.172964:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440297.173161:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681318016 00000100:00100000:3.0:1787440297.173173:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681318016 00000100:00100000:3.0:1787440297.173250:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 43 00000100:00100000:3.0:1787440297.173261:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee077ec1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+45:5600:x1874266681318016:12345-192.168.206.58@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1787440297.173713:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee077ec1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+46:5600:x1874266681318016:12345-192.168.206.58@tcp:35:ldlm_bl.0 Request processed in 452us (761us total) trans 4294967443 rc 0/0 00000100:00100000:3.0:1787440297.173722:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 43 00000100:00100000:1.0:1787440297.174216:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee07f9f1880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5849:1874266701245184:192.168.206.58@tcp:104: 00010000:00010000:1.0:1787440297.174252:0:5849:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e800/0x85f5fa77adf3cd66 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440297.176489:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:1.0:1787440297.176626:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681318144 00000100:00100000:1.0:1787440297.176636:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681318144 00010000:00010000:1.0:1787440297.176683:0:6711:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce000/0x85f5fa77adf3cd3c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6239f expref: 46 pid: 6892 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440297.176728:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 67 00000100:00100000:1.0:1787440297.176737:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee080b06a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+46:2363:x1874266681318144:12345-192.168.206.58@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787440297.176765:0:6711:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787440297.176772:0:6711:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce000/0x85f5fa77adf3cd3c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6239f expref: 46 pid: 6892 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440297.176787:0:6711:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce000/0x85f5fa77adf3cd3c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6239f expref: 46 pid: 6892 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440297.176814:0:6711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce000/0x85f5fa77adf3cd3c lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6239f expref: 46 pid: 6892 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440297.176833:0:6711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ee050ca1c00) 00010000:00010000:1.0:1787440297.176839:0:6711:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e800/0x85f5fa77adf3cd66 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440297.176849:0:6711:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e800/0x85f5fa77adf3cd66 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440297.176858:0:6711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e800/0x85f5fa77adf3cd66 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440297.176906:0:6711:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787440297.176966:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee080b06a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+45:2363:x1874266681318144:12345-192.168.206.58@tcp:103:ldlm_bl.0 Request processed in 229us (490us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440297.176974:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 67 00010000:00010000:0.0:1787440297.177151:0:5849:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e800/0x85f5fa77adf3cd66 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440297.177160:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e800/0x85f5fa77adf3cd66 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787440297.177221:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1787440297.177226:0:5849:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787440297.177250:0:5849:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e800/0x85f5fa77adf3cd66 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440297.177268:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e800/0x85f5fa77adf3cd66 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440297.177279:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e000/0x85f5fa77adf3cd58 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440297.177286:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e000/0x85f5fa77adf3cd58 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440297.177293:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e000/0x85f5fa77adf3cd58 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440297.177299:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee07fb9e000 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:0.0:1787440297.177304:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e000/0x85f5fa77adf3cd58 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440297.177312:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e000/0x85f5fa77adf3cd58 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440297.177331:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8ee05132ea00) 00010000:00010000:0.0:1787440297.177334:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440297.177338:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e000/0x85f5fa77adf3cd58 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440297.177345:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e000/0x85f5fa77adf3cd58 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440297.177356:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f600/0x85f5fa77adf3cd5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440297.177362:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f600/0x85f5fa77adf3cd5f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440297.177368:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f600/0x85f5fa77adf3cd5f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440297.177374:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee07fb9f600 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:0.0:1787440297.177377:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f600/0x85f5fa77adf3cd5f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440297.177382:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f600/0x85f5fa77adf3cd5f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440297.177388:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8ee05132e700) 00010000:00010000:0.0:1787440297.177391:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440297.177393:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f600/0x85f5fa77adf3cd5f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440297.177399:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f600/0x85f5fa77adf3cd5f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440297.177448:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e400/0x85f5fa77adf3cd51 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc623a6 expref: 45 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440297.177462:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e800/0x85f5fa77adf3cd66 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc623a6 expref: 44 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440297.177469:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ee050ca1c00) 00010000:00010000:0.0:1787440297.177472:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787440297.177474:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee07fb9e800, rc 0) 00000100:00100000:0.0:1787440297.177553:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee05fcdc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+44:11444:x1874266681317760:12345-192.168.206.58@tcp:101:stat.0 Request processed in 10963us (11282us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440297.177561:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 156 00000100:00100000:0.0:1787440297.218425:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:2.0:1787440297.218643:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681318400 00000100:00100000:2.0:1787440297.218656:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681318400 00000100:00100000:2.0:1787440297.218726:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 157 00000100:00100000:2.0:1787440297.218737:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee080b04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+44:11450:x1874266681318400:12345-192.168.206.58@tcp:36:truncate.0 00010000:00010000:2.0:1787440297.218995:0:5850:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787440297.219031:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e800/0x85f5fa77adf3cd66 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc623a6 expref: 44 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440297.219055:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ee050ca1c00) 00010000:00010000:2.0:1787440297.219061:0:5850:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787440297.219741:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e400/0x85f5fa77adf3cd6d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440297.219762:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e400/0x85f5fa77adf3cd6d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440297.219823:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e400/0x85f5fa77adf3cd6d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787440297.220004:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967444 00000004:00010000:2.0:1787440297.220033:0:5850:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002449c251 reply state 000000002b00b900 transno 4294967445 ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e400/0x85f5fa77adf3cd6d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440297.220043:0:5850:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787440297.220281:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee080b04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+46:11450:x1874266681318400:12345-192.168.206.58@tcp:36:truncate.0 Request processed in 1544us (1868us total) trans 4294967445 rc 0/0 00000100:00100000:2.0:1787440297.220290:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 157 00000020:00080000:2.0:1787440297.220296:0:5850:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787440297.222616:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e400/0x85f5fa77adf3cd6d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440297.222636:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e400/0x85f5fa77adf3cd6d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440297.222644:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e400/0x85f5fa77adf3cd6d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440297.222650:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee07f86e400 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:1.0:1787440297.222656:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e400/0x85f5fa77adf3cd6d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440297.222665:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e400/0x85f5fa77adf3cd6d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440297.222685:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ee050ca1c00) 00010000:00010000:1.0:1787440297.222688:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440297.222694:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e400/0x85f5fa77adf3cd6d lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440297.222701:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e400/0x85f5fa77adf3cd6d lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440297.416823:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440297.417085:0:6892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681318528 00000100:00100000:3.0:1787440297.417099:0:6892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681318528 00000100:00100000:3.0:1787440297.417170:0:6892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 158 00000100:00100000:3.0:1787440297.417181:0:6892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee080b04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+45:11464:x1874266681318528:12345-192.168.206.58@tcp:101:stat.0 00010000:00010000:3.0:1787440297.417211:0:6892:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440297.417252:0:6892:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95200/0x85f5fa77adf3cd74 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fab14535dc623ad expref: -99 pid: 6892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440297.417340:0:6892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94000/0x85f5fa77adf3cd7b lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440297.417357:0:6892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94000/0x85f5fa77adf3cd7b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440297.417371:0:6892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94000/0x85f5fa77adf3cd7b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440297.417392:0:6892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94800/0x85f5fa77adf3cd82 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440297.417400:0:6892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94800/0x85f5fa77adf3cd82 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440297.417407:0:6892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94800/0x85f5fa77adf3cd82 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440297.417704:0:6892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94600/0x85f5fa77adf3cd89 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440297.417714:0:6892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94600/0x85f5fa77adf3cd89 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440297.417722:0:6892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94600/0x85f5fa77adf3cd89 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787440297.417949:0:6892:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:3.0:1787440297.417955:0:6892:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787440297.417986:0:6892:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94600/0x85f5fa77adf3cd89 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440297.418010:0:6892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94600/0x85f5fa77adf3cd89 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440297.418662:0:6892:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94000/0x85f5fa77adf3cd7b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440297.418670:0:6892:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94000/0x85f5fa77adf3cd7b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440297.418677:0:6892:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94000/0x85f5fa77adf3cd7b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440297.418683:0:6892:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee049e94000 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:3.0:1787440297.418689:0:6892:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94000/0x85f5fa77adf3cd7b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440297.418697:0:6892:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94000/0x85f5fa77adf3cd7b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440297.418713:0:6892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8ee05132ea00) 00010000:00010000:3.0:1787440297.418717:0:6892:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440297.418722:0:6892:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94000/0x85f5fa77adf3cd7b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440297.418728:0:6892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94000/0x85f5fa77adf3cd7b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440297.418746:0:6892:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94800/0x85f5fa77adf3cd82 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440297.418820:0:6892:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94800/0x85f5fa77adf3cd82 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440297.418837:0:6892:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94800/0x85f5fa77adf3cd82 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440297.418842:0:6892:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee049e94800 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:3.0:1787440297.418845:0:6892:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94800/0x85f5fa77adf3cd82 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440297.418852:0:6892:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94800/0x85f5fa77adf3cd82 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440297.418986:0:6892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8ee0460cc200) 00010000:00010000:3.0:1787440297.418990:0:6892:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440297.418994:0:6892:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94800/0x85f5fa77adf3cd82 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440297.419000:0:6892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94800/0x85f5fa77adf3cd82 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440297.419160:0:6892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95200/0x85f5fa77adf3cd74 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc623ad expref: 47 pid: 6892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440297.419178:0:6892:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94600/0x85f5fa77adf3cd89 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc623ad expref: 46 pid: 6892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440297.419186:0:6892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ee050ca1c00) 00010000:00010000:3.0:1787440297.419189:0:6892:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787440297.419193:0:6892:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee049e94600, rc 0) 00000100:00100000:3.0:1787440297.419298:0:6892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee080b04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+46:11464:x1874266681318528:12345-192.168.206.58@tcp:101:stat.0 Request processed in 2116us (2487us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440297.419320:0:6892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 158 00000040:00080000:1.0:1787440297.438634:0:11682:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787440297.438647:0:11682:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787440297.438928:0:11682:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:1.0:1787440297.438935:0:11682:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787440297.498393:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:2.0:1787440297.500399:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681318784 00000100:00100000:2.0:1787440297.500441:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681318784 00000100:00100000:2.0:1787440297.500685:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 159 00000100:00100000:2.0:1787440297.500699:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee0773fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+46:11474:x1874266681318784:12345-192.168.206.58@tcp:101:lfs.0 00010000:00010000:2.0:1787440297.500729:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440297.500758:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e400/0x85f5fa77adf3cd90 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fab14535dc623b4 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787440297.500919:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:2.0:1787440297.501217:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e400/0x85f5fa77adf3cd90 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc623b4 expref: 48 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440297.501236:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ee054b3cb00) 00010000:00010000:2.0:1787440297.501239:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787440297.501246:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e400/0x85f5fa77adf3cd90 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc623b4 expref: 48 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440297.501266:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee07f86e400, rc 0) 00000100:00100000:2.0:1787440297.501442:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee0773fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+47:11474:x1874266681318784:12345-192.168.206.58@tcp:101:lfs.0 Request processed in 744us (3326us total) trans 4294967446 rc 301/301 00000100:00100000:2.0:1787440297.501464:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 159 00000100:00100000:1.0:1787440297.506621:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440297.507606:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681319040 00000100:00100000:3.0:1787440297.507622:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681319040 00000100:00100000:3.0:1787440297.507695:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 44 00000100:00100000:3.0:1787440297.507708:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee079bae850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+47:11474:x1874266681319040:12345-192.168.206.58@tcp:35:lfs.0 00000100:00100000:3.0:1787440297.508657:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee079bae850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+48:11474:x1874266681319040:12345-192.168.206.58@tcp:35:lfs.0 Request processed in 942us (2041us total) trans 4294967447 rc 0/0 00000100:00100000:3.0:1787440297.508670:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 44 00000100:00100000:1.0:1787440297.585677:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440297.585822:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681319296 00000100:00100000:0.0:1787440297.585834:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681319296 00000100:00100000:0.0:1787440297.585920:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 160 00000100:00100000:0.0:1787440297.585932:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee07f9f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+48:11480:x1874266681319296:12345-192.168.206.58@tcp:101:bash.0 00010000:00010000:0.0:1787440297.585965:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440297.585994:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf600/0x85f5fa77adf3cd9e lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fab14535dc623bb expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440297.586154:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce800/0x85f5fa77adf3cda5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440297.586171:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94600/0x85f5fa77adf3cd89 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc623ad expref: 49 pid: 6892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440297.586204:0:5849:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce800/0x85f5fa77adf3cda5 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440297.586247:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94600/0x85f5fa77adf3cd89 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc623ad expref: 49 pid: 6892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440297.586263:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94600/0x85f5fa77adf3cd89 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc623ad expref: 49 pid: 6892 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440297.586279:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee080327800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5849:1874266701245312:192.168.206.58@tcp:104: 00000100:00100000:0.0:1787440297.586416:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee0460eb480 going to sleep for 11 seconds 00000100:00100000:0.0:1787440297.591004:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee080327800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5849:1874266701245312:192.168.206.58@tcp:104: 00010000:00010000:0.0:1787440297.591078:0:5849:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce800/0x85f5fa77adf3cda5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440297.593135:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440297.594173:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681319424 00000100:00100000:3.0:1787440297.594189:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681319424 00010000:00010000:3.0:1787440297.594248:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94600/0x85f5fa77adf3cd89 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc623ad expref: 50 pid: 6892 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440297.594301:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 68 00000100:00100000:3.0:1787440297.594313:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee07f9f3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+50:2362:x1874266681319424:12345-192.168.206.58@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787440297.594334:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787440297.594342:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94600/0x85f5fa77adf3cd89 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc623ad expref: 50 pid: 6892 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440297.594357:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94600/0x85f5fa77adf3cd89 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc623ad expref: 50 pid: 6892 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440297.594386:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94600/0x85f5fa77adf3cd89 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc623ad expref: 50 pid: 6892 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440297.594650:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ee050ca1c00) 00010000:00010000:3.0:1787440297.594658:0:5836:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce800/0x85f5fa77adf3cda5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440297.594668:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce800/0x85f5fa77adf3cda5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440297.594676:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce800/0x85f5fa77adf3cda5 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440297.594705:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787440297.594944:0:5849:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce800/0x85f5fa77adf3cda5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440297.594954:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce800/0x85f5fa77adf3cda5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787440297.594978:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:0.0:1787440297.595211:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf600/0x85f5fa77adf3cd9e lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc623bb expref: 51 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440297.595229:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce800/0x85f5fa77adf3cda5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc623bb expref: 50 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440297.595253:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ee050ca1c00) 00010000:00010000:0.0:1787440297.595256:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787440297.595259:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee04cbce800, rc 0) 00000100:00100000:3.0:1787440297.595266:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee07f9f3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+50:2362:x1874266681319424:12345-192.168.206.58@tcp:103:ldlm_bl.0 Request processed in 955us (2149us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440297.595275:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 68 00000100:00100000:0.0:1787440297.595289:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee07f9f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+50:11480:x1874266681319296:12345-192.168.206.58@tcp:101:bash.0 Request processed in 9361us (9630us total) trans 4294967448 rc 0/0 00000100:00100000:0.0:1787440297.595296:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 160 00000100:00100000:2.0:1787440297.600708:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440297.601172:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681319680 00000100:00100000:0.0:1787440297.601185:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681319680 00000100:00100000:0.0:1787440297.601303:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 161 00000100:00100000:0.0:1787440297.601317:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee077ec1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+49:11480:x1874266681319680:12345-192.168.206.58@tcp:36:bash.0 00010000:00010000:0.0:1787440297.601824:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfe00/0x85f5fa77adf3cdb3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440297.601846:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfe00/0x85f5fa77adf3cdb3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440297.601878:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfe00/0x85f5fa77adf3cdb3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787440297.601939:0:5851:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967449 00000004:00010000:0.0:1787440297.601966:0:5851:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f32cf794 reply state 000000007685a124 transno 4294967450 ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfe00/0x85f5fa77adf3cdb3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440297.601976:0:5851:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787440297.602102:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee077ec1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+52:11480:x1874266681319680:12345-192.168.206.58@tcp:36:bash.0 Request processed in 786us (1406us total) trans 4294967450 rc 0/0 00000100:00100000:0.0:1787440297.602111:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 161 00000020:00080000:0.0:1787440297.602146:0:5851:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787440297.605593:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfe00/0x85f5fa77adf3cdb3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440297.605616:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfe00/0x85f5fa77adf3cdb3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440297.605624:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfe00/0x85f5fa77adf3cdb3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440297.605631:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee04cbcfe00 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:3.0:1787440297.605637:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfe00/0x85f5fa77adf3cdb3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440297.605646:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfe00/0x85f5fa77adf3cdb3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440297.605688:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ee050ca1c00) 00010000:00010000:3.0:1787440297.605691:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440297.605697:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfe00/0x85f5fa77adf3cdb3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440297.605704:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfe00/0x85f5fa77adf3cdb3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440297.611652:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440297.612143:0:6892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681319808 00000100:00100000:3.0:1787440297.612158:0:6892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681319808 00000100:00100000:3.0:1787440297.612235:0:6892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 162 00000100:00100000:3.0:1787440297.612246:0:6892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee080b46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+51:11480:x1874266681319808:12345-192.168.206.58@tcp:101:bash.0 00010000:00010000:3.0:1787440297.612278:0:6892:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440297.612304:0:6892:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94600/0x85f5fa77adf3cdba lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fab14535dc623c2 expref: -99 pid: 6892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440297.612441:0:6892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95200/0x85f5fa77adf3cdc1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440297.612459:0:6892:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce800/0x85f5fa77adf3cda5 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc623bb expref: 52 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440297.612468:0:6892:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95200/0x85f5fa77adf3cdc1 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440297.612532:0:6892:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce800/0x85f5fa77adf3cda5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc623bb expref: 52 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440297.612548:0:6892:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce800/0x85f5fa77adf3cda5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc623bb expref: 52 pid: 5849 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440297.612572:0:6892:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee0773fd500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6892:1874266701245440:192.168.206.58@tcp:104: 00000100:00100000:3.0:1787440297.612671:0:6892:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee047ed23c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787440297.616882:0:6892:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee0773fd500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6892:1874266701245440:192.168.206.58@tcp:104: 00010000:00010000:3.0:1787440297.616920:0:6892:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95200/0x85f5fa77adf3cdc1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440297.616976:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440297.617128:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681319936 00000100:00100000:3.0:1787440297.617136:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681319936 00010000:00010000:3.0:1787440297.617180:0:6711:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce800/0x85f5fa77adf3cda5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc623bb expref: 53 pid: 5849 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440297.617219:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 69 00000100:00100000:3.0:1787440297.617229:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee07f9f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+53:2363:x1874266681319936:12345-192.168.206.58@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787440297.617248:0:6711:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787440297.617256:0:6711:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce800/0x85f5fa77adf3cda5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc623bb expref: 53 pid: 5849 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440297.617269:0:6711:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce800/0x85f5fa77adf3cda5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc623bb expref: 53 pid: 5849 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440297.617298:0:6711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce800/0x85f5fa77adf3cda5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc623bb expref: 53 pid: 5849 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440297.617316:0:6711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ee050ca1c00) 00010000:00010000:3.0:1787440297.617322:0:6711:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95200/0x85f5fa77adf3cdc1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440297.617351:0:6711:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95200/0x85f5fa77adf3cdc1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440297.617359:0:6711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95200/0x85f5fa77adf3cdc1 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440297.617395:0:6711:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787440297.617478:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee07f9f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+52:2363:x1874266681319936:12345-192.168.206.58@tcp:103:ldlm_bl.0 Request processed in 249us (731us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440297.617487:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 69 00010000:00010000:1.0:1787440297.618351:0:6892:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95200/0x85f5fa77adf3cdc1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440297.618362:0:6892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95200/0x85f5fa77adf3cdc1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787440297.618421:0:6892:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1787440297.618437:0:6892:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787440297.618467:0:6892:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95200/0x85f5fa77adf3cdc1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440297.618529:0:6892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94600/0x85f5fa77adf3cdba lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc623c2 expref: 52 pid: 6892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440297.618550:0:6892:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95200/0x85f5fa77adf3cdc1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc623c2 expref: 51 pid: 6892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440297.618558:0:6892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ee050ca1c00) 00010000:00010000:1.0:1787440297.618561:0:6892:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787440297.618563:0:6892:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee049e95200, rc 0) 00000100:00100000:1.0:1787440297.618611:0:6892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee080b46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+51:11480:x1874266681319808:12345-192.168.206.58@tcp:101:bash.0 Request processed in 6367us (6973us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440297.618619:0:6892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 162 00000100:00100000:1.0:1787440297.624148:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:2.0:1787440297.624278:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681320192 00000100:00100000:2.0:1787440297.624292:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681320192 00000100:00100000:2.0:1787440297.624402:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 45 00000100:00100000:2.0:1787440297.624416:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee07f9f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+51:11480:x1874266681320192:12345-192.168.206.58@tcp:35:bash.0 00000100:00100000:2.0:1787440297.624893:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee07f9f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+52:11480:x1874266681320192:12345-192.168.206.58@tcp:35:bash.0 Request processed in 478us (758us total) trans 4294967451 rc 0/0 00000100:00100000:2.0:1787440297.624913:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 45 00000100:00100000:2.0:1787440297.735918:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440297.736651:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681320448 00000100:00100000:0.0:1787440297.736666:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681320448 00000100:00100000:0.0:1787440297.736755:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 163 00000100:00100000:0.0:1787440297.736767:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee080b47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+52:11490:x1874266681320448:12345-192.168.206.58@tcp:101:lfs.0 00010000:00010000:0.0:1787440297.736797:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440297.736824:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf600/0x85f5fa77adf3cdc8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fab14535dc623c9 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787440297.736978:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:0.0:1787440297.737137:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf600/0x85f5fa77adf3cdc8 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc623c9 expref: 54 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440297.737154:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ee054b3cb00) 00010000:00010000:0.0:1787440297.737157:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787440297.737162:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf600/0x85f5fa77adf3cdc8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc623c9 expref: 54 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440297.737179:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee04cbcf600, rc 0) 00000100:00100000:0.0:1787440297.737269:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee080b47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+53:11490:x1874266681320448:12345-192.168.206.58@tcp:101:lfs.0 Request processed in 504us (1363us total) trans 4294967452 rc 301/301 00000100:00100000:0.0:1787440297.737278:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 163 00000100:00100000:1.0:1787440297.742246:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440297.742351:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681320576 00000100:00100000:0.0:1787440297.742364:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681320576 00000100:00100000:0.0:1787440297.742462:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 164 00000100:00100000:0.0:1787440297.742473:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee06e6cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+53:11490:x1874266681320576:12345-192.168.206.58@tcp:34:lfs.0 00010000:00010000:0.0:1787440297.742624:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfc00/0x85f5fa77adf3cdd6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440297.742660:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfc00/0x85f5fa77adf3cdd6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440297.742677:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfc00/0x85f5fa77adf3cdd6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440297.742697:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf400/0x85f5fa77adf3cddd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440297.742705:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf400/0x85f5fa77adf3cddd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440297.742712:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf400/0x85f5fa77adf3cddd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440297.742843:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf200/0x85f5fa77adf3cde4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440297.742853:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf200/0x85f5fa77adf3cde4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440297.742874:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf200/0x85f5fa77adf3cde4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787440297.742926:0:5849:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf200/0x85f5fa77adf3cde4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440297.742942:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfc00/0x85f5fa77adf3cdd6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440297.742948:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfc00/0x85f5fa77adf3cdd6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440297.742967:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfc00/0x85f5fa77adf3cdd6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440297.742973:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee04cbcfc00 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:0.0:1787440297.742979:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfc00/0x85f5fa77adf3cdd6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440297.742988:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfc00/0x85f5fa77adf3cdd6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440297.743004:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8ee05132ea00) 00010000:00010000:0.0:1787440297.743007:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440297.743012:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfc00/0x85f5fa77adf3cdd6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440297.743249:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfc00/0x85f5fa77adf3cdd6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440297.743266:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf400/0x85f5fa77adf3cddd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440297.743273:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf400/0x85f5fa77adf3cddd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440297.743280:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf400/0x85f5fa77adf3cddd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440297.743285:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee04cbcf400 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:0.0:1787440297.743288:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf400/0x85f5fa77adf3cddd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440297.743309:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf400/0x85f5fa77adf3cddd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440297.743319:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8ee050ca1500) 00010000:00010000:0.0:1787440297.743321:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440297.743324:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf400/0x85f5fa77adf3cddd lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440297.743331:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf400/0x85f5fa77adf3cddd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440297.743345:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf200/0x85f5fa77adf3cde4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440297.743351:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf200/0x85f5fa77adf3cde4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440297.743357:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf200/0x85f5fa77adf3cde4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440297.743362:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee04cbcf200 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:0.0:1787440297.743365:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf200/0x85f5fa77adf3cde4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440297.743371:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf200/0x85f5fa77adf3cde4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440297.743377:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ee050ca1c00) 00010000:00010000:0.0:1787440297.743379:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440297.743382:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf200/0x85f5fa77adf3cde4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440297.743395:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf200/0x85f5fa77adf3cde4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440297.743531:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee06e6cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+53:11490:x1874266681320576:12345-192.168.206.58@tcp:34:lfs.0 Request processed in 1057us (1299us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440297.743540:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 164 00000100:00100000:1.0:1787440297.749806:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440297.750130:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681320832 00000100:00100000:3.0:1787440297.750143:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681320832 00000100:00100000:3.0:1787440297.750216:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 46 00000100:00100000:3.0:1787440297.750228:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee06e6ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+53:11490:x1874266681320832:12345-192.168.206.58@tcp:35:lfs.0 00000100:00100000:3.0:1787440297.750608:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee06e6ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+54:11490:x1874266681320832:12345-192.168.206.58@tcp:35:lfs.0 Request processed in 381us (814us total) trans 4294967453 rc 0/0 00000100:00100000:3.0:1787440297.750617:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 46 00000100:00100000:3.0:1787440297.821115:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440297.821262:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681321088 00000100:00100000:0.0:1787440297.821274:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681321088 00000100:00100000:0.0:1787440297.821345:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 165 00000100:00100000:0.0:1787440297.821357:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee0773fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+54:11493:x1874266681321088:12345-192.168.206.58@tcp:101:lfs.0 00010000:00010000:0.0:1787440297.821389:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440297.821415:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf200/0x85f5fa77adf3cdeb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fab14535dc623d0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440297.821589:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf400/0x85f5fa77adf3cdf2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440297.821606:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf400/0x85f5fa77adf3cdf2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440297.821619:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf400/0x85f5fa77adf3cdf2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440297.821634:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfc00/0x85f5fa77adf3cdf9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440297.821641:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfc00/0x85f5fa77adf3cdf9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440297.821663:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfc00/0x85f5fa77adf3cdf9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440297.821826:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf600/0x85f5fa77adf3ce00 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440297.821837:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf600/0x85f5fa77adf3ce00 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440297.821845:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf600/0x85f5fa77adf3ce00 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787440297.821855:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1787440297.821981:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf400/0x85f5fa77adf3cdf2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440297.821990:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf400/0x85f5fa77adf3cdf2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440297.821997:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf400/0x85f5fa77adf3cdf2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440297.822003:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee04cbcf400 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:0.0:1787440297.822008:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf400/0x85f5fa77adf3cdf2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440297.822016:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf400/0x85f5fa77adf3cdf2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440297.822030:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8ee05132ea00) 00010000:00010000:0.0:1787440297.822033:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440297.822046:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf400/0x85f5fa77adf3cdf2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440297.822052:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf400/0x85f5fa77adf3cdf2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440297.822080:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfc00/0x85f5fa77adf3cdf9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440297.822088:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfc00/0x85f5fa77adf3cdf9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440297.822095:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfc00/0x85f5fa77adf3cdf9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440297.822100:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee04cbcfc00 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:0.0:1787440297.822103:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfc00/0x85f5fa77adf3cdf9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440297.822109:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfc00/0x85f5fa77adf3cdf9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440297.822118:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8ee050ca1500) 00010000:00010000:0.0:1787440297.822120:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440297.822124:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfc00/0x85f5fa77adf3cdf9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440297.822130:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfc00/0x85f5fa77adf3cdf9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440297.822180:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf200/0x85f5fa77adf3cdeb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc623d0 expref: 57 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440297.822207:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf600/0x85f5fa77adf3ce00 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc623d0 expref: 56 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440297.822215:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ee050ca1c00) 00010000:00010000:0.0:1787440297.822217:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787440297.822220:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee04cbcf600, rc 0) 00000100:00100000:0.0:1787440297.822286:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee0773fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+56:11493:x1874266681321088:12345-192.168.206.58@tcp:101:lfs.0 Request processed in 930us (1186us total) trans 4294967454 rc 0/0 00000100:00100000:0.0:1787440297.822293:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 165 00000100:00100000:1.0:1787440297.826574:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:1.0:1787440297.826626:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:2.0:1787440297.826724:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681321344 00000100:00100000:2.0:1787440297.826737:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681321344 00000100:00100000:2.0:1787440297.826816:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 12 00000100:00100000:2.0:1787440297.826827:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee077cf2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+56:2363:x1874266681321344:12345-192.168.206.58@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787440297.826848:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787440297.826879:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf600/0x85f5fa77adf3ce00 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc623d0 expref: 56 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440297.826904:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ee050ca1c00) 00010000:00010000:2.0:1787440297.826909:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787440297.826981:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee077cf2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+55:2363:x1874266681321344:12345-192.168.206.58@tcp:103:ldlm_bl.0 Request processed in 155us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440297.826989:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 12 00000100:00100000:0.0:1787440297.827101:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681321216 00000100:00100000:0.0:1787440297.827105:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681321216 00000100:00100000:0.0:1787440297.827138:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 166 00000100:00100000:0.0:1787440297.827146:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee077cf1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+55:11493:x1874266681321216:12345-192.168.206.58@tcp:54:lfs.0 00010000:00010000:0.0:1787440297.827217:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce200/0x85f5fa77adf3ce0e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440297.827234:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce200/0x85f5fa77adf3ce0e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440297.827246:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce200/0x85f5fa77adf3ce0e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440297.827278:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce200/0x85f5fa77adf3ce0e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440297.827285:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce200/0x85f5fa77adf3ce0e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440297.827307:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce200/0x85f5fa77adf3ce0e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440297.827313:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee04cbce200 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:0.0:1787440297.827318:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce200/0x85f5fa77adf3ce0e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440297.827326:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce200/0x85f5fa77adf3ce0e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440297.827336:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ee050ca1c00) 00010000:00010000:0.0:1787440297.827339:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787440297.827343:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce200/0x85f5fa77adf3ce0e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440297.827349:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce200/0x85f5fa77adf3ce0e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440297.827391:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee077cf1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+55:11493:x1874266681321216:12345-192.168.206.58@tcp:54:lfs.0 Request processed in 247us (831us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440297.827399:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 166 00000100:00100000:1.0:1787440297.830977:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440297.831331:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681321600 00000100:00100000:3.0:1787440297.831345:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681321600 00000100:00100000:3.0:1787440297.831466:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 47 00000100:00100000:3.0:1787440297.831477:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee077cf3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+55:11493:x1874266681321600:12345-192.168.206.58@tcp:35:lfs.0 00000100:00100000:3.0:1787440297.831833:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee077cf3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+56:11493:x1874266681321600:12345-192.168.206.58@tcp:35:lfs.0 Request processed in 356us (866us total) trans 4294967455 rc 0/0 00000100:00100000:3.0:1787440297.831842:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 47 00000100:00100000:1.0:1787440297.964351:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440297.964466:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681321856 00000100:00100000:0.0:1787440297.964479:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681321856 00000100:00100000:0.0:1787440297.964574:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 167 00000100:00100000:0.0:1787440297.964586:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee077cf1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+56:11511:x1874266681321856:12345-192.168.206.58@tcp:101:cat.0 00010000:00010000:0.0:1787440297.964617:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440297.964644:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce200/0x85f5fa77adf3ce15 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fab14535dc623d7 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440297.964809:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf200/0x85f5fa77adf3ce1c lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440297.964826:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf200/0x85f5fa77adf3ce1c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440297.964839:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf200/0x85f5fa77adf3ce1c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787440297.964852:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1787440297.965002:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce200/0x85f5fa77adf3ce15 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc623d7 expref: 59 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440297.965037:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf200/0x85f5fa77adf3ce1c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc623d7 expref: 58 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440297.965047:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ee050ca1c00) 00010000:00010000:0.0:1787440297.965051:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1787440297.965054:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee04cbcf200, rc 0) 00000100:00100000:0.0:1787440297.965139:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee077cf1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+58:11511:x1874266681321856:12345-192.168.206.58@tcp:101:cat.0 Request processed in 555us (801us total) trans 4294967456 rc 0/0 00000100:00100000:0.0:1787440297.965149:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 167 00000100:00100000:1.0:1787440298.006019:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440298.006254:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681321984 00000100:00100000:0.0:1787440298.006267:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681321984 00000100:00100000:0.0:1787440298.006337:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 168 00000100:00100000:0.0:1787440298.006347:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee077cf2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+58:11512:x1874266681321984:12345-192.168.206.58@tcp:101:lfs.0 00010000:00010000:0.0:1787440298.006376:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440298.006419:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce200/0x85f5fa77adf3ce2a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fab14535dc623de expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440298.006609:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfc00/0x85f5fa77adf3ce31 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440298.006627:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfc00/0x85f5fa77adf3ce31 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440298.006678:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfc00/0x85f5fa77adf3ce31 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787440298.006758:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:0.0:1787440298.006762:0:5849:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787440298.006785:0:5849:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfc00/0x85f5fa77adf3ce31 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440298.006814:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce200/0x85f5fa77adf3ce2a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc623de expref: 60 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440298.006920:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfc00/0x85f5fa77adf3ce31 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc623de expref: 59 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440298.006930:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8ee05132ea00) 00010000:00010000:0.0:1787440298.006933:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787440298.006937:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee04cbcfc00, rc 0) 00000100:00100000:0.0:1787440298.007147:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee077cf2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+59:11512:x1874266681321984:12345-192.168.206.58@tcp:101:lfs.0 Request processed in 799us (1139us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440298.007156:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 168 00000100:00100000:1.0:1787440298.013186:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:2.0:1787440298.013289:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681322368 00000100:00100000:2.0:1787440298.013301:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681322368 00000100:00100000:2.0:1787440298.013371:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 48 00000100:00100000:2.0:1787440298.013383:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee077cf0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+59:11512:x1874266681322368:12345-192.168.206.58@tcp:35:lfs.0 00000100:00100000:2.0:1787440298.017188:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee077cf0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+60:11512:x1874266681322368:12345-192.168.206.58@tcp:35:lfs.0 Request processed in 3794us (4004us total) trans 4294967457 rc 0/0 00000100:00100000:2.0:1787440298.017204:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 48 00000100:00100000:3.0:1787440298.020923:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:1.0:1787440298.021223:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681322496 00000100:00100000:1.0:1787440298.021236:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681322496 00000100:00100000:1.0:1787440298.021368:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 13 00000100:00100000:1.0:1787440298.021379:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee06e7e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+60:11512:x1874266681322496:12345-192.168.206.58@tcp:103:lfs.0 00010000:00010000:1.0:1787440298.021399:0:6711:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1787440298.021444:0:6711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95200/0x85f5fa77adf3cdc1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc623c2 expref: 60 pid: 6892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440298.021473:0:6711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf200/0x85f5fa77adf3ce1c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc623d7 expref: 59 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440298.021487:0:6711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcee00/0x85f5fa77adf3cccc lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62383 expref: 58 pid: 6892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440298.021556:0:6711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ee050ca1c00) 00010000:00010000:1.0:1787440298.021570:0:6711:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787440298.021648:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee06e7e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+57:11512:x1874266681322496:12345-192.168.206.58@tcp:103:lfs.0 Request processed in 270us (739us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440298.021657:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 13 00000100:00100000:1.0:1787440298.024691:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:2.0:1787440298.024962:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681322624 00000100:00100000:2.0:1787440298.024974:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681322624 00000100:00100000:2.0:1787440298.025054:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 169 00000100:00100000:2.0:1787440298.025072:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee077cf2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+57:11512:x1874266681322624:12345-192.168.206.58@tcp:58:lfs.0 00010000:00010000:2.0:1787440298.025222:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86fc00/0x85f5fa77adf3ce38 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440298.025243:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86fc00/0x85f5fa77adf3ce38 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440298.025258:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86fc00/0x85f5fa77adf3ce38 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787440298.025482:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:2.0:1787440298.025625:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee077cf2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+57:11512:x1874266681322624:12345-192.168.206.58@tcp:58:lfs.0 Request processed in 560us (949us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440298.025635:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 169 00000100:00100000:3.0:1787440298.042922:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440298.042978:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440298.043011:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440298.043075:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440298.043116:0:6892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681323136 00000100:00100000:3.0:1787440298.043127:0:6892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681323136 00000100:00080000:3.0:1787440298.043165:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787440298.043224:0:6892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 156 00000100:00100000:3.0:1787440298.043235:0:6892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee0773fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fde7b340-91f7-42a0-a1a3-5665ea2691c9+5:2361:x1874266681323136:12345-192.168.206.58@tcp:400:kworker.0 00000100:00100000:3.0:1787440298.043329:0:6892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee0773fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fde7b340-91f7-42a0-a1a3-5665ea2691c9+5:2361:x1874266681323136:12345-192.168.206.58@tcp:400:kworker.0 Request processed in 96us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440298.043338:0:6892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 156 00000100:00100000:2.0:1787440298.043591:0:12016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681323008 00000100:00100000:2.0:1787440298.043596:0:12016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681323008 00000100:00100000:2.0:1787440298.043631:0:12016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681322880 00000100:00100000:2.0:1787440298.043634:0:12016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681322880 00000100:00100000:2.0:1787440298.043657:0:12016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 92 00000100:00100000:2.0:1787440298.043664:0:12016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee0773fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+6:2361:x1874266681323008:12345-192.168.206.58@tcp:400:kworker.0 00000100:00100000:2.0:1787440298.043702:0:12016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee0773fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+6:2361:x1874266681323008:12345-192.168.206.58@tcp:400:kworker.0 Request processed in 38us (723us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440298.043708:0:12016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 92 00000100:00100000:2.0:1787440298.043723:0:12016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 93 00000100:00100000:2.0:1787440298.043730:0:12016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee0773fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+7:2361:x1874266681322880:12345-192.168.206.58@tcp:400:kworker.0 00000100:00100000:2.0:1787440298.043762:0:12016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee0773fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+7:2361:x1874266681322880:12345-192.168.206.58@tcp:400:kworker.0 Request processed in 26us (744us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440298.043768:0:12016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 93 00000100:00080000:3.0:1787440298.044286:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787440298.044293:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787440298.044641:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681322752 00000100:00100000:0.0:1787440298.044659:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681322752 00000100:00100000:0.0:1787440298.044710:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 298 00000100:00100000:0.0:1787440298.044719:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee06d273c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+13:2361:x1874266681322752:12345-192.168.206.58@tcp:400:kworker.0 00000100:00100000:0.0:1787440298.044788:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee06d273c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+13:2361:x1874266681322752:12345-192.168.206.58@tcp:400:kworker.0 Request processed in 71us (1881us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440298.044796:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 298 00000100:00100000:3.0:1787440298.048824:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:2.0:1787440298.048954:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681323264 00000100:00100000:2.0:1787440298.048967:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681323264 00000100:00100000:2.0:1787440298.049052:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 170 00000100:00100000:2.0:1787440298.049077:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee0773fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+57:11514:x1874266681323264:12345-192.168.206.58@tcp:101:lfs.0 00010000:00010000:2.0:1787440298.049104:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440298.049130:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86ec00/0x85f5fa77adf3ce3f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fab14535dc623e5 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440298.049217:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e200/0x85f5fa77adf3ce46 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440298.049234:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e200/0x85f5fa77adf3ce46 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440298.049247:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e200/0x85f5fa77adf3ce46 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440298.049264:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f000/0x85f5fa77adf3ce4d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440298.049271:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f000/0x85f5fa77adf3ce4d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440298.049278:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f000/0x85f5fa77adf3ce4d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440298.049394:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e400/0x85f5fa77adf3ce54 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440298.049404:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e400/0x85f5fa77adf3ce54 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440298.049424:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e400/0x85f5fa77adf3ce54 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787440298.049469:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1787440298.049474:0:5851:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787440298.049614:0:5851:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e400/0x85f5fa77adf3ce54 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440298.049635:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e400/0x85f5fa77adf3ce54 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440298.049644:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e200/0x85f5fa77adf3ce46 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440298.049652:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e200/0x85f5fa77adf3ce46 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440298.049659:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e200/0x85f5fa77adf3ce46 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440298.049666:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee07f86e200 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:2.0:1787440298.049670:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e200/0x85f5fa77adf3ce46 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440298.049679:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e200/0x85f5fa77adf3ce46 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440298.049693:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8ee05132ea00) 00010000:00010000:2.0:1787440298.049697:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440298.049707:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e200/0x85f5fa77adf3ce46 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440298.049724:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e200/0x85f5fa77adf3ce46 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440298.049743:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f000/0x85f5fa77adf3ce4d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440298.049749:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f000/0x85f5fa77adf3ce4d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440298.049754:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f000/0x85f5fa77adf3ce4d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440298.049758:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee07f86f000 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:2.0:1787440298.049762:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f000/0x85f5fa77adf3ce4d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440298.049767:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f000/0x85f5fa77adf3ce4d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440298.049774:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8ee054b3c400) 00010000:00010000:2.0:1787440298.049776:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440298.049779:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f000/0x85f5fa77adf3ce4d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440298.049784:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f000/0x85f5fa77adf3ce4d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440298.049820:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86ec00/0x85f5fa77adf3ce3f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc623e5 expref: 59 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440298.049833:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e400/0x85f5fa77adf3ce54 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc623e5 expref: 58 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440298.049846:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ee054b3cd00) 00010000:00010000:2.0:1787440298.049849:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787440298.049851:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee07f86e400, rc 0) 00000100:00100000:2.0:1787440298.049933:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee0773fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+58:11514:x1874266681323264:12345-192.168.206.58@tcp:101:lfs.0 Request processed in 868us (1122us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440298.049941:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 170 00010000:00010000:3.0:1787440298.076841:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1787440298.407664:0:6891:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 396778167247ns, next at 397778164403ns, rc = 0 00000100:00100000:3.0:1787440298.407694:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787440298.407721:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee0773fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874266701245568:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787440298.407814:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440298.407898:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701245568 00000100:00100000:3.0:1787440298.407907:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701245568 00000100:00100000:3.0:1787440298.407978:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787440298.407988:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee0773ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1874266701245568:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787440298.408052:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787440298.408131:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee0773ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1874266701245568:12345-0@lo:13:osp-pre-0-0.0 Request processed in 142us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440298.408153:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00080000:3.0:1787440298.408181:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787440298.408241:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee0773fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874266701245568:0@lo:13:osp-pre-0-0.0 00000040:00080000:0.0:1787440298.468312:0:11682:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787440298.468328:0:11682:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787440298.468393:0:11682:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1787440298.468401:0:11682:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787440298.468623:0:11682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee080327800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11682:1874266701245696:192.168.206.58@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787440298.469046:0:11682:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee0460eb480 going to sleep for 11 seconds 00000100:00100000:0.0:1787440298.480047:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440298.485792:0:11682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee080327800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11682:1874266701245696:192.168.206.58@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787440298.486050:0:6892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681323392 00000100:00100000:3.0:1787440298.486060:0:6892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681323392 00000100:00100000:3.0:1787440298.486274:0:6892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 171 00000100:00100000:3.0:1787440298.486286:0:6892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee080326300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+58:11525:x1874266681323392:12345-192.168.206.58@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787440298.486328:0:6892:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787440298.486619:0:6892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee080326300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+58:11525:x1874266681323392:12345-192.168.206.58@tcp:53:lhsmtool_posix.0 Request processed in 335us (6585us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440298.486628:0:6892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 171 00000100:00100000:3.0:1787440298.499653:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440298.499710:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681323520 00000100:00100000:3.0:1787440298.499722:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681323520 00000100:00100000:3.0:1787440298.499793:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 172 00000100:00100000:3.0:1787440298.499807:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee0773fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+58:11525:x1874266681323520:12345-192.168.206.58@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1787440298.499909:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94000/0x85f5fa77adf3ce5b lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440298.499930:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94000/0x85f5fa77adf3ce5b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440298.499945:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94000/0x85f5fa77adf3ce5b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440298.499981:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94800/0x85f5fa77adf3ce62 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440298.499989:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94800/0x85f5fa77adf3ce62 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440298.499996:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94800/0x85f5fa77adf3ce62 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440298.500030:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95800/0x85f5fa77adf3ce69 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440298.500040:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95800/0x85f5fa77adf3ce69 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440298.500047:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95800/0x85f5fa77adf3ce69 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787440298.500105:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1787440298.500111:0:5851:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787440298.500306:0:5851:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95800/0x85f5fa77adf3ce69 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440298.500323:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94000/0x85f5fa77adf3ce5b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440298.500330:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94000/0x85f5fa77adf3ce5b lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440298.500337:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94000/0x85f5fa77adf3ce5b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440298.500355:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee049e94000 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:3.0:1787440298.500361:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94000/0x85f5fa77adf3ce5b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440298.500370:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94000/0x85f5fa77adf3ce5b lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440298.500385:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ee05132e100) 00010000:00010000:3.0:1787440298.500389:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440298.500394:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94000/0x85f5fa77adf3ce5b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440298.500401:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94000/0x85f5fa77adf3ce5b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440298.500422:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94800/0x85f5fa77adf3ce62 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440298.500428:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94800/0x85f5fa77adf3ce62 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440298.500434:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94800/0x85f5fa77adf3ce62 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440298.500439:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee049e94800 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:3.0:1787440298.500442:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94800/0x85f5fa77adf3ce62 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440298.500448:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94800/0x85f5fa77adf3ce62 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440298.500471:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff8ee0460cc200) 00010000:00010000:3.0:1787440298.500473:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440298.500476:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94800/0x85f5fa77adf3ce62 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440298.500482:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94800/0x85f5fa77adf3ce62 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440298.500526:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95800/0x85f5fa77adf3ce69 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440298.500533:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95800/0x85f5fa77adf3ce69 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440298.500538:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95800/0x85f5fa77adf3ce69 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440298.500543:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee049e95800 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:3.0:1787440298.500546:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95800/0x85f5fa77adf3ce69 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440298.500551:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95800/0x85f5fa77adf3ce69 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440298.500559:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ee054b3cd00) 00010000:00010000:3.0:1787440298.500561:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440298.500564:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95800/0x85f5fa77adf3ce69 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440298.500569:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95800/0x85f5fa77adf3ce69 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440298.500787:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee0773fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+58:11525:x1874266681323520:12345-192.168.206.58@tcp:34:lhsmtool_posix.0 Request processed in 980us (1156us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440298.500797:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 172 00000100:00100000:1.0:1787440298.512730:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:2.0:1787440298.512943:0:6892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681323776 00000100:00100000:2.0:1787440298.512956:0:6892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681323776 00000100:00100000:2.0:1787440298.514243:0:6892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 173 00000100:00100000:2.0:1787440298.514262:0:6892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee077cf2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+58:11525:x1874266681323776:12345-192.168.206.58@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787440298.514290:0:6892:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440298.514316:0:6892:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86ee00/0x85f5fa77adf3ce70 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fab14535dc623ec expref: -99 pid: 6892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440298.514446:0:6892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e200/0x85f5fa77adf3ce77 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440298.514463:0:6892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e200/0x85f5fa77adf3ce77 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440298.514477:0:6892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e200/0x85f5fa77adf3ce77 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787440298.514518:0:6892:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1787440298.514816:0:6892:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e200/0x85f5fa77adf3ce77 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440298.514826:0:6892:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e200/0x85f5fa77adf3ce77 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440298.514843:0:6892:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e200/0x85f5fa77adf3ce77 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440298.514850:0:6892:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee07f86e200 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:2.0:1787440298.514856:0:6892:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e200/0x85f5fa77adf3ce77 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440298.514864:0:6892:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e200/0x85f5fa77adf3ce77 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440298.514879:0:6892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ee054b3cd00) 00010000:00010000:2.0:1787440298.514883:0:6892:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787440298.514887:0:6892:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e200/0x85f5fa77adf3ce77 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440298.514893:0:6892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e200/0x85f5fa77adf3ce77 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440298.514943:0:6892:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86ee00/0x85f5fa77adf3ce70 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc623ec expref: 60 pid: 6892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440298.514954:0:6892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ee05132e100) 00010000:00010000:2.0:1787440298.514956:0:6892:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787440298.514960:0:6892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86ee00/0x85f5fa77adf3ce70 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc623ec expref: 60 pid: 6892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440298.514969:0:6892:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee07f86ee00, rc 0) 00000100:00100000:2.0:1787440298.515055:0:6892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee077cf2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+59:11525:x1874266681323776:12345-192.168.206.58@tcp:101:lhsmtool_posix.0 Request processed in 798us (2339us total) trans 4294967458 rc 301/301 00000100:00100000:2.0:1787440298.515082:0:6892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 173 00000100:00100000:0.0:1787440298.525318:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440298.525398:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681323904 00000100:00100000:3.0:1787440298.525411:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681323904 00000100:00100000:0.0:1787440298.525895:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 174 00000100:00100000:0.0:1787440298.525909:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee080324000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+59:11525:x1874266681323904:12345-192.168.206.58@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787440298.525958:0:5851:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787440298.526284:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee080324000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+59:11525:x1874266681323904:12345-192.168.206.58@tcp:53:lhsmtool_posix.0 Request processed in 377us (976us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440298.526294:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 174 00000001:00080000:3.0:1787440298.529076:0:5871:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967456 is committed 00000001:00080000:3.0:1787440298.529161:0:5871:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967457 is committed 00000004:00080000:3.0:1787440298.529182:0:5871:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:3.0:1787440298.529206:0:5871:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8edf41152c00 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:3.0:1787440298.529213:0:5871:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8ee047de1a00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8edf41152900 00000020:00080000:3.0:1787440298.529216:0:5871:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8ee04caa7b00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8ee077284c00 00000100:00100000:0.0:1787440298.529541:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787440298.529569:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee080325880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1874266701245824:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1787440298.529670:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440298.529771:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701245824 00000100:00100000:0.0:1787440298.529779:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701245824 00000100:00100000:0.0:1787440298.529835:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787440298.529862:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee080325c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3310:x1874266701245824:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1787440298.529896:0:6698:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:4 count 1 00002000:00010000:0.0:1787440298.529939:0:6698:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a8a2ca8, atime: 0x6a8a2ca8, ctime: 0x6a8a2ca8, blocks: 0x1 00010000:00010000:0.0:1787440298.529951:0:6698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000061934086/0x85f5fa77adf3ce85 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440298.529972:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=396s v=(0 0) 00010000:00010000:0.0:1787440298.529977:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787440298.529985:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000061934086/0x85f5fa77adf3ce85 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440298.530006:0:6698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000061934086/0x85f5fa77adf3ce85 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440298.530018:0:6698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000061934086/0x85f5fa77adf3ce85 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440298.530026:0:6698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000061934086/0x85f5fa77adf3ce85 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440298.530049:0:6698:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000020:00080000:2.0:1787440298.530734:0:5882:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:2.0:1787440298.530896:0:5882:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:0.0:1787440298.531559:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee080325c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3310:x1874266701245824:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1692us (1883us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1787440298.531572:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000004:00080000:2.0:1787440298.531887:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8ee080325880/2, rc 0, transno 4294967307 00000100:00100000:2.0:1787440298.531895:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee080325880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1874266701245824:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1787440298.532541:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787440298.532553:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000061934086/0x85f5fa77adf3ce85 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440298.532567:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee04cbce600 already unused, calling callback (ffffffffc15b52a0) 00010000:00010000:1.0:1787440298.532572:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000061934086/0x85f5fa77adf3ce85 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440298.532584:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000061934086/0x85f5fa77adf3ce85 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440298.532608:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000061934086/0x85f5fa77adf3ce85 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440298.532616:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000061934086/0x85f5fa77adf3ce85 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440298.532651:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787440298.532653:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787440298.532655:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787440298.541630:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440298.541681:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681324160 00000100:00100000:3.0:1787440298.541694:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681324160 00000100:00100000:3.0:1787440298.541769:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 175 00000100:00100000:3.0:1787440298.541781:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee0773fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+17:11525:x1874266681324160:12345-192.168.206.58@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787440298.541808:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440298.541812:0:5849:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787440298.541845:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfc00/0x85f5fa77adf3ce31 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc623de expref: 17 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440298.541867:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8ee05132ea00) 00010000:00010000:3.0:1787440298.541881:0:5849:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787440298.541900:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95800/0x85f5fa77adf3ce8c lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fab14535dc623f3 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787440298.549611:0:5849:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:1.0:1787440298.551333:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e400/0x85f5fa77adf3ce93 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440298.551359:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e400/0x85f5fa77adf3ce93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440298.551384:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e400/0x85f5fa77adf3ce93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440298.551832:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95800/0x85f5fa77adf3ce8c lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc623f3 expref: 19 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440298.551856:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e400/0x85f5fa77adf3ce93 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc623f3 expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440298.551867:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8ee05132e800) 00010000:00010000:1.0:1787440298.551871:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787440298.551874:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee07fb9e400, rc 0) 00000100:00100000:1.0:1787440298.551960:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee0773fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+18:11525:x1874266681324160:12345-192.168.206.58@tcp:101:lhsmtool_posix.0 Request processed in 10182us (10343us total) trans 4294967459 rc 0/0 00000100:00100000:1.0:1787440298.551970:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 175 00000100:00100000:1.0:1787440298.563393:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440298.563533:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681324416 00000100:00100000:0.0:1787440298.563547:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681324416 00000100:00100000:0.0:1787440298.563619:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 176 00000100:00100000:0.0:1787440298.563639:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee077cf0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+18:11525:x1874266681324416:12345-192.168.206.58@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787440298.563719:0:5851:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787440298.563765:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e400/0x85f5fa77adf3ce93 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc623f3 expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440298.563788:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8ee05132e800) 00010000:00010000:0.0:1787440298.563800:0:5851:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787440298.563827:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce600/0x85f5fa77adf3cea1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440298.563842:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce600/0x85f5fa77adf3cea1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440298.563853:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce600/0x85f5fa77adf3cea1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440298.563868:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcec00/0x85f5fa77adf3cea8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x1b55b17d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440298.563875:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcec00/0x85f5fa77adf3cea8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x1b55b17d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440298.563882:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcec00/0x85f5fa77adf3cea8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x1b55b17d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440298.564687:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce600/0x85f5fa77adf3cea1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440298.564701:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce600/0x85f5fa77adf3cea1 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440298.564721:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce600/0x85f5fa77adf3cea1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440298.564728:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee04cbce600 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:0.0:1787440298.564734:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce600/0x85f5fa77adf3cea1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440298.564742:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce600/0x85f5fa77adf3cea1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440298.565539:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8ee05132ea00) 00010000:00010000:0.0:1787440298.565543:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440298.565549:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce600/0x85f5fa77adf3cea1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440298.565556:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce600/0x85f5fa77adf3cea1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440298.565571:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcec00/0x85f5fa77adf3cea8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x1b55b17d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440298.565579:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcec00/0x85f5fa77adf3cea8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x1b55b17d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440298.565585:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcec00/0x85f5fa77adf3cea8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x1b55b17d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440298.565591:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee04cbcec00 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:0.0:1787440298.565595:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcec00/0x85f5fa77adf3cea8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x1b55b17d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440298.565614:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcec00/0x85f5fa77adf3cea8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x1b55b17d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440298.565624:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x1b55b17d (ffff8ee050ca1700) 00010000:00010000:0.0:1787440298.565626:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440298.565630:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcec00/0x85f5fa77adf3cea8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x1b55b17d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440298.565636:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcec00/0x85f5fa77adf3cea8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x1b55b17d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440298.566033:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee077cf0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+17:11525:x1874266681324416:12345-192.168.206.58@tcp:36:lhsmtool_posix.0 Request processed in 2385us (2643us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787440298.566043:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 176 00000100:00100000:2.0:1787440298.571909:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440298.575236:0:6892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681324544 00000100:00100000:3.0:1787440298.575255:0:6892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681324544 00000100:00100000:2.0:1787440298.578238:0:6892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 177 00000100:00100000:2.0:1787440298.578256:0:6892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee080b45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+17:11525:x1874266681324544:12345-192.168.206.58@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787440298.578283:0:6892:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440298.578311:0:6892:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86ee00/0x85f5fa77adf3ceaf lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fab14535dc623fa expref: -99 pid: 6892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440298.578354:0:6892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e200/0x85f5fa77adf3ceb6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440298.578370:0:6892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e200/0x85f5fa77adf3ceb6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440298.578385:0:6892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e200/0x85f5fa77adf3ceb6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440298.578958:0:6892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86ee00/0x85f5fa77adf3ceaf lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc623fa expref: 19 pid: 6892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440298.578978:0:6892:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e200/0x85f5fa77adf3ceb6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc623fa expref: 18 pid: 6892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440298.579000:0:6892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8ee054b3c400) 00010000:00010000:2.0:1787440298.579003:0:6892:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787440298.579007:0:6892:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee07f86e200, rc 0) 00000100:00100000:2.0:1787440298.579709:0:6892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee080b45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+18:11525:x1874266681324544:12345-192.168.206.58@tcp:101:lhsmtool_posix.0 Request processed in 1452us (7806us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440298.579717:0:6892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 177 00000100:00100000:2.0:1787440298.582344:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440298.582580:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681324800 00000100:00100000:3.0:1787440298.582595:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681324800 00000100:00100000:3.0:1787440298.582667:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 178 00000100:00100000:3.0:1787440298.582678:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee080b46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+18:11525:x1874266681324800:12345-192.168.206.58@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787440298.582779:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94800/0x85f5fa77adf3cebd lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440298.582801:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94800/0x85f5fa77adf3cebd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440298.582815:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94800/0x85f5fa77adf3cebd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787440298.583194:0:5850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].6, 88 off8648 00000004:00080000:3.0:1787440298.583207:0:5850:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 396953713571ns, next at 397953710495ns, rc = 0 00000004:00010000:3.0:1787440298.583321:0:5850:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000073078b1e reply state 00000000eea11a35 transno 4294967460 ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94800/0x85f5fa77adf3cebd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440298.583332:0:5850:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787440298.583468:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee080b46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+20:11525:x1874266681324800:12345-192.168.206.58@tcp:36:lhsmtool_posix.0 Request processed in 779us (1121us total) trans 4294967460 rc 0/0 00000100:00100000:3.0:1787440298.583477:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 178 00010000:00010000:2.0:1787440298.586835:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94800/0x85f5fa77adf3cebd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440298.586855:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00010000:00010000:2.0:1787440298.586858:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94800/0x85f5fa77adf3cebd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440298.586866:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94800/0x85f5fa77adf3cebd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440298.586873:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee049e94800 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:2.0:1787440298.586879:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94800/0x85f5fa77adf3cebd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440298.586888:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94800/0x85f5fa77adf3cebd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440298.586908:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8ee054b3c400) 00010000:00010000:2.0:1787440298.586912:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787440298.586918:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94800/0x85f5fa77adf3cebd lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440298.586925:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94800/0x85f5fa77adf3cebd lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440298.587138:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681324928 00000100:00100000:0.0:1787440298.587151:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681324928 00000100:00100000:0.0:1787440298.587226:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 179 00000100:00100000:0.0:1787440298.587238:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee05fcddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+19:11525:x1874266681324928:12345-192.168.206.58@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787440298.587268:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440298.587291:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcec00/0x85f5fa77adf3cec4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fab14535dc62401 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440298.587368:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcec00/0x85f5fa77adf3cec4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62401 expref: 20 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440298.587383:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcec00/0x85f5fa77adf3cec4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62401 expref: 20 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440298.587417:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8ee054b3c400) 00010000:00010000:0.0:1787440298.587421:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787440298.587424:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee04cbcec00, rc 0) 00000100:00100000:0.0:1787440298.587514:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee05fcddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+20:11525:x1874266681324928:12345-192.168.206.58@tcp:101:lhsmtool_posix.0 Request processed in 256us (641us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440298.587522:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 179 00000100:00100000:2.0:1787440298.590623:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:1.0:1787440298.590972:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681325056 00000100:00100000:1.0:1787440298.590985:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681325056 00000100:00100000:1.0:1787440298.591074:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 51 00000100:00100000:1.0:1787440298.591086:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee080b44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+6:2363:x1874266681325056:12345-192.168.206.58@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1787440298.591560:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee080b44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+7:2363:x1874266681325056:12345-192.168.206.58@tcp:2:lhsmtool_posix.0 Request processed in 473us (947us total) trans 4294967313 rc 0/0 00000100:00100000:1.0:1787440298.591570:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 51 00000100:00100000:3.0:1787440298.598029:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:1.0:1787440298.598104:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681325312 00000100:00100000:1.0:1787440298.598118:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681325312 00000100:00100000:1.0:1787440298.598195:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 49 00000100:00100000:1.0:1787440298.598222:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee05fcdc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+20:11525:x1874266681325312:12345-192.168.206.58@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787440298.598553:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee05fcdc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+21:11525:x1874266681325312:12345-192.168.206.58@tcp:35:lhsmtool_posix.0 Request processed in 333us (538us total) trans 4294967461 rc 0/0 00000100:00100000:1.0:1787440298.598561:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 49 00000100:00100000:1.0:1787440298.602094:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440298.602205:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681325568 00000100:00100000:3.0:1787440298.602218:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681325568 00000100:00100000:3.0:1787440298.602311:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 180 00000100:00100000:3.0:1787440298.602322:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee077cf3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+21:11525:x1874266681325568:12345-192.168.206.58@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787440298.602477:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee077cf3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+21:11525:x1874266681325568:12345-192.168.206.58@tcp:57:lhsmtool_posix.0 Request processed in 157us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440298.602487:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 180 00000100:00100000:2.0:1787440298.608604:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:1.0:1787440298.612706:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681325696 00000100:00100000:1.0:1787440298.612725:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681325696 00000100:00100000:1.0:1787440298.612817:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 181 00000100:00100000:1.0:1787440298.612829:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee080b46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+21:11525:x1874266681325696:12345-192.168.206.58@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787440298.612855:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440298.612882:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f000/0x85f5fa77adf3cecb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fab14535dc62408 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440298.612972:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fe00/0x85f5fa77adf3ced2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440298.612990:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fe00/0x85f5fa77adf3ced2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440298.613002:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fe00/0x85f5fa77adf3ced2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787440298.613050:0:5849:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787440298.613085:0:5849:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fe00/0x85f5fa77adf3ced2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440298.613115:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f000/0x85f5fa77adf3cecb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62408 expref: 23 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440298.613158:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fe00/0x85f5fa77adf3ced2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62408 expref: 22 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440298.613167:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8ee054b3c400) 00010000:00010000:1.0:1787440298.613171:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1787440298.613175:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee07fb9fe00, rc 0) 00000100:00100000:1.0:1787440298.613301:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee080b46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+22:11525:x1874266681325696:12345-192.168.206.58@tcp:101:lhsmtool_posix.0 Request processed in 474us (4709us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440298.613309:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 181 00000100:00100000:2.0:1787440298.620802:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440298.620863:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681325824 00000100:00100000:3.0:1787440298.620875:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681325824 00000100:00100000:3.0:1787440298.620947:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 52 00000100:00100000:3.0:1787440298.620958:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee080b44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+7:2362:x1874266681325824:12345-192.168.206.58@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787440298.620981:0:6695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440298.621006:0:6695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000999a3feb/0x85f5fa77adf3ced9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5fab14535dc6240f expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787440298.621039:0:6695:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8a2caa, blocks: 0x1 00010000:00010000:3.0:1787440298.621072:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=396s v=(0 0) 00010000:00010000:3.0:1787440298.621077:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787440298.621089:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000999a3feb/0x85f5fa77adf3ced9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6240f expref: 8 pid: 6695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440298.621109:0:6695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000999a3feb/0x85f5fa77adf3ced9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6240f expref: 8 pid: 6695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440298.621124:0:6695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee049e94000, rc 0) 00000100:00100000:3.0:1787440298.621204:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee080b44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+8:2362:x1874266681325824:12345-192.168.206.58@tcp:101:lhsmtool_posix.0 Request processed in 246us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440298.621212:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 52 00000100:00100000:1.0:1787440298.638027:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:2.0:1787440298.638374:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681326080 00000100:00100000:2.0:1787440298.638387:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681326080 00000100:00100000:2.0:1787440298.638675:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 182 00000100:00100000:2.0:1787440298.638689:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee077cf0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+22:11525:x1874266681326080:12345-192.168.206.58@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787440298.638828:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee077cf0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+22:11525:x1874266681326080:12345-192.168.206.58@tcp:57:lhsmtool_posix.0 Request processed in 142us (813us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440298.638837:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 182 00000100:00100000:0.0:1787440298.654962:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440298.655021:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681326208 00000100:00100000:0.0:1787440298.655033:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681326208 00000100:00100000:0.0:1787440298.655121:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 53 00000100:00100000:0.0:1787440298.655133:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee080326d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+8:11525:x1874266681326208:12345-192.168.206.58@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787440298.655159:0:6698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440298.655185:0:6698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000061934086/0x85f5fa77adf3cee0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5fab14535dc62416 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440298.655229:0:6698:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000999a3feb/0x85f5fa77adf3ced9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6240f expref: 9 pid: 6695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440298.655240:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1787440298.655246:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787440298.655252:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000061934086/0x85f5fa77adf3cee0 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62416 expref: 9 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440298.655297:0:6698:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000999a3feb/0x85f5fa77adf3ced9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6240f expref: 9 pid: 6695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440298.655338:0:6698:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000999a3feb/0x85f5fa77adf3ced9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6240f expref: 9 pid: 6695 timeout: 497 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440298.655358:0:6698:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee080327480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6698:1874266701245952:192.168.206.58@tcp:104: 00000100:00100000:0.0:1787440298.655480:0:6698:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee04cb766c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787440298.671232:0:6698:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee080327480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6698:1874266701245952:192.168.206.58@tcp:104: 00010000:00010000:0.0:1787440298.671285:0:6698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000061934086/0x85f5fa77adf3cee0 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62416 expref: 9 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440298.671314:0:6698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee04cbce600, rc 0) 00000100:00100000:0.0:1787440298.671412:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee080326d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+9:11525:x1874266681326208:12345-192.168.206.58@tcp:101:lhsmtool_posix.0 Request processed in 16281us (16463us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440298.671424:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 53 00000100:00100000:2.0:1787440298.677739:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:2.0:1787440298.679708:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681326336 00000100:00100000:2.0:1787440298.679725:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681326336 00010000:00010000:2.0:1787440298.679861:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000999a3feb/0x85f5fa77adf3ced9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6240f expref: 9 pid: 6695 timeout: 497 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440298.679908:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 70 00000100:00100000:2.0:1787440298.679919:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee080b47800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+9:2362:x1874266681326336:12345-192.168.206.58@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787440298.679938:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787440298.679968:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000999a3feb/0x85f5fa77adf3ced9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6240f expref: 9 pid: 6695 timeout: 497 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440298.679985:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000999a3feb/0x85f5fa77adf3ced9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6240f expref: 9 pid: 6695 timeout: 497 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440298.680039:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000999a3feb/0x85f5fa77adf3ced9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6240f expref: 9 pid: 6695 timeout: 497 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440298.680546:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787440298.680555:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787440298.680568:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000061934086/0x85f5fa77adf3cee0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62416 expref: 8 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440298.680582:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000061934086/0x85f5fa77adf3cee0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62416 expref: 8 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440298.680635:0:5835:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000061934086/0x85f5fa77adf3cee0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62416 expref: 8 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440298.680653:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee080b44000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5835:1874266701246080:192.168.206.58@tcp:105: 00000100:00100000:2.0:1787440298.681163:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee0807a9a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787440298.702147:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440298.702214:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee080b44000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5835:1874266701246080:192.168.206.58@tcp:105: 00010000:00010000:3.0:1787440298.702247:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787440298.702316:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee080b47800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+8:2362:x1874266681326336:12345-192.168.206.58@tcp:103:ldlm_bl.0 Request processed in 22398us (24591us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440298.702328:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 70 00000100:00100000:1.0:1787440298.714179:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681326464 00000100:00100000:1.0:1787440298.714200:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681326464 00002000:00100000:1.0:1787440298.714278:0:6701:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff8ee05fcdc000 x1874266681326464/t0(0) o4->792563a7-4c22-4ac7-ac25-d49ef7fb41a8@192.168.206.58@tcp:459/0 lens 504/0 e 0 to 0 dl 1787440309 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787440298.714294:0:6701:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ee05fcdc000 with x1874266681326464 ext(0->8) 00002000:00010000:1.0:1787440298.714301:0:6701:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8ee05fcdc000 00000100:00100000:1.0:1787440298.714351:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 4 00000100:00100000:1.0:1787440298.714363:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee05fcdc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+8:2363:x1874266681326464:12345-192.168.206.58@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1787440298.716874:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee05fcdc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+10:2363:x1874266681326464:12345-192.168.206.58@tcp:4:lhsmtool_posix.0 Request processed in 2499us (14728us total) trans 4294967314 rc 0/0 00000100:00100000:1.0:1787440298.716890:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 4 00002000:00100000:1.0:1787440298.716905:0:6701:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff8ee05fcdc000 x1874266681326464/t4294967314(0) o4->792563a7-4c22-4ac7-ac25-d49ef7fb41a8@192.168.206.58@tcp:459/0 lens 504/448 e 0 to 0 dl 1787440309 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787440298.716930:0:6701:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ee05fcdc000 with x1874266681326464 ext(0->8) 00002000:00010000:1.0:1787440298.716937:0:6701:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8ee05fcdc000 00000100:00100000:3.0:1787440298.739272:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440298.739426:0:6892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681326592 00000100:00100000:0.0:1787440298.739439:0:6892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681326592 00000100:00100000:0.0:1787440298.739530:0:6892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 183 00000100:00100000:0.0:1787440298.739542:0:6892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee05fcdf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+22:11525:x1874266681326592:12345-192.168.206.58@tcp:44:lhsmtool_posix.0 00000100:00100000:0.0:1787440298.848587:0:6892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee05fcdf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+22:11525:x1874266681326592:12345-192.168.206.58@tcp:44:lhsmtool_posix.0 Request processed in 109039us (109320us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440298.848599:0:6892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 183 00000001:00080000:3.0:1787440298.848957:0:5871:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967461 is committed 00000020:00080000:3.0:1787440298.848972:0:5871:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000004:00080000:3.0:1787440298.849088:0:5871:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000020:00080000:0.0:1787440298.852797:0:5882:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:0.0:1787440298.852815:0:5882:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000004:00080000:3.0:1787440298.857477:0:5871:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000100:00100000:1.0:1787440298.857837:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787440298.857858:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee080327480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874266701246208:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1787440298.857917:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440298.858054:0:9225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701246208 00000100:00100000:0.0:1787440298.858084:0:9225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701246208 00000100:00100000:0.0:1787440298.858150:0:9225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787440298.858159:0:9225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee077cf2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1874266701246208:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1787440298.858323:0:9225:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1787440298.858327:0:9225:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1787440298 00002000:00010000:0.0:1787440298.858330:0:9225:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1787440298.858332:0:9225:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1787440298 -> 1787440298 00002000:00010000:0.0:1787440298.858334:0:9225:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1787440298.858373:0:9225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee077cf2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3309:x1874266701246208:12345-0@lo:2:osp-syn-1-0.0 Request processed in 215us (455us total) trans 4294967315 rc 0/0 00000100:00100000:0.0:1787440298.858379:0:9225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:3.0:1787440298.859025:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:1.0:1787440298.859109:0:3309:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8ee080327480/2, rc 0, transno 4294967315 00000100:00100000:1.0:1787440298.859116:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee080327480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874266701246208:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1787440298.861103:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:2.0:1787440298.861964:0:12016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681326720 00000100:00100000:2.0:1787440298.861973:0:12016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681326720 00000100:00100000:2.0:1787440298.862044:0:12016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 55 00000100:00100000:2.0:1787440298.862055:0:12016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee077cf1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+10:2363:x1874266681326720:12345-192.168.206.58@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1787440298.902133:0:12016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee077cf1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+10:2363:x1874266681326720:12345-192.168.206.58@tcp:16:lhsmtool_posix.0 Request processed in 40072us (41028us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440298.902147:0:12016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 55 00000001:00080000:1.0:1787440298.902184:0:7640:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967315 is committed 00000001:00080000:1.0:1787440298.902263:0:7640:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967314 is committed 00000100:00100000:1.0:1787440298.908847:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440298.908963:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681326976 00000100:00100000:3.0:1787440298.908973:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681326976 00000100:00100000:3.0:1787440298.909093:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 184 00000100:00100000:3.0:1787440298.909105:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee077cf1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+18:11525:x1874266681326976:12345-192.168.206.58@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787440298.909159:0:5850:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787440298.909188:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fe00/0x85f5fa77adf3ced2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62408 expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440298.909217:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8ee054b3c400) 00010000:00010000:3.0:1787440298.909223:0:5850:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787440298.909260:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95600/0x85f5fa77adf3cee7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440298.909272:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95600/0x85f5fa77adf3cee7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440298.909282:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95600/0x85f5fa77adf3cee7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787440298.909560:0:5850:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000023fa5d7a reply state 00000000625444d2 transno 4294967462 ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95600/0x85f5fa77adf3cee7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440298.910305:0:5850:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787440298.910420:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee077cf1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+19:11525:x1874266681326976:12345-192.168.206.58@tcp:36:lhsmtool_posix.0 Request processed in 1316us (1579us total) trans 4294967462 rc 0/0 00000100:00100000:3.0:1787440298.910429:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 184 00000100:00100000:3.0:1787440298.926452:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00010000:00010000:3.0:1787440298.926681:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95600/0x85f5fa77adf3cee7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440298.926694:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95600/0x85f5fa77adf3cee7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440298.926702:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95600/0x85f5fa77adf3cee7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440298.926708:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee049e95600 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:3.0:1787440298.926713:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95600/0x85f5fa77adf3cee7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440298.926720:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95600/0x85f5fa77adf3cee7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440298.926737:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8ee054b3c400) 00010000:00010000:3.0:1787440298.926740:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440298.926744:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95600/0x85f5fa77adf3cee7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440298.926751:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95600/0x85f5fa77adf3cee7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440298.927347:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681327104 00000100:00100000:2.0:1787440298.927356:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681327104 00000100:00100000:2.0:1787440298.927405:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 56 00000100:00100000:2.0:1787440298.927414:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee05fcdea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+7:2363:x1874266681327104:12345-192.168.206.58@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1787440298.927824:0:6698:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:2.0:1787440298.927828:0:6698:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1787440298 -> 1787440297 00002000:00010000:2.0:1787440298.927830:0:6698:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1787440296 00002000:00010000:2.0:1787440298.927832:0:6698:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1787440298 -> 1787440297 00002000:00010000:2.0:1787440298.927834:0:6698:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1787440298.927891:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee05fcdea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+8:2363:x1874266681327104:12345-192.168.206.58@tcp:2:lhsmtool_posix.0 Request processed in 477us (1447us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1787440298.927899:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 56 00000100:00100000:1.0:1787440298.939392:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:2.0:1787440298.939579:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681327360 00000100:00100000:2.0:1787440298.939588:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681327360 00000100:00100000:2.0:1787440298.939642:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 185 00000100:00100000:2.0:1787440298.939664:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee077cf0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+18:11525:x1874266681327360:12345-192.168.206.58@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1787440298.939726:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86ee00/0x85f5fa77adf3ceee lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440298.939743:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e200/0x85f5fa77adf3ceb6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc623fa expref: 18 pid: 6892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440298.939752:0:5849:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86ee00/0x85f5fa77adf3ceee lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440298.939785:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e200/0x85f5fa77adf3ceb6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc623fa expref: 18 pid: 6892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440298.939800:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e200/0x85f5fa77adf3ceb6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc623fa expref: 18 pid: 6892 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440298.939829:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee080b46d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5849:1874266701246336:192.168.206.58@tcp:104: 00000100:00100000:2.0:1787440298.939906:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee047f969c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787440298.943845:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee080b46d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5849:1874266701246336:192.168.206.58@tcp:104: 00000100:00100000:1.0:1787440298.943855:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00010000:00010000:3.0:1787440298.943871:0:5849:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86ee00/0x85f5fa77adf3ceee lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440298.943885:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681327488 00000100:00100000:1.0:1787440298.943891:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681327488 00010000:00010000:1.0:1787440298.943921:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e200/0x85f5fa77adf3ceb6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc623fa expref: 19 pid: 6892 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440298.943953:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 71 00000100:00100000:1.0:1787440298.943962:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee077cf3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+19:2362:x1874266681327488:12345-192.168.206.58@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787440298.943975:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787440298.943982:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e200/0x85f5fa77adf3ceb6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc623fa expref: 19 pid: 6892 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440298.944003:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e200/0x85f5fa77adf3ceb6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc623fa expref: 19 pid: 6892 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440298.944024:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e200/0x85f5fa77adf3ceb6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc623fa expref: 19 pid: 6892 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440298.944038:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8ee054b3c400) 00010000:00010000:1.0:1787440298.944043:0:5834:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86ee00/0x85f5fa77adf3ceee lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440298.944052:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86ee00/0x85f5fa77adf3ceee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440298.944058:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86ee00/0x85f5fa77adf3ceee lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440298.944091:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787440298.944143:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee077cf3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+18:2362:x1874266681327488:12345-192.168.206.58@tcp:103:ldlm_bl.0 Request processed in 181us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440298.944151:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 71 00010000:00010000:1.0:1787440298.944670:0:5849:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86ee00/0x85f5fa77adf3ceee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440298.944679:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86ee00/0x85f5fa77adf3ceee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440298.944705:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86ee00/0x85f5fa77adf3ceee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440298.944722:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86ee00/0x85f5fa77adf3ceee lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440298.944729:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86ee00/0x85f5fa77adf3ceee lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440298.944736:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee07f86ee00 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:1.0:1787440298.944741:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86ee00/0x85f5fa77adf3ceee lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440298.944748:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86ee00/0x85f5fa77adf3ceee lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440298.944759:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8ee054b3c400) 00010000:00010000:1.0:1787440298.944761:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1787440298.944765:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86ee00/0x85f5fa77adf3ceee lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440298.944770:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86ee00/0x85f5fa77adf3ceee lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440298.945108:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee077cf0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+17:11525:x1874266681327360:12345-192.168.206.58@tcp:55:lhsmtool_posix.0 Request processed in 5455us (5722us total) trans 0 rc -22/-22 00000100:00100000:1.0:1787440298.945118:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 185 00000100:00100000:1.0:1787440298.951196:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440298.951272:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681327616 00000100:00100000:3.0:1787440298.951281:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681327616 00000100:00100000:3.0:1787440298.951331:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 57 00000100:00100000:3.0:1787440298.951340:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee077cf1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+8:2363:x1874266681327616:12345-192.168.206.58@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1787440298.951377:0:6695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000a5c19790/0x85f5fa77adf3cef5 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440298.951396:0:6695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000061934086/0x85f5fa77adf3cee0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62416 expref: 8 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440298.951403:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787440298.951407:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787440298.951412:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a5c19790/0x85f5fa77adf3cef5 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440298.951443:0:6695:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000061934086/0x85f5fa77adf3cee0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62416 expref: 8 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440298.951475:0:6695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000061934086/0x85f5fa77adf3cee0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62416 expref: 8 pid: 6698 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440298.951488:0:6695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee0806b5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6695:1874266701246464:192.168.206.58@tcp:104: 00000100:00100000:3.0:1787440298.951591:0:6695:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee047ed23c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787440298.960998:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:1.0:1787440298.961033:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681327744 00000100:00100000:1.0:1787440298.961041:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681327744 00010000:00010000:1.0:1787440298.961085:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000061934086/0x85f5fa77adf3cee0 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62416 expref: 9 pid: 6698 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440298.961137:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 72 00000100:00100000:1.0:1787440298.961149:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee077cf0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+9:2362:x1874266681327744:12345-192.168.206.58@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787440298.961162:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787440298.961184:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000061934086/0x85f5fa77adf3cee0 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62416 expref: 9 pid: 6698 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440298.961197:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000061934086/0x85f5fa77adf3cee0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62416 expref: 9 pid: 6698 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440298.961220:0:5836:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787440298.961225:0:5836:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787440298.961361:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a5c19790/0x85f5fa77adf3cef5 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440298.961372:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a5c19790/0x85f5fa77adf3cef5 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440298.961394:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787440298.961454:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee077cf0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+9:2362:x1874266681327744:12345-192.168.206.58@tcp:103:ldlm_bl.0 Request processed in 307us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440298.961462:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 72 00010000:00010000:1.0:1787440298.961800:0:6695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000061934086/0x85f5fa77adf3cee0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62416 expref: 8 pid: 6698 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440298.961813:0:6695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee0806b5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6695:1874266701246464:192.168.206.58@tcp:104: 00010000:00010000:1.0:1787440298.961837:0:6695:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a5c19790/0x85f5fa77adf3cef5 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440298.961847:0:6695:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a5c19790/0x85f5fa77adf3cef5 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440298.961854:0:6695:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a5c19790/0x85f5fa77adf3cef5 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440298.961881:0:6695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000a5c19790/0x85f5fa77adf3cef5 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440298.961889:0:6695:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a5c19790/0x85f5fa77adf3cef5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440298.961897:0:6695:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a5c19790/0x85f5fa77adf3cef5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440298.961903:0:6695:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee049e95600 already unused, calling callback (ffffffffc15b52a0) 00010000:00010000:1.0:1787440298.961908:0:6695:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a5c19790/0x85f5fa77adf3cef5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440298.961916:0:6695:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a5c19790/0x85f5fa77adf3cef5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440298.961929:0:6695:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a5c19790/0x85f5fa77adf3cef5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440298.961944:0:6695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a5c19790/0x85f5fa77adf3cef5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440298.961998:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee077cf1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+7:2363:x1874266681327616:12345-192.168.206.58@tcp:1:lhsmtool_posix.0 Request processed in 10657us (10808us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440298.962007:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 57 00000100:00100000:0.0:1787440298.969919:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:1.0:1787440298.970360:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681328000 00000100:00100000:1.0:1787440298.970371:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681328000 00000100:00100000:1.0:1787440298.970430:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 186 00000100:00100000:1.0:1787440298.970443:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee080326a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+17:11525:x1874266681328000:12345-192.168.206.58@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1787440298.970545:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fe00/0x85f5fa77adf3cefc lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440298.970563:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fe00/0x85f5fa77adf3cefc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440298.970588:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fe00/0x85f5fa77adf3cefc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440298.970894:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9ee00/0x85f5fa77adf3cf03 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440298.970909:0:5851:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcec00/0x85f5fa77adf3cec4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62401 expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440298.970919:0:5851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9ee00/0x85f5fa77adf3cf03 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440298.970968:0:5851:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcec00/0x85f5fa77adf3cec4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62401 expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440298.970983:0:5851:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcec00/0x85f5fa77adf3cec4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62401 expref: 18 pid: 5849 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440298.970998:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee077cf3100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5851:1874266701246592:192.168.206.58@tcp:104: 00000100:00100000:1.0:1787440298.971087:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee047c026c0 going to sleep for 11 seconds 00000001:00080000:3.0:1787440298.976927:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967307 is committed 00000001:00080000:3.0:1787440298.976943:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000100:00100000:0.0:1787440298.977345:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee077cf3100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5851:1874266701246592:192.168.206.58@tcp:104: 00010000:00010000:0.0:1787440298.977376:0:5851:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9ee00/0x85f5fa77adf3cf03 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440298.985701:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:1.0:1787440298.987593:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681328128 00000100:00100000:1.0:1787440298.987605:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681328128 00010000:00010000:1.0:1787440298.987645:0:6711:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcec00/0x85f5fa77adf3cec4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62401 expref: 19 pid: 5849 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440298.987681:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 73 00000100:00100000:1.0:1787440298.987689:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee0806b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+19:2360:x1874266681328128:12345-192.168.206.58@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787440298.987703:0:6711:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787440298.987709:0:6711:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcec00/0x85f5fa77adf3cec4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62401 expref: 19 pid: 5849 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440298.987722:0:6711:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcec00/0x85f5fa77adf3cec4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62401 expref: 19 pid: 5849 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440298.987742:0:6711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcec00/0x85f5fa77adf3cec4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62401 expref: 19 pid: 5849 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440298.987755:0:6711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8ee054b3c400) 00010000:00010000:1.0:1787440298.987767:0:6711:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9ee00/0x85f5fa77adf3cf03 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440298.987776:0:6711:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9ee00/0x85f5fa77adf3cf03 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440298.987784:0:6711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9ee00/0x85f5fa77adf3cf03 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440298.987817:0:6711:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787440298.987865:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee0806b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+18:2360:x1874266681328128:12345-192.168.206.58@tcp:103:ldlm_bl.0 Request processed in 176us (2172us total) trans 0 rc 0/0 00010000:00010000:3.0:1787440298.987899:0:5851:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9ee00/0x85f5fa77adf3cf03 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440298.987906:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9ee00/0x85f5fa77adf3cf03 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787440298.988103:0:5851:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:3.0:1787440298.988266:0:5851:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000001:00080000:3.0:1787440298.988312:0:5851:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:3.0:1787440298.988390:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee0806b4000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5851:1874266701246720:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1787440298.988442:0:5851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440298.988467:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee047ed2180 going to sleep for 11 seconds 00000100:00100000:1.0:1787440298.988603:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 73 00000100:00100000:2.0:1787440298.990090:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701246720 00000100:00100000:2.0:1787440298.990108:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701246720 00000100:00100000:2.0:1787440298.990176:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787440298.990187:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee0806b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5851:x1874266701246720:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1787440298.990348:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee0806b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5851:x1874266701246720:12345-0@lo:1000:mdt00_002.0 Request processed in 163us (1906us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440298.990359:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787440298.990417:0:5851:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:2.0:1787440298.990423:0:5851:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8ee080327480, transno 4294967315 00000100:00100000:2.0:1787440298.990461:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee0806b4000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5851:1874266701246720:0@lo:1000:mdt00_002.0 00000001:00080000:2.0:1787440298.991219:0:5851:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967466 00000100:00100000:2.0:1787440298.991327:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee080b45c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5851:1874266701246848:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1787440298.991396:0:5851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440298.991435:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee049e0a0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787440298.993115:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701246848 00000100:00100000:0.0:1787440298.993128:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701246848 00000100:00100000:0.0:1787440298.993184:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787440298.993208:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee080b45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5851:x1874266701246848:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1787440298.993462:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee080b45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5851:x1874266701246848:12345-0@lo:1000:mdt00_002.0 Request processed in 268us (2065us total) trans 4294967317 rc 0/0 00000100:00100000:0.0:1787440298.993470:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787440298.994405:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee080b45c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5851:1874266701246848:0@lo:1000:mdt00_002.0 00010000:00010000:2.0:1787440298.994673:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9ee00/0x85f5fa77adf3cf03 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440298.994687:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9ee00/0x85f5fa77adf3cf03 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440298.994695:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9ee00/0x85f5fa77adf3cf03 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440298.994728:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee07fb9ee00 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:2.0:1787440298.994734:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9ee00/0x85f5fa77adf3cf03 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440298.994742:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9ee00/0x85f5fa77adf3cf03 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440298.994762:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8ee054b3c400) 00010000:00010000:2.0:1787440298.994767:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787440298.994773:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9ee00/0x85f5fa77adf3cf03 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440298.994778:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9ee00/0x85f5fa77adf3cf03 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440298.995113:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86fc00/0x85f5fa77adf3ce38 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440298.995121:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86fc00/0x85f5fa77adf3ce38 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440298.995128:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86fc00/0x85f5fa77adf3ce38 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440298.995133:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee07f86fc00 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:2.0:1787440298.995137:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86fc00/0x85f5fa77adf3ce38 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440298.995144:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86fc00/0x85f5fa77adf3ce38 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440298.995167:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ee054b3cd00) 00010000:00010000:2.0:1787440298.995169:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787440298.995173:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86fc00/0x85f5fa77adf3ce38 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440298.995180:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86fc00/0x85f5fa77adf3ce38 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440298.995211:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86ee00/0x85f5fa77adf3cf0a lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440298.995228:0:5851:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e400/0x85f5fa77adf3ce54 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc623e5 expref: 21 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440298.995238:0:5851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86ee00/0x85f5fa77adf3cf0a lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440298.995287:0:5851:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e400/0x85f5fa77adf3ce54 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc623e5 expref: 21 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440298.995309:0:5851:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e400/0x85f5fa77adf3ce54 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc623e5 expref: 21 pid: 5851 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440298.995328:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee080b44a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5851:1874266701246976:192.168.206.58@tcp:104: 00000100:00100000:2.0:1787440298.995460:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee049e0a0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787440299.000953:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee080b44a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5851:1874266701246976:192.168.206.58@tcp:104: 00010000:00010000:2.0:1787440299.000985:0:5851:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86ee00/0x85f5fa77adf3cf0a lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440299.002525:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:2.0:1787440299.003949:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681328256 00000100:00100000:2.0:1787440299.003963:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681328256 00010000:00010000:2.0:1787440299.004019:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e400/0x85f5fa77adf3ce54 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc623e5 expref: 22 pid: 5851 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1787440299.004050:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787440299.004080:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 74 00000100:00100000:2.0:1787440299.004092:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee077cf3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+22:2363:x1874266681328256:12345-192.168.206.58@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787440299.004109:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787440299.004116:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e400/0x85f5fa77adf3ce54 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc623e5 expref: 22 pid: 5851 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440299.004131:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e400/0x85f5fa77adf3ce54 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc623e5 expref: 22 pid: 5851 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440299.004154:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e400/0x85f5fa77adf3ce54 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc623e5 expref: 22 pid: 5851 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440299.004170:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ee054b3cd00) 00010000:00010000:2.0:1787440299.004176:0:5836:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86ee00/0x85f5fa77adf3cf0a lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440299.004185:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86ee00/0x85f5fa77adf3cf0a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440299.004193:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86ee00/0x85f5fa77adf3cf0a lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440299.004225:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787440299.004276:0:5851:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86ee00/0x85f5fa77adf3cf0a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440299.004290:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86ee00/0x85f5fa77adf3cf0a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440299.004304:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee077cf3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+21:2363:x1874266681328256:12345-192.168.206.58@tcp:103:ldlm_bl.0 Request processed in 212us (1822us total) trans 0 rc 0/0 00010000:00010000:3.0:1787440299.004309:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86ee00/0x85f5fa77adf3cf0a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440299.004322:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 74 00010000:00010000:3.0:1787440299.004325:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86ee00/0x85f5fa77adf3cf0a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440299.004336:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86ee00/0x85f5fa77adf3cf0a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440299.004364:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee07f86ee00 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:3.0:1787440299.004369:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86ee00/0x85f5fa77adf3cf0a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440299.004378:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86ee00/0x85f5fa77adf3cf0a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440299.004396:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ee054b3cd00) 00010000:00010000:3.0:1787440299.004399:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440299.004404:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86ee00/0x85f5fa77adf3cf0a lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440299.004411:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86ee00/0x85f5fa77adf3cf0a lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440299.004431:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fe00/0x85f5fa77adf3cefc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440299.004437:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fe00/0x85f5fa77adf3cefc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440299.004444:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fe00/0x85f5fa77adf3cefc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440299.004450:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee07fb9fe00 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:3.0:1787440299.004453:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fe00/0x85f5fa77adf3cefc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440299.004459:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fe00/0x85f5fa77adf3cefc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440299.004479:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ee054b3cd00) 00010000:00010000:3.0:1787440299.004481:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787440299.004484:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fe00/0x85f5fa77adf3cefc lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440299.004535:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fe00/0x85f5fa77adf3cefc lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440299.004867:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee080326a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+20:11525:x1874266681328000:12345-192.168.206.58@tcp:57:lhsmtool_posix.0 Request processed in 34412us (34942us total) trans 4294967467 rc 0/0 00000100:00100000:3.0:1787440299.004880:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 186 00000020:00080000:3.0:1787440299.004886:0:5851:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1787440299.004969:0:11682:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787440299.004975:0:11682:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787440299.005473:0:11682:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:2.0:1787440299.005484:0:11682:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787440299.007629:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:2.0:1787440299.007757:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681328512 00000100:00100000:2.0:1787440299.007769:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681328512 00000100:00100000:2.0:1787440299.007829:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 50 00000100:00100000:2.0:1787440299.007840:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee079bacc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+20:11525:x1874266681328512:12345-192.168.206.58@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1787440299.009691:0:5852:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1787440299.009864:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967468 00010000:00010000:2.0:1787440299.010181:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e400/0x85f5fa77adf3cf11 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440299.010198:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e400/0x85f5fa77adf3cf11 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440299.010209:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e400/0x85f5fa77adf3cf11 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440299.010218:0:5852:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e400/0x85f5fa77adf3cf11 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440299.010225:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e400/0x85f5fa77adf3cf11 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440299.010232:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e400/0x85f5fa77adf3cf11 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440299.010263:0:5852:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787440299.010374:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee079bacc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+22:11525:x1874266681328512:12345-192.168.206.58@tcp:35:lhsmtool_posix.0 Request processed in 2531us (2757us total) trans 4294967469 rc 0/0 00000100:00100000:2.0:1787440299.010385:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 50 00000020:00080000:2.0:1787440299.010391:0:5852:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787440299.010715:0:5837:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787440299.010729:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e400/0x85f5fa77adf3cf11 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440299.010740:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee07f86e400 already unused, calling callback (ffffffffc15b52a0) 00010000:00010000:3.0:1787440299.010757:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e400/0x85f5fa77adf3cf11 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440299.010770:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e400/0x85f5fa77adf3cf11 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440299.011660:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8ee054b3c400) 00010000:00010000:3.0:1787440299.011668:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787440299.011675:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e400/0x85f5fa77adf3cf11 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440299.011685:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e400/0x85f5fa77adf3cf11 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440299.011742:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787440299.011744:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787440299.011747:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787440299.047896:0:12457:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787440299.047905:0:12457:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787440299.047942:0:12457:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1787440299.047947:0:12457:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1787440299.102255:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787440299.151942:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440299.152012:0:6892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681328768 00000100:00100000:0.0:1787440299.152028:0:6892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681328768 00000100:00100000:0.0:1787440299.152092:0:6892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 187 00000100:00100000:0.0:1787440299.152102:0:6892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee080b44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+22:11535:x1874266681328768:12345-192.168.206.58@tcp:101:lfs.0 00010000:00010000:0.0:1787440299.152124:0:6892:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440299.152142:0:6892:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce000/0x85f5fa77adf3cf18 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fab14535dc6241d expref: -99 pid: 6892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440299.152372:0:6892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfe00/0x85f5fa77adf3cf1f lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440299.152385:0:6892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfe00/0x85f5fa77adf3cf1f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440299.152396:0:6892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfe00/0x85f5fa77adf3cf1f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787440299.152407:0:6892:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:0.0:1787440299.152808:0:6892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce000/0x85f5fa77adf3cf18 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6241d expref: 25 pid: 6892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440299.152827:0:6892:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfe00/0x85f5fa77adf3cf1f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6241d expref: 24 pid: 6892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440299.152836:0:6892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8ee05132ea00) 00010000:00010000:0.0:1787440299.152839:0:6892:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787440299.152842:0:6892:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee04cbcfe00, rc 0) 00000100:00100000:0.0:1787440299.152905:0:6892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee080b44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+24:11535:x1874266681328768:12345-192.168.206.58@tcp:101:lfs.0 Request processed in 804us (969us total) trans 4294967470 rc 0/0 00000100:00100000:0.0:1787440299.152912:0:6892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 187 00000100:00100000:3.0:1787440299.159841:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:1.0:1787440299.159929:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681328896 00000100:00100000:1.0:1787440299.159938:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681328896 00000100:00100000:1.0:1787440299.159993:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 188 00000100:00100000:1.0:1787440299.160003:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee0806b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+24:11535:x1874266681328896:12345-192.168.206.58@tcp:34:lfs.0 00010000:00010000:1.0:1787440299.160086:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fa00/0x85f5fa77adf3cf2d lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440299.160102:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fa00/0x85f5fa77adf3cf2d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440299.160114:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fa00/0x85f5fa77adf3cf2d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440299.160128:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e400/0x85f5fa77adf3cf34 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440299.160146:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e400/0x85f5fa77adf3cf34 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440299.160153:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e400/0x85f5fa77adf3cf34 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440299.160457:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f600/0x85f5fa77adf3cf3b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440299.160466:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f600/0x85f5fa77adf3cf3b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440299.160474:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f600/0x85f5fa77adf3cf3b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787440299.160541:0:5850:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f600/0x85f5fa77adf3cf3b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440299.160554:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fa00/0x85f5fa77adf3cf2d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440299.160561:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fa00/0x85f5fa77adf3cf2d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440299.160568:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fa00/0x85f5fa77adf3cf2d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440299.160575:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee07fb9fa00 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:1.0:1787440299.160579:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fa00/0x85f5fa77adf3cf2d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440299.160586:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fa00/0x85f5fa77adf3cf2d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440299.160605:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8ee05132ea00) 00010000:00010000:1.0:1787440299.160608:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440299.160613:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fa00/0x85f5fa77adf3cf2d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440299.160620:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fa00/0x85f5fa77adf3cf2d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440299.160631:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e400/0x85f5fa77adf3cf34 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440299.160637:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e400/0x85f5fa77adf3cf34 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440299.160643:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e400/0x85f5fa77adf3cf34 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440299.160649:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee07fb9e400 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:1.0:1787440299.160652:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e400/0x85f5fa77adf3cf34 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440299.160658:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e400/0x85f5fa77adf3cf34 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440299.160665:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8ee05132e400) 00010000:00010000:1.0:1787440299.160668:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440299.160671:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e400/0x85f5fa77adf3cf34 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440299.160678:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e400/0x85f5fa77adf3cf34 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440299.160705:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f600/0x85f5fa77adf3cf3b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440299.160712:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f600/0x85f5fa77adf3cf3b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440299.160717:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f600/0x85f5fa77adf3cf3b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440299.160721:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee07fb9f600 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:1.0:1787440299.160724:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f600/0x85f5fa77adf3cf3b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440299.160730:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f600/0x85f5fa77adf3cf3b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440299.160738:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ee05132ef00) 00010000:00010000:1.0:1787440299.160740:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440299.160743:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f600/0x85f5fa77adf3cf3b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440299.160749:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f600/0x85f5fa77adf3cf3b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440299.160828:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee0806b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+24:11535:x1874266681328896:12345-192.168.206.58@tcp:34:lfs.0 Request processed in 825us (995us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440299.160837:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 188 00000100:00100000:3.0:1787440299.224571:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:1.0:1787440299.224667:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681329152 00000100:00100000:1.0:1787440299.224676:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681329152 00000100:00100000:1.0:1787440299.224738:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 189 00000100:00100000:1.0:1787440299.224763:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee05fb61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+24:11538:x1874266681329152:12345-192.168.206.58@tcp:101:lfs.0 00010000:00010000:1.0:1787440299.224784:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440299.224805:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f600/0x85f5fa77adf3cf42 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fab14535dc62424 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440299.224874:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e400/0x85f5fa77adf3cf49 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440299.224888:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e400/0x85f5fa77adf3cf49 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440299.224898:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e400/0x85f5fa77adf3cf49 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440299.224912:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fa00/0x85f5fa77adf3cf50 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440299.224919:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fa00/0x85f5fa77adf3cf50 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440299.224925:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fa00/0x85f5fa77adf3cf50 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440299.225265:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e000/0x85f5fa77adf3cf57 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440299.225274:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e000/0x85f5fa77adf3cf57 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440299.225280:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e000/0x85f5fa77adf3cf57 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787440299.225299:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:1.0:1787440299.225391:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e400/0x85f5fa77adf3cf49 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440299.225398:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e400/0x85f5fa77adf3cf49 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440299.225403:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e400/0x85f5fa77adf3cf49 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440299.225409:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee07fb9e400 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:1.0:1787440299.225413:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e400/0x85f5fa77adf3cf49 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440299.225421:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e400/0x85f5fa77adf3cf49 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440299.225433:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8ee05132ea00) 00010000:00010000:1.0:1787440299.225436:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440299.225440:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e400/0x85f5fa77adf3cf49 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440299.225447:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e400/0x85f5fa77adf3cf49 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440299.225460:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fa00/0x85f5fa77adf3cf50 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440299.225466:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fa00/0x85f5fa77adf3cf50 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440299.225482:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fa00/0x85f5fa77adf3cf50 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440299.225487:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee07fb9fa00 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:1.0:1787440299.225521:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fa00/0x85f5fa77adf3cf50 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440299.225529:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fa00/0x85f5fa77adf3cf50 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440299.225538:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8ee05132ef00) 00010000:00010000:1.0:1787440299.225541:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440299.225544:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fa00/0x85f5fa77adf3cf50 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440299.225549:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fa00/0x85f5fa77adf3cf50 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440299.225588:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f600/0x85f5fa77adf3cf42 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62424 expref: 27 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440299.225602:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e000/0x85f5fa77adf3cf57 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62424 expref: 26 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440299.225609:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ee05132e400) 00010000:00010000:1.0:1787440299.225610:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787440299.225613:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee07fb9e000, rc 0) 00000100:00100000:1.0:1787440299.225670:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee05fb61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+26:11538:x1874266681329152:12345-192.168.206.58@tcp:101:lfs.0 Request processed in 909us (1109us total) trans 4294967471 rc 0/0 00000100:00100000:1.0:1787440299.225686:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 189 00000100:00100000:2.0:1787440299.230019:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:1.0:1787440299.230102:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681329280 00000100:00100000:1.0:1787440299.230112:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681329280 00000100:00100000:1.0:1787440299.230173:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 190 00000100:00100000:1.0:1787440299.230182:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee080b47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+26:11538:x1874266681329280:12345-192.168.206.58@tcp:54:lfs.0 00010000:00010000:1.0:1787440299.230249:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fe00/0x85f5fa77adf3cf65 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440299.230267:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fe00/0x85f5fa77adf3cf65 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440299.230280:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fe00/0x85f5fa77adf3cf65 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440299.230307:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fe00/0x85f5fa77adf3cf65 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440299.230328:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fe00/0x85f5fa77adf3cf65 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440299.230335:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fe00/0x85f5fa77adf3cf65 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440299.230340:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee07fb9fe00 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:1.0:1787440299.230345:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fe00/0x85f5fa77adf3cf65 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440299.230352:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fe00/0x85f5fa77adf3cf65 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440299.230364:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ee05132e400) 00010000:00010000:1.0:1787440299.230381:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787440299.230386:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fe00/0x85f5fa77adf3cf65 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440299.230394:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fe00/0x85f5fa77adf3cf65 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440299.230481:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee080b47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+26:11538:x1874266681329280:12345-192.168.206.58@tcp:54:lfs.0 Request processed in 299us (470us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440299.230517:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 190 00000100:00100000:3.0:1787440299.233549:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:1.0:1787440299.233690:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681329536 00000100:00100000:1.0:1787440299.233699:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681329536 00000100:00100000:1.0:1787440299.233752:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 51 00000100:00100000:1.0:1787440299.233761:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee05fb60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+26:11538:x1874266681329536:12345-192.168.206.58@tcp:35:lfs.0 00000100:00100000:1.0:1787440299.234005:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee05fb60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+27:11538:x1874266681329536:12345-192.168.206.58@tcp:35:lfs.0 Request processed in 244us (463us total) trans 4294967472 rc 0/0 00000100:00100000:1.0:1787440299.234013:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 51 00000100:00100000:2.0:1787440299.296269:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440299.296469:0:6892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681329792 00000100:00100000:0.0:1787440299.296479:0:6892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681329792 00000100:00100000:0.0:1787440299.296561:0:6892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 191 00000100:00100000:0.0:1787440299.296570:0:6892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee080b45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+27:11073:x1874266681329792:12345-192.168.206.58@tcp:101:bash.0 00010000:00010000:0.0:1787440299.296594:0:6892:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440299.296613:0:6892:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcec00/0x85f5fa77adf3cf6c lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fab14535dc6242b expref: -99 pid: 6892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440299.296712:0:6892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce600/0x85f5fa77adf3cf73 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440299.296727:0:6892:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e000/0x85f5fa77adf3cf57 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62424 expref: 28 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440299.296736:0:6892:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce600/0x85f5fa77adf3cf73 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440299.296768:0:6892:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e000/0x85f5fa77adf3cf57 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62424 expref: 28 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440299.296782:0:6892:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e000/0x85f5fa77adf3cf57 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62424 expref: 28 pid: 5849 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440299.296795:0:6892:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee080327480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6892:1874266701247104:192.168.206.58@tcp:104: 00000100:00100000:0.0:1787440299.296954:0:6892:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee047f5e540 going to sleep for 11 seconds 00000100:00100000:2.0:1787440299.304661:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:1.0:1787440299.304801:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681329920 00000100:00100000:1.0:1787440299.304810:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681329920 00010000:00010000:1.0:1787440299.304862:0:6711:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e000/0x85f5fa77adf3cf57 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62424 expref: 29 pid: 5849 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440299.304915:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 75 00000100:00100000:1.0:1787440299.304926:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee080b44e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+29:2362:x1874266681329920:12345-192.168.206.58@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787440299.304942:0:6711:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787440299.304948:0:6711:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e000/0x85f5fa77adf3cf57 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62424 expref: 29 pid: 5849 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440299.304960:0:6892:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee080327480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6892:1874266701247104:192.168.206.58@tcp:104: 00010000:00010000:1.0:1787440299.304975:0:6711:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e000/0x85f5fa77adf3cf57 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62424 expref: 29 pid: 5849 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440299.305156:0:6892:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce600/0x85f5fa77adf3cf73 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440299.307280:0:6711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e000/0x85f5fa77adf3cf57 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62424 expref: 29 pid: 5849 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440299.307304:0:6711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ee05132e400) 00010000:00010000:1.0:1787440299.307309:0:6711:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce600/0x85f5fa77adf3cf73 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440299.307318:0:6711:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce600/0x85f5fa77adf3cf73 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440299.307325:0:6711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce600/0x85f5fa77adf3cf73 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440299.307481:0:6711:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787440299.307598:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee080b44e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+28:2362:x1874266681329920:12345-192.168.206.58@tcp:103:ldlm_bl.0 Request processed in 2671us (2943us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440299.307607:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 75 00010000:00010000:0.0:1787440299.308441:0:6892:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce600/0x85f5fa77adf3cf73 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440299.308454:0:6892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce600/0x85f5fa77adf3cf73 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787440299.308477:0:6892:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:0.0:1787440299.308734:0:6892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcec00/0x85f5fa77adf3cf6c lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6242b expref: 29 pid: 6892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440299.308815:0:6892:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce600/0x85f5fa77adf3cf73 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6242b expref: 28 pid: 6892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440299.308825:0:6892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ee05132e400) 00010000:00010000:0.0:1787440299.308828:0:6892:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787440299.308978:0:6892:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee04cbce600, rc 0) 00000100:00100000:0.0:1787440299.309151:0:6892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee080b45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+28:11073:x1874266681329792:12345-192.168.206.58@tcp:101:bash.0 Request processed in 12581us (12891us total) trans 4294967473 rc 0/0 00000100:00100000:0.0:1787440299.309160:0:6892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 191 00000100:00100000:2.0:1787440299.312193:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:1.0:1787440299.312274:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681330176 00000100:00100000:1.0:1787440299.312283:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681330176 00000100:00100000:1.0:1787440299.312338:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 192 00000100:00100000:1.0:1787440299.312347:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee080b47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+28:11073:x1874266681330176:12345-192.168.206.58@tcp:36:bash.0 00010000:00010000:1.0:1787440299.312905:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fe00/0x85f5fa77adf3cf81 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440299.312922:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fe00/0x85f5fa77adf3cf81 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440299.312946:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fe00/0x85f5fa77adf3cf81 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787440299.313003:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000004:00010000:1.0:1787440299.313041:0:5850:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a08addcd reply state 0000000093f53979 transno 4294967475 ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fe00/0x85f5fa77adf3cf81 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440299.313050:0:5850:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1787440299.313111:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967475 00000100:00100000:1.0:1787440299.313211:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee080b47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+32:11073:x1874266681330176:12345-192.168.206.58@tcp:36:bash.0 Request processed in 863us (1025us total) trans 4294967476 rc 0/0 00000100:00100000:1.0:1787440299.313225:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 192 00000020:00080000:1.0:1787440299.313230:0:5850:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1787440299.316297:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440299.317054:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681330304 00000100:00100000:3.0:1787440299.317078:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681330304 00000100:00100000:3.0:1787440299.317172:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 193 00000100:00100000:3.0:1787440299.317183:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee080b45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+32:11073:x1874266681330304:12345-192.168.206.58@tcp:101:bash.0 00010000:00010000:3.0:1787440299.317207:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440299.317227:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94c00/0x85f5fa77adf3cf88 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fab14535dc62432 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440299.317282:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94c00/0x85f5fa77adf3cf88 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62432 expref: 33 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440299.317296:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94c00/0x85f5fa77adf3cf88 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62432 expref: 33 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440299.317313:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ee05132e400) 00010000:00010000:3.0:1787440299.317317:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787440299.317320:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee049e94c00, rc 0) 00000100:00100000:3.0:1787440299.317391:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee080b45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+33:11073:x1874266681330304:12345-192.168.206.58@tcp:101:bash.0 Request processed in 210us (1101us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440299.317398:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 193 00010000:00010000:1.0:1787440299.318666:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fe00/0x85f5fa77adf3cf81 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440299.318678:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fe00/0x85f5fa77adf3cf81 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440299.318684:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fe00/0x85f5fa77adf3cf81 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440299.318690:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee07fb9fe00 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:1.0:1787440299.318694:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fe00/0x85f5fa77adf3cf81 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440299.318701:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fe00/0x85f5fa77adf3cf81 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440299.318716:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ee05132e400) 00010000:00010000:1.0:1787440299.318733:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440299.318738:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fe00/0x85f5fa77adf3cf81 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440299.318744:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fe00/0x85f5fa77adf3cf81 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440299.325018:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:1.0:1787440299.325115:0:12016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681330432 00000100:00100000:1.0:1787440299.325124:0:12016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681330432 00000100:00100000:1.0:1787440299.325221:0:12016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 58 00000100:00100000:1.0:1787440299.325232:0:12016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee080b46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+7:11073:x1874266681330432:12345-192.168.206.58@tcp:101:bash.0 00010000:00010000:1.0:1787440299.325251:0:12016:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440299.325272:0:12016:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002a4179b0/0x85f5fa77adf3cf8f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5fab14535dc62439 expref: -99 pid: 12016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787440299.325300:0:12016:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a8a2ca9, atime: 0x6a8a2ca8, ctime: 0x6a8a2ca9, blocks: 0xb 00010000:00010000:1.0:1787440299.325320:0:12016:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=397s v=(0 0) 00010000:00010000:1.0:1787440299.325325:0:12016:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787440299.325333:0:12016:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002a4179b0/0x85f5fa77adf3cf8f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62439 expref: 8 pid: 12016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440299.325349:0:12016:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002a4179b0/0x85f5fa77adf3cf8f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62439 expref: 8 pid: 12016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440299.325361:0:12016:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee07fb9e000, rc 0) 00000100:00100000:1.0:1787440299.325426:0:12016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee080b46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+8:11073:x1874266681330432:12345-192.168.206.58@tcp:101:bash.0 Request processed in 196us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440299.325433:0:12016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 58 00000100:00100000:2.0:1787440299.329995:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:1.0:1787440299.330103:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681330560 00000100:00100000:1.0:1787440299.330112:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681330560 00002000:00010000:1.0:1787440299.330151:0:6703:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:1.0:1787440299.330157:0:6703:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ee080b44000 with x1874266681330560 ext(0->18446744073709551615) 00002000:00010000:1.0:1787440299.330167:0:6703:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8ee080b44000. 00000100:00100000:1.0:1787440299.330201:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 5 00000100:00100000:1.0:1787440299.330211:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee080b44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+8:2362:x1874266681330560:12345-192.168.206.58@tcp:10:bash.0 00002000:00010000:1.0:1787440299.330487:0:6703:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:1.0:1787440299.330530:0:6703:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1787440297 -> 1787440299 00002000:00010000:1.0:1787440299.330533:0:6703:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 1787440296 -> 1787440296 00002000:00010000:1.0:1787440299.330536:0:6703:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1787440297 -> 1787440299 00002000:00010000:1.0:1787440299.330538:0:6703:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:1.0:1787440299.330591:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee080b44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+9:2362:x1874266681330560:12345-192.168.206.58@tcp:10:bash.0 Request processed in 380us (604us total) trans 4294967318 rc 0/0 00000100:00100000:1.0:1787440299.330598:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 5 00002000:00010000:1.0:1787440299.330602:0:6703:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:1.0:1787440299.330605:0:6703:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ee080b44000 with x1874266681330560 ext(0->18446744073709551615) 00002000:00010000:1.0:1787440299.330609:0:6703:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8ee080b44000. 00000100:00100000:3.0:1787440299.403547:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:1.0:1787440299.403779:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681330688 00000100:00100000:1.0:1787440299.403791:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681330688 00000100:00100000:1.0:1787440299.403856:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 194 00000100:00100000:1.0:1787440299.403866:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee05fb60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+32:11552:x1874266681330688:12345-192.168.206.58@tcp:34:lfs.0 00010000:00010000:1.0:1787440299.403967:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fe00/0x85f5fa77adf3cf96 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440299.403988:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fe00/0x85f5fa77adf3cf96 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440299.404345:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fe00/0x85f5fa77adf3cf96 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440299.404365:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f600/0x85f5fa77adf3cf9d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440299.404375:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f600/0x85f5fa77adf3cf9d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440299.404383:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f600/0x85f5fa77adf3cf9d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440299.405270:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fa00/0x85f5fa77adf3cfa4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440299.405284:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fa00/0x85f5fa77adf3cfa4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440299.405294:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fa00/0x85f5fa77adf3cfa4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787440299.405337:0:5850:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fa00/0x85f5fa77adf3cfa4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440299.405350:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fe00/0x85f5fa77adf3cf96 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440299.405357:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fe00/0x85f5fa77adf3cf96 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440299.407698:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fe00/0x85f5fa77adf3cf96 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440299.407727:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee07fb9fe00 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:1.0:1787440299.407732:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fe00/0x85f5fa77adf3cf96 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440299.407803:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fe00/0x85f5fa77adf3cf96 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440299.407822:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8ee05132ea00) 00010000:00010000:1.0:1787440299.407824:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440299.407829:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fe00/0x85f5fa77adf3cf96 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440299.408173:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fe00/0x85f5fa77adf3cf96 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440299.408193:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f600/0x85f5fa77adf3cf9d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440299.408199:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f600/0x85f5fa77adf3cf9d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440299.408204:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f600/0x85f5fa77adf3cf9d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440299.408208:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee07fb9f600 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:1.0:1787440299.408211:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f600/0x85f5fa77adf3cf9d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440299.408217:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f600/0x85f5fa77adf3cf9d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440299.408236:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8ee05132e500) 00010000:00010000:1.0:1787440299.408238:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440299.408242:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f600/0x85f5fa77adf3cf9d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440299.408247:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f600/0x85f5fa77adf3cf9d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440299.408266:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fa00/0x85f5fa77adf3cfa4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440299.408272:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fa00/0x85f5fa77adf3cfa4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440299.408277:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fa00/0x85f5fa77adf3cfa4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440299.408281:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee07fb9fa00 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:1.0:1787440299.408284:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fa00/0x85f5fa77adf3cfa4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440299.408290:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fa00/0x85f5fa77adf3cfa4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440299.408296:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ee05132e400) 00010000:00010000:1.0:1787440299.408299:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440299.408301:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fa00/0x85f5fa77adf3cfa4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440299.408306:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fa00/0x85f5fa77adf3cfa4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440299.408564:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee05fb60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+32:11552:x1874266681330688:12345-192.168.206.58@tcp:34:lfs.0 Request processed in 4694us (5021us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440299.408574:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 194 00000100:00100000:0.0:1787440299.421154:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee080b06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1874266701247488:0@lo:400:kworker.0 00000100:00100000:0.0:1787440299.421217:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440299.421272:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787440299.421277:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee07f9f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874266701247616:0@lo:400:kworker.0 00000100:00100000:0.0:1787440299.421314:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440299.421345:0:9225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701247616 00000100:00100000:0.0:1787440299.421350:0:9225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701247616 00000100:00100000:0.0:1787440299.421390:0:9225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1787440299.421398:0:9225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee080327800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1874266701247616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787440299.421442:0:9225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee080327800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1874266701247616:12345-0@lo:400:kworker.0 Request processed in 45us (126us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440299.421448:0:9225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1787440299.421483:0:3309:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967307 gen 2 00000004:00080000:0.0:1787440299.421488:0:3309:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967307 00000004:00080000:0.0:1787440299.421526:0:3309:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8ee080325880, transno 4294967307 00000100:00100000:0.0:1787440299.421551:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee07f9f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874266701247616:0@lo:400:kworker.0 00000100:00100000:0.0:1787440299.421569:0:6892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701247488 00000100:00100000:0.0:1787440299.421572:0:6892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701247488 00000100:00100000:0.0:1787440299.421837:0:6892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1787440299.421844:0:6892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee080327480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1874266701247488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787440299.421881:0:6892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee080327480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1874266701247488:12345-0@lo:400:kworker.0 Request processed in 38us (663us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440299.421887:0:6892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00080000:0.0:1787440299.421904:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787440299.421993:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee080b06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1874266701247488:0@lo:400:kworker.0 00000100:00100000:2.0:1787440299.422538:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee077cf0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874266701247360:0@lo:400:kworker.0 00000100:00100000:2.0:1787440299.422577:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440299.422620:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1787440299.422626:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee077cf3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:168176ea-29d1-49de-a254-317e90d54802:3312:1874266701247232:0@lo:400:kworker.0 00000100:00100000:2.0:1787440299.422649:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440299.422674:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee07f9f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3312:1874266701247744:0@lo:400:kworker.0 00000100:00100000:2.0:1787440299.422694:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440299.422718:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701247232 00000100:00100000:2.0:1787440299.422723:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701247232 00000100:00100000:2.0:1787440299.422753:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:2.0:1787440299.422760:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee06d271850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:168176ea-29d1-49de-a254-317e90d54802+19:3312:x1874266701247232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787440299.422793:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee06d271850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:168176ea-29d1-49de-a254-317e90d54802+19:3312:x1874266701247232:12345-0@lo:400:kworker.0 Request processed in 34us (143us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440299.422809:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:2.0:1787440299.422846:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee077cf3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:168176ea-29d1-49de-a254-317e90d54802:3312:1874266701247232:0@lo:400:kworker.0 00000100:00100000:1.0:1787440299.423105:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701247360 00000100:00100000:1.0:1787440299.423110:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701247360 00000100:00100000:1.0:1787440299.423146:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701247744 00000100:00100000:1.0:1787440299.423149:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701247744 00000100:00100000:1.0:1787440299.423185:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1787440299.423191:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee06e6ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874266701247360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440299.423229:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee06e6ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874266701247360:12345-0@lo:400:kworker.0 Request processed in 39us (652us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440299.423235:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1787440299.423248:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1787440299.423253:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee05fcdd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874266701247744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440299.423277:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee05fcdd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874266701247744:12345-0@lo:400:kworker.0 Request processed in 24us (582us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440299.423283:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00080000:1.0:1787440299.423299:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787440299.426054:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee07f9f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3312:1874266701247744:0@lo:400:kworker.0 00000100:00100000:2.0:1787440299.426083:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee077cf0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874266701247360:0@lo:400:kworker.0 00000100:00100000:2.0:1787440299.476641:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:1.0:1787440299.476783:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681330944 00000100:00100000:1.0:1787440299.476792:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681330944 00000100:00100000:1.0:1787440299.476852:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 195 00000100:00100000:1.0:1787440299.476861:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee05fcdc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+32:11555:x1874266681330944:12345-192.168.206.58@tcp:101:lfs.0 00010000:00010000:1.0:1787440299.477033:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440299.477054:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fa00/0x85f5fa77adf3cfab lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fab14535dc62440 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440299.477136:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f600/0x85f5fa77adf3cfb2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440299.477150:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f600/0x85f5fa77adf3cfb2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440299.477174:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f600/0x85f5fa77adf3cfb2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440299.477187:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fe00/0x85f5fa77adf3cfb9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440299.477195:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fe00/0x85f5fa77adf3cfb9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440299.477202:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fe00/0x85f5fa77adf3cfb9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440299.477595:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e400/0x85f5fa77adf3cfc0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440299.477605:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e400/0x85f5fa77adf3cfc0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440299.477613:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e400/0x85f5fa77adf3cfc0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787440299.477623:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1787440299.477711:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f600/0x85f5fa77adf3cfb2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440299.477719:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f600/0x85f5fa77adf3cfb2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440299.477726:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f600/0x85f5fa77adf3cfb2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440299.477730:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee07fb9f600 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:1.0:1787440299.477742:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f600/0x85f5fa77adf3cfb2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440299.477749:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f600/0x85f5fa77adf3cfb2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440299.477762:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8ee05132ea00) 00010000:00010000:1.0:1787440299.477765:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440299.477770:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f600/0x85f5fa77adf3cfb2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440299.477777:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f600/0x85f5fa77adf3cfb2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440299.477789:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fe00/0x85f5fa77adf3cfb9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440299.477794:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fe00/0x85f5fa77adf3cfb9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440299.477799:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fe00/0x85f5fa77adf3cfb9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440299.477803:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee07fb9fe00 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:1.0:1787440299.477805:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fe00/0x85f5fa77adf3cfb9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440299.477810:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fe00/0x85f5fa77adf3cfb9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440299.477816:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8ee05132e500) 00010000:00010000:1.0:1787440299.477818:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440299.477828:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fe00/0x85f5fa77adf3cfb9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440299.477833:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fe00/0x85f5fa77adf3cfb9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440299.478369:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fa00/0x85f5fa77adf3cfab lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62440 expref: 35 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440299.478387:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e400/0x85f5fa77adf3cfc0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62440 expref: 34 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440299.478394:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ee05132e400) 00010000:00010000:1.0:1787440299.478397:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1787440299.478400:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee07fb9e400, rc 0) 00000100:00100000:1.0:1787440299.478881:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee05fcdc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+34:11555:x1874266681330944:12345-192.168.206.58@tcp:101:lfs.0 Request processed in 2010us (2237us total) trans 4294967477 rc 0/0 00000100:00100000:1.0:1787440299.478891:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 195 00000100:00100000:2.0:1787440299.484568:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440299.485984:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681331072 00000100:00100000:0.0:1787440299.485995:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681331072 00000100:00100000:0.0:1787440299.486085:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 196 00000100:00100000:0.0:1787440299.486094:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee077cf0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+34:11555:x1874266681331072:12345-192.168.206.58@tcp:54:lfs.0 00010000:00010000:0.0:1787440299.486166:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcec00/0x85f5fa77adf3cfce lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440299.486196:0:5850:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce600/0x85f5fa77adf3cf73 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6242b expref: 34 pid: 6892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440299.486204:0:5850:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcec00/0x85f5fa77adf3cfce lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440299.486238:0:5850:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce600/0x85f5fa77adf3cf73 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6242b expref: 34 pid: 6892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440299.486252:0:5850:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce600/0x85f5fa77adf3cf73 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6242b expref: 34 pid: 6892 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440299.486266:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee080325880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5850:1874266701247872:192.168.206.58@tcp:104: 00000100:00100000:0.0:1787440299.486370:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee047f5e540 going to sleep for 11 seconds 00000100:00100000:0.0:1787440299.490132:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee080325880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5850:1874266701247872:192.168.206.58@tcp:104: 00010000:00010000:0.0:1787440299.490160:0:5850:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcec00/0x85f5fa77adf3cfce lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440299.497920:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440299.498140:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681331328 00000100:00100000:0.0:1787440299.498150:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681331328 00000100:00100000:0.0:1787440299.498211:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 52 00000100:00100000:0.0:1787440299.498221:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee077cf3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+35:5601:x1874266681331328:12345-192.168.206.58@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1787440299.498579:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee077cf3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+36:5601:x1874266681331328:12345-192.168.206.58@tcp:35:ldlm_bl.0 Request processed in 358us (666us total) trans 4294967478 rc 0/0 00000100:00100000:0.0:1787440299.498711:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 52 00000100:00100000:2.0:1787440299.511107:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440299.511248:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681331456 00000100:00100000:0.0:1787440299.511268:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681331456 00010000:00010000:0.0:1787440299.511305:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce600/0x85f5fa77adf3cf73 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6242b expref: 36 pid: 6892 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440299.511347:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 76 00000100:00100000:0.0:1787440299.511356:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee06e7e4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+36:2362:x1874266681331456:12345-192.168.206.58@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787440299.511489:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787440299.511656:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce600/0x85f5fa77adf3cf73 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6242b expref: 36 pid: 6892 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440299.511671:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce600/0x85f5fa77adf3cf73 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6242b expref: 36 pid: 6892 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440299.511694:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce600/0x85f5fa77adf3cf73 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6242b expref: 36 pid: 6892 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440299.511710:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ee05132e400) 00010000:00010000:0.0:1787440299.511714:0:5835:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcec00/0x85f5fa77adf3cfce lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440299.511723:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcec00/0x85f5fa77adf3cfce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440299.511731:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcec00/0x85f5fa77adf3cfce lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440299.512135:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787440299.512200:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee06e7e4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+35:2362:x1874266681331456:12345-192.168.206.58@tcp:103:ldlm_bl.0 Request processed in 843us (1098us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440299.512208:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 76 00010000:00010000:0.0:1787440299.514056:0:5850:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcec00/0x85f5fa77adf3cfce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440299.514080:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcec00/0x85f5fa77adf3cfce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440299.514129:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcec00/0x85f5fa77adf3cfce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440299.514136:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcec00/0x85f5fa77adf3cfce lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440299.514142:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcec00/0x85f5fa77adf3cfce lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440299.514148:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee04cbcec00 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:0.0:1787440299.514151:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcec00/0x85f5fa77adf3cfce lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440299.514158:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcec00/0x85f5fa77adf3cfce lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440299.514173:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ee05132e400) 00010000:00010000:0.0:1787440299.514175:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787440299.514179:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcec00/0x85f5fa77adf3cfce lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440299.514185:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcec00/0x85f5fa77adf3cfce lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440299.514262:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee077cf0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+34:11555:x1874266681331072:12345-192.168.206.58@tcp:54:lfs.0 Request processed in 28164us (29698us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440299.514271:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 196 00000100:00100000:2.0:1787440299.524090:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440299.524173:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681331712 00000100:00100000:0.0:1787440299.524183:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681331712 00000100:00100000:0.0:1787440299.524241:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 53 00000100:00100000:0.0:1787440299.524265:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee077cf3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+34:11555:x1874266681331712:12345-192.168.206.58@tcp:35:lfs.0 00000100:00100000:0.0:1787440299.524737:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee077cf3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+35:11555:x1874266681331712:12345-192.168.206.58@tcp:35:lfs.0 Request processed in 473us (653us total) trans 4294967479 rc 0/0 00000100:00100000:0.0:1787440299.524844:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 53 00000100:00100000:3.0:1787440299.690628:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440299.690755:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681331968 00000100:00100000:0.0:1787440299.690764:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681331968 00000100:00100000:0.0:1787440299.690823:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 197 00000100:00100000:0.0:1787440299.690845:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee05fb63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+35:11566:x1874266681331968:12345-192.168.206.58@tcp:101:cat.0 00010000:00010000:0.0:1787440299.690870:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440299.690890:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcec00/0x85f5fa77adf3cfd5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fab14535dc62447 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440299.690963:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce600/0x85f5fa77adf3cfdc lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440299.690977:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce600/0x85f5fa77adf3cfdc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440299.690990:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce600/0x85f5fa77adf3cfdc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440299.691004:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce800/0x85f5fa77adf3cfe3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440299.691012:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce800/0x85f5fa77adf3cfe3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440299.691019:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce800/0x85f5fa77adf3cfe3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440299.691376:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf600/0x85f5fa77adf3cfea lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440299.691386:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf600/0x85f5fa77adf3cfea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440299.691393:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf600/0x85f5fa77adf3cfea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787440299.691403:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:0.0:1787440299.691490:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce600/0x85f5fa77adf3cfdc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440299.691896:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce600/0x85f5fa77adf3cfdc lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440299.691902:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce600/0x85f5fa77adf3cfdc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440299.691908:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee04cbce600 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:0.0:1787440299.691913:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce600/0x85f5fa77adf3cfdc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440299.691920:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce600/0x85f5fa77adf3cfdc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440299.691932:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8ee05132ea00) 00010000:00010000:0.0:1787440299.691935:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440299.691940:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce600/0x85f5fa77adf3cfdc lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440299.691956:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce600/0x85f5fa77adf3cfdc lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440299.691969:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce800/0x85f5fa77adf3cfe3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440299.691975:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce800/0x85f5fa77adf3cfe3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440299.691980:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce800/0x85f5fa77adf3cfe3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440299.691985:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee04cbce800 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:0.0:1787440299.691988:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce800/0x85f5fa77adf3cfe3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440299.691994:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce800/0x85f5fa77adf3cfe3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440299.692001:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8ee050ca1e00) 00010000:00010000:0.0:1787440299.692004:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440299.692007:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce800/0x85f5fa77adf3cfe3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440299.692013:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce800/0x85f5fa77adf3cfe3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440299.693569:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcec00/0x85f5fa77adf3cfd5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62447 expref: 38 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440299.693595:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf600/0x85f5fa77adf3cfea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62447 expref: 37 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440299.693604:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ee05132e400) 00010000:00010000:2.0:1787440299.693607:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787440299.693610:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee04cbcf600, rc 0) 00000100:00100000:2.0:1787440299.693685:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee05fb63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+37:11566:x1874266681331968:12345-192.168.206.58@tcp:101:cat.0 Request processed in 2852us (3064us total) trans 4294967480 rc 0/0 00000100:00100000:2.0:1787440299.693695:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 197 00000100:00100000:2.0:1787440299.701918:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440299.702125:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681332224 00000100:00100000:3.0:1787440299.702136:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681332224 00000100:00100000:3.0:1787440299.702201:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 54 00000100:00100000:3.0:1787440299.702211:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee077cf0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+37:11566:x1874266681332224:12345-192.168.206.58@tcp:35:cat.0 00000100:00100000:3.0:1787440299.702443:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee077cf0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+38:11566:x1874266681332224:12345-192.168.206.58@tcp:35:cat.0 Request processed in 233us (533us total) trans 4294967481 rc 0/0 00000100:00100000:3.0:1787440299.702461:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 54 00000100:00100000:3.0:1787440299.742712:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:2.0:1787440299.742977:0:6892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681332480 00000100:00100000:2.0:1787440299.742986:0:6892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681332480 00000100:00100000:2.0:1787440299.743054:0:6892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 198 00000100:00100000:2.0:1787440299.743089:0:6892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee077838380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+38:11567:x1874266681332480:12345-192.168.206.58@tcp:36:rm.0 00010000:00010000:2.0:1787440299.743140:0:6892:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1787440299.743165:0:6892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf600/0x85f5fa77adf3cfea lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62447 expref: 38 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440299.743197:0:6892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e400/0x85f5fa77adf3cfc0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62440 expref: 37 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440299.743211:0:6892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94c00/0x85f5fa77adf3cf88 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62432 expref: 36 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440299.743222:0:6892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ee05132e400) 00010000:00010000:2.0:1787440299.743233:0:6892:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787440299.743252:0:6892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e400/0x85f5fa77adf3cff8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440299.743264:0:6892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e400/0x85f5fa77adf3cff8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440299.743273:0:6892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e400/0x85f5fa77adf3cff8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440299.743287:0:6892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86fc00/0x85f5fa77adf3cfff lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440299.743294:0:6892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86fc00/0x85f5fa77adf3cfff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440299.743301:0:6892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86fc00/0x85f5fa77adf3cfff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440299.743677:0:6892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e200/0x85f5fa77adf3d006 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440299.743686:0:6892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e200/0x85f5fa77adf3d006 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440299.743694:0:6892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e200/0x85f5fa77adf3d006 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787440299.745677:0:6892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].7, 64 off8712 00000004:00080000:2.0:1787440299.745691:0:6892:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 398116197793ns, next at 399116194979ns, rc = 0 00010000:00010000:2.0:1787440299.746142:0:6892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86ec00/0x85f5fa77adf3d00d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440299.746159:0:6892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86ec00/0x85f5fa77adf3d00d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440299.746171:0:6892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86ec00/0x85f5fa77adf3d00d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440299.746178:0:6892:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86ec00/0x85f5fa77adf3d00d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440299.746184:0:6892:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86ec00/0x85f5fa77adf3d00d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440299.746259:0:6892:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86ec00/0x85f5fa77adf3d00d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440299.746334:0:6892:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787440299.746358:0:6892:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e200/0x85f5fa77adf3d006 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440299.746373:0:6892:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e200/0x85f5fa77adf3d006 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440299.746380:0:6892:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e200/0x85f5fa77adf3d006 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440299.746386:0:6892:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee07f86e200 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:2.0:1787440299.746390:0:6892:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e200/0x85f5fa77adf3d006 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440299.746397:0:6892:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e200/0x85f5fa77adf3d006 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440299.746408:0:6892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ee054b3cc00) 00010000:00010000:2.0:1787440299.746411:0:6892:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787440299.746415:0:6892:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e200/0x85f5fa77adf3d006 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440299.746421:0:6892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e200/0x85f5fa77adf3d006 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440299.746459:0:6892:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e400/0x85f5fa77adf3cff8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440299.746465:0:6892:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e400/0x85f5fa77adf3cff8 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440299.746471:0:6892:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e400/0x85f5fa77adf3cff8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440299.746476:0:6892:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee07f86e400 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:2.0:1787440299.746511:0:6892:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e400/0x85f5fa77adf3cff8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440299.746519:0:6892:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e400/0x85f5fa77adf3cff8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440299.746527:0:6892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8ee05132ea00) 00010000:00010000:2.0:1787440299.746530:0:6892:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440299.746533:0:6892:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e400/0x85f5fa77adf3cff8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440299.746539:0:6892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e400/0x85f5fa77adf3cff8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787440299.746550:0:6892:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ca4cd84a reply state 000000005531f350 transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86fc00/0x85f5fa77adf3cfff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440299.746558:0:6892:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787440299.746648:0:6892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee077838380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+37:11567:x1874266681332480:12345-192.168.206.58@tcp:36:rm.0 Request processed in 3559us (3942us total) trans 4294967482 rc 0/0 00000100:00100000:2.0:1787440299.746657:0:6892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 198 00010000:00010000:3.0:1787440299.752475:0:5837:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787440299.752513:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86ec00/0x85f5fa77adf3d00d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440299.752526:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee07f86ec00 already unused, calling callback (ffffffffc15b52a0) 00010000:00010000:3.0:1787440299.752531:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86ec00/0x85f5fa77adf3d00d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440299.752541:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86ec00/0x85f5fa77adf3d00d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440299.752559:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ee054b3cc00) 00010000:00010000:3.0:1787440299.752563:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787440299.752567:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86ec00/0x85f5fa77adf3d00d lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440299.752573:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86ec00/0x85f5fa77adf3d00d lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440299.752597:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787440299.752599:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787440299.752614:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787440299.752972:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86fc00/0x85f5fa77adf3cfff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440299.752982:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86fc00/0x85f5fa77adf3cfff lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440299.752988:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86fc00/0x85f5fa77adf3cfff lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440299.752994:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee07f86fc00 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:3.0:1787440299.752998:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86fc00/0x85f5fa77adf3cfff lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440299.753078:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86fc00/0x85f5fa77adf3cfff lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440299.753089:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8ee054b3c600) 00010000:00010000:3.0:1787440299.753091:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440299.753094:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86fc00/0x85f5fa77adf3cfff lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440299.753100:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86fc00/0x85f5fa77adf3cfff lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440299.810109:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:1.0:1787440299.810378:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681332736 00000100:00100000:1.0:1787440299.810388:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681332736 00000100:00100000:1.0:1787440299.810448:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 199 00000100:00100000:1.0:1787440299.810458:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee077838000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+36:11573:x1874266681332736:12345-192.168.206.58@tcp:101:bash.0 00010000:00010000:1.0:1787440299.810526:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440299.810547:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fa00/0x85f5fa77adf3d014 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fab14535dc6244e expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440299.810713:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fe00/0x85f5fa77adf3d01b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440299.810728:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fe00/0x85f5fa77adf3d01b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440299.810752:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fe00/0x85f5fa77adf3d01b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440299.810768:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f600/0x85f5fa77adf3d022 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440299.810776:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f600/0x85f5fa77adf3d022 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440299.810783:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f600/0x85f5fa77adf3d022 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787440299.812263:0:5851:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:0.0:1787440299.812466:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce600/0x85f5fa77adf3d029 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440299.812520:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce600/0x85f5fa77adf3d029 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440299.812532:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce600/0x85f5fa77adf3d029 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440299.812574:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fe00/0x85f5fa77adf3d01b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440299.812824:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fe00/0x85f5fa77adf3d01b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440299.812905:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fe00/0x85f5fa77adf3d01b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440299.812912:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee07fb9fe00 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:0.0:1787440299.812916:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fe00/0x85f5fa77adf3d01b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440299.812924:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fe00/0x85f5fa77adf3d01b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440299.812937:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8ee05132ea00) 00010000:00010000:0.0:1787440299.812940:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440299.812944:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fe00/0x85f5fa77adf3d01b lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440299.812950:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fe00/0x85f5fa77adf3d01b lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787440299.812963:0:5851:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c0ccb741 reply state 000000002650ced0 transno 4294967483 ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f600/0x85f5fa77adf3d022 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440299.812979:0:5851:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787440299.813028:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fa00/0x85f5fa77adf3d014 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6244e expref: 39 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440299.813045:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce600/0x85f5fa77adf3d029 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6244e expref: 38 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440299.813052:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8ee050ca1e00) 00010000:00010000:0.0:1787440299.813055:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787440299.813069:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee04cbce600, rc 0) 00000100:00100000:0.0:1787440299.813154:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee077838000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+39:11573:x1874266681332736:12345-192.168.206.58@tcp:101:bash.0 Request processed in 2697us (3054us total) trans 4294967483 rc 0/0 00000100:00100000:0.0:1787440299.813164:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 199 00010000:00010000:1.0:1787440299.817415:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f600/0x85f5fa77adf3d022 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440299.817433:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f600/0x85f5fa77adf3d022 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440299.817442:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f600/0x85f5fa77adf3d022 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440299.817448:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee07fb9f600 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:1.0:1787440299.817454:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f600/0x85f5fa77adf3d022 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440299.817534:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f600/0x85f5fa77adf3d022 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440299.817552:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8ee05132e500) 00010000:00010000:1.0:1787440299.817556:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440299.817560:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f600/0x85f5fa77adf3d022 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440299.817567:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f600/0x85f5fa77adf3d022 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440299.823290:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:1.0:1787440299.826081:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681332864 00000100:00100000:1.0:1787440299.826095:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681332864 00000100:00100000:1.0:1787440299.826223:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 59 00000100:00100000:1.0:1787440299.826233:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee07783a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+5:2360:x1874266681332864:12345-192.168.206.58@tcp:101:bash.0 00010000:00010000:1.0:1787440299.826250:0:6695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440299.826270:0:6695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b7306a59/0x85f5fa77adf3d037 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5fab14535dc62455 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787440299.826298:0:6695:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787440299.826316:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=398s v=(0 0) 00010000:00010000:1.0:1787440299.826321:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787440299.826331:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b7306a59/0x85f5fa77adf3d037 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62455 expref: 6 pid: 6695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440299.826351:0:6695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b7306a59/0x85f5fa77adf3d037 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62455 expref: 6 pid: 6695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440299.826402:0:6695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee07fb9f600, rc 0) 00000100:00100000:1.0:1787440299.826690:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee07783a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+6:2360:x1874266681332864:12345-192.168.206.58@tcp:101:bash.0 Request processed in 457us (3409us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440299.826698:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 59 00000100:00100000:2.0:1787440299.832778:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440299.832868:0:12016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681332992 00000100:00100000:3.0:1787440299.832878:0:12016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681332992 00000100:00100000:3.0:1787440299.832934:0:12016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 60 00000100:00100000:3.0:1787440299.832944:0:12016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee077cf3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+6:11573:x1874266681332992:12345-192.168.206.58@tcp:101:bash.0 00010000:00010000:3.0:1787440299.832977:0:12016:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440299.832995:0:12016:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000de97f61a/0x85f5fa77adf3d03e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5fab14535dc6245c expref: -99 pid: 12016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440299.833038:0:12016:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b7306a59/0x85f5fa77adf3d037 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62455 expref: 7 pid: 6695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440299.833047:0:12016:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787440299.833052:0:12016:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787440299.833070:0:12016:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000de97f61a/0x85f5fa77adf3d03e lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6245c expref: 7 pid: 12016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440299.833103:0:12016:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b7306a59/0x85f5fa77adf3d037 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62455 expref: 7 pid: 6695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440299.833117:0:12016:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b7306a59/0x85f5fa77adf3d037 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62455 expref: 7 pid: 6695 timeout: 498 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440299.833130:0:12016:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee077839c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:12016:1874266701248000:192.168.206.58@tcp:104: 00000100:00100000:3.0:1787440299.833223:0:12016:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee047ed2cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787440299.838436:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440299.838551:0:12016:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee077839c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:12016:1874266701248000:192.168.206.58@tcp:104: 00010000:00010000:3.0:1787440299.838583:0:12016:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000de97f61a/0x85f5fa77adf3d03e lrc: 3/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6245c expref: 7 pid: 12016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440299.838603:0:12016:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee049e95400, rc 0) 00000100:00100000:3.0:1787440299.838682:0:12016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee077cf3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+7:11573:x1874266681332992:12345-192.168.206.58@tcp:101:bash.0 Request processed in 5738us (5912us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440299.838691:0:12016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 60 00000100:00100000:2.0:1787440299.839262:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681333120 00000100:00100000:2.0:1787440299.839270:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681333120 00010000:00010000:2.0:1787440299.839302:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b7306a59/0x85f5fa77adf3d037 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62455 expref: 7 pid: 6695 timeout: 498 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440299.839342:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 77 00000100:00100000:2.0:1787440299.839352:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee080325880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+7:2363:x1874266681333120:12345-192.168.206.58@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787440299.839376:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787440299.839407:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b7306a59/0x85f5fa77adf3d037 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62455 expref: 7 pid: 6695 timeout: 498 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440299.839420:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b7306a59/0x85f5fa77adf3d037 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62455 expref: 7 pid: 6695 timeout: 498 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440299.839442:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b7306a59/0x85f5fa77adf3d037 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62455 expref: 7 pid: 6695 timeout: 498 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440299.839457:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787440299.839461:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787440299.839469:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000de97f61a/0x85f5fa77adf3d03e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6245c expref: 6 pid: 12016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440299.839480:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000de97f61a/0x85f5fa77adf3d03e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6245c expref: 6 pid: 12016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440299.839579:0:5834:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000de97f61a/0x85f5fa77adf3d03e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6245c expref: 6 pid: 12016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440299.839594:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee08090fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5834:1874266701248128:192.168.206.58@tcp:105: 00000100:00100000:2.0:1787440299.839667:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee0807a9000 going to sleep for 11 seconds 00000100:00100000:2.0:1787440299.843292:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee08090fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5834:1874266701248128:192.168.206.58@tcp:105: 00010000:00010000:2.0:1787440299.843319:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787440299.843386:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee080325880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+6:2363:x1874266681333120:12345-192.168.206.58@tcp:103:ldlm_bl.0 Request processed in 4035us (4957us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440299.843412:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 77 00000100:00100000:3.0:1787440299.847561:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:1.0:1787440299.847782:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681333376 00000100:00100000:1.0:1787440299.847791:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681333376 00000100:00100000:1.0:1787440299.847848:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 55 00000100:00100000:1.0:1787440299.847859:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee077839c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+38:11573:x1874266681333376:12345-192.168.206.58@tcp:35:bash.0 00000100:00100000:1.0:1787440299.848479:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee077839c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+39:11573:x1874266681333376:12345-192.168.206.58@tcp:35:bash.0 Request processed in 620us (925us total) trans 4294967484 rc 0/0 00000100:00100000:1.0:1787440299.848488:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 55 00000100:00100000:2.0:1787440299.938937:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee07783b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1874266701248256:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787440299.939439:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440299.940746:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701248256 00000100:00100000:3.0:1787440299.940756:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701248256 00000100:00100000:3.0:1787440299.940819:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787440299.940840:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee08090fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1874266701248256:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787440299.940863:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3856662528 00000100:00100000:3.0:1787440299.940944:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee08090fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1874266701248256:12345-0@lo:13:osp-pre-1-0.0 Request processed in 115us (1505us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440299.940951:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787440299.942091:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee07783b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1874266701248256:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787440300.045028:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:2.0:1787440300.045853:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681333504 00000100:00100000:2.0:1787440300.045863:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681333504 00000100:00100000:2.0:1787440300.046054:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 200 00000100:00100000:2.0:1787440300.046078:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee080b06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+39:11589:x1874266681333504:12345-192.168.206.58@tcp:101:lfs.0 00010000:00010000:2.0:1787440300.046100:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440300.046119:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f000/0x85f5fa77adf3d045 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fab14535dc62463 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440300.046173:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e200/0x85f5fa77adf3d04c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440300.046186:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e200/0x85f5fa77adf3d04c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440300.046197:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e200/0x85f5fa77adf3d04c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787440300.046251:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:2.0:1787440300.046254:0:5850:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787440300.046272:0:5850:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e200/0x85f5fa77adf3d04c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440300.046292:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f000/0x85f5fa77adf3d045 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62463 expref: 41 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440300.046325:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e200/0x85f5fa77adf3d04c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62463 expref: 40 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440300.046333:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8ee05132ea00) 00010000:00010000:2.0:1787440300.046337:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787440300.046340:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee07f86e200, rc 0) 00000100:00100000:2.0:1787440300.046405:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee080b06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+40:11589:x1874266681333504:12345-192.168.206.58@tcp:101:lfs.0 Request processed in 331us (1487us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440300.052938:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:1.0:1787440300.054728:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681333760 00000100:00100000:2.0:1787440300.055123:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 200 00000100:00100000:1.0:1787440300.055207:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681333760 00000100:00100000:1.0:1787440300.055302:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 201 00000100:00100000:1.0:1787440300.055313:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee077838700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+40:11589:x1874266681333760:12345-192.168.206.58@tcp:101:lfs.0 00010000:00010000:1.0:1787440300.055333:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440300.055353:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9ee00/0x85f5fa77adf3d053 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fab14535dc6246a expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440300.055463:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e800/0x85f5fa77adf3d05a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440300.055478:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e800/0x85f5fa77adf3d05a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440300.055489:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e800/0x85f5fa77adf3d05a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787440300.055544:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1787440300.055681:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9ee00/0x85f5fa77adf3d053 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6246a expref: 43 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440300.055698:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e800/0x85f5fa77adf3d05a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6246a expref: 42 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440300.055709:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8ee050ca1e00) 00010000:00010000:1.0:1787440300.055711:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787440300.055714:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee07fb9e800, rc 0) 00000100:00100000:1.0:1787440300.055787:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee077838700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+42:11589:x1874266681333760:12345-192.168.206.58@tcp:101:lfs.0 Request processed in 476us (2865us total) trans 4294967485 rc 0/0 00000100:00100000:1.0:1787440300.055794:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 201 00000100:00100000:2.0:1787440300.063763:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:1.0:1787440300.063782:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681334016 00000100:00100000:1.0:1787440300.063792:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681334016 00000100:00100000:2.0:1787440300.063798:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:2.0:1787440300.063835:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 202 00000100:00100000:2.0:1787440300.063846:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee08090df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+42:11589:x1874266681334016:12345-192.168.206.58@tcp:101:lfs.0 00010000:00010000:2.0:1787440300.063870:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440300.063888:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e400/0x85f5fa77adf3d068 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fab14535dc62471 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440300.064039:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681334144 00000100:00100000:3.0:1787440300.064044:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681334144 00000100:00100000:3.0:1787440300.064091:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 14 00000100:00100000:3.0:1787440300.064099:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee08090ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+44:2363:x1874266681334144:12345-192.168.206.58@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787440300.064109:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787440300.064128:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e800/0x85f5fa77adf3d05a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6246a expref: 44 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440300.064144:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8ee050ca1e00) 00010000:00010000:3.0:1787440300.064148:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787440300.064205:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee08090ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+43:2363:x1874266681334144:12345-192.168.206.58@tcp:103:ldlm_bl.0 Request processed in 107us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440300.064212:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 14 00010000:00010000:2.0:1787440300.064377:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86fc00/0x85f5fa77adf3d06f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440300.064392:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86fc00/0x85f5fa77adf3d06f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440300.064401:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86fc00/0x85f5fa77adf3d06f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787440300.064415:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1787440300.064564:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e400/0x85f5fa77adf3d068 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62471 expref: 44 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440300.064580:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86fc00/0x85f5fa77adf3d06f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62471 expref: 43 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440300.064588:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8ee050ca1e00) 00010000:00010000:2.0:1787440300.064591:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787440300.064593:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee07f86fc00, rc 0) 00000100:00100000:2.0:1787440300.064674:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee08090df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+43:11589:x1874266681334016:12345-192.168.206.58@tcp:101:lfs.0 Request processed in 829us (928us total) trans 4294967486 rc 0/0 00000100:00100000:2.0:1787440300.064680:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 202 00000100:00100000:2.0:1787440300.079592:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440300.079691:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681334272 00000100:00100000:0.0:1787440300.079700:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681334272 00000100:00100000:0.0:1787440300.079835:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 61 00000100:00100000:0.0:1787440300.079847:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee08090c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+6:2363:x1874266681334272:12345-192.168.206.58@tcp:1:lfs.0 00010000:00010000:0.0:1787440300.079890:0:6697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c54b44d4/0x85f5fa77adf3d07d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440300.079909:0:6697:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000de97f61a/0x85f5fa77adf3d03e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6245c expref: 6 pid: 12016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440300.079917:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787440300.079934:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787440300.079939:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c54b44d4/0x85f5fa77adf3d07d lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440300.079984:0:6697:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000de97f61a/0x85f5fa77adf3d03e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6245c expref: 6 pid: 12016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440300.080000:0:6697:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000de97f61a/0x85f5fa77adf3d03e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6245c expref: 6 pid: 12016 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440300.080014:0:6697:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee0800a5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6697:1874266701248384:192.168.206.58@tcp:104: 00000100:00100000:0.0:1787440300.080113:0:6697:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee06d3b2240 going to sleep for 11 seconds 00000100:00100000:2.0:1787440300.083631:0:6697:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee0800a5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6697:1874266701248384:192.168.206.58@tcp:104: 00010000:00010000:2.0:1787440300.083660:0:6697:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c54b44d4/0x85f5fa77adf3d07d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1787440300.084719:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787440300.086830:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:1.0:1787440300.086978:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681334400 00000100:00100000:1.0:1787440300.086986:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681334400 00002000:00100000:1.0:1787440300.087034:0:6701:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff8ee08090e680 x1874266681334400/t0(0) o4->792563a7-4c22-4ac7-ac25-d49ef7fb41a8@192.168.206.58@tcp:461/0 lens 504/0 e 0 to 0 dl 1787440311 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787440300.087044:0:6701:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ee08090e680 with x1874266681334400 ext(0->8) 00010000:00010000:1.0:1787440300.087053:0:6701:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000de97f61a/0x85f5fa77adf3d03e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6245c expref: 7 pid: 12016 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440300.087079:0:6701:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000de97f61a/0x85f5fa77adf3d03e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6245c expref: 7 pid: 12016 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787440300.087101:0:6701:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8ee08090e680 00000100:00100000:1.0:1787440300.087135:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 3 00000100:00100000:1.0:1787440300.087143:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee08090e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+7:2362:x1874266681334400:12345-192.168.206.58@tcp:4:lfs.0 00000100:00100000:1.0:1787440300.087844:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee08090e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+9:2362:x1874266681334400:12345-192.168.206.58@tcp:4:lfs.0 Request processed in 698us (1019us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1787440300.087853:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 3 00002000:00100000:1.0:1787440300.087860:0:6701:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff8ee08090e680 x1874266681334400/t4294967308(0) o4->792563a7-4c22-4ac7-ac25-d49ef7fb41a8@192.168.206.58@tcp:461/0 lens 504/448 e 0 to 0 dl 1787440311 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787440300.087869:0:6701:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ee08090e680 with x1874266681334400 ext(0->8) 00010000:00010000:1.0:1787440300.087875:0:6701:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000de97f61a/0x85f5fa77adf3d03e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6245c expref: 9 pid: 12016 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440300.087888:0:6701:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000de97f61a/0x85f5fa77adf3d03e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6245c expref: 9 pid: 12016 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787440300.087896:0:6701:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8ee08090e680 00000100:00100000:0.0:1787440300.096669:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:1.0:1787440300.096889:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681334528 00000100:00100000:1.0:1787440300.096899:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681334528 00010000:00010000:1.0:1787440300.096937:0:6711:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000de97f61a/0x85f5fa77adf3d03e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6245c expref: 9 pid: 12016 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440300.097047:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 78 00000100:00100000:1.0:1787440300.097066:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee0800a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+9:2363:x1874266681334528:12345-192.168.206.58@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787440300.097097:0:6711:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1787440300.097116:0:6711:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1787440300.097119:0:6711:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1787440300 00002000:00010000:1.0:1787440300.097121:0:6711:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1787440300 00002000:00010000:1.0:1787440300.097124:0:6711:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1787440300 00010000:00010000:1.0:1787440300.097130:0:6711:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000de97f61a/0x85f5fa77adf3d03e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6245c expref: 9 pid: 12016 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440300.097145:0:6711:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000de97f61a/0x85f5fa77adf3d03e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6245c expref: 9 pid: 12016 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440300.097166:0:6711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000de97f61a/0x85f5fa77adf3d03e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6245c expref: 9 pid: 12016 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440300.097182:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787440300.097187:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787440300.097192:0:6711:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c54b44d4/0x85f5fa77adf3d07d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440300.097201:0:6711:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c54b44d4/0x85f5fa77adf3d07d lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440300.097238:0:6711:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787440300.097293:0:6697:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c54b44d4/0x85f5fa77adf3d07d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440300.097302:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee0800a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+8:2363:x1874266681334528:12345-192.168.206.58@tcp:103:ldlm_bl.0 Request processed in 245us (640us total) trans 0 rc 0/0 00010000:00010000:0.0:1787440300.097311:0:6697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c54b44d4/0x85f5fa77adf3d07d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440300.097316:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 78 00010000:00010000:0.0:1787440300.097342:0:6697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c54b44d4/0x85f5fa77adf3d07d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440300.097554:0:6697:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c54b44d4/0x85f5fa77adf3d07d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440300.097563:0:6697:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c54b44d4/0x85f5fa77adf3d07d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440300.097583:0:6697:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee04cbce200 already unused, calling callback (ffffffffc15b52a0) 00010000:00010000:0.0:1787440300.097587:0:6697:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c54b44d4/0x85f5fa77adf3d07d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440300.097595:0:6697:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c54b44d4/0x85f5fa77adf3d07d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440300.097607:0:6697:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c54b44d4/0x85f5fa77adf3d07d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440300.097615:0:6697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c54b44d4/0x85f5fa77adf3d07d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440300.097666:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee08090c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+7:2363:x1874266681334272:12345-192.168.206.58@tcp:1:lfs.0 Request processed in 17822us (18082us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440300.097673:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 61 00000100:00100000:0.0:1787440300.106360:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:1.0:1787440300.112086:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681334784 00000100:00100000:1.0:1787440300.112100:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681334784 00000100:00100000:0.0:1787440300.119996:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 56 00000100:00100000:0.0:1787440300.120013:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee079baf450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+43:11589:x1874266681334784:12345-192.168.206.58@tcp:35:lfs.0 00000004:00010000:0.0:1787440300.120096:0:5853:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86fc00/0x85f5fa77adf3d06f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62471 expref: 43 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787440300.120375:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:0.0:1787440300.120435:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00000001:00080000:0.0:1787440300.121853:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00010000:00010000:0.0:1787440300.121925:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce200/0x85f5fa77adf3d084 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440300.121942:0:5853:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce600/0x85f5fa77adf3d029 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6244e expref: 47 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440300.121951:0:5853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce200/0x85f5fa77adf3d084 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440300.121985:0:5853:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce600/0x85f5fa77adf3d029 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6244e expref: 47 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440300.122001:0:5853:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce600/0x85f5fa77adf3d029 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6244e expref: 47 pid: 5851 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440300.122014:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee0800a6680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5853:1874266701248512:192.168.206.58@tcp:104: 00000100:00100000:0.0:1787440300.122116:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee042d78840 going to sleep for 11 seconds 00010000:00010000:1.0:1787440300.125078:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787440300.126203:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee0800a6680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5853:1874266701248512:192.168.206.58@tcp:104: 00010000:00010000:3.0:1787440300.126245:0:5853:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce200/0x85f5fa77adf3d084 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440300.126900:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440300.126975:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681334912 00000100:00100000:3.0:1787440300.126983:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681334912 00010000:00010000:3.0:1787440300.127019:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce600/0x85f5fa77adf3d029 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6244e expref: 48 pid: 5851 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440300.127075:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 79 00000100:00100000:3.0:1787440300.127085:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee0800a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+48:2361:x1874266681334912:12345-192.168.206.58@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787440300.127099:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787440300.127107:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce600/0x85f5fa77adf3d029 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6244e expref: 48 pid: 5851 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440300.127118:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce600/0x85f5fa77adf3d029 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6244e expref: 48 pid: 5851 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440300.127140:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce600/0x85f5fa77adf3d029 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6244e expref: 48 pid: 5851 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440300.127156:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8ee050ca1e00) 00010000:00010000:3.0:1787440300.127161:0:5836:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce200/0x85f5fa77adf3d084 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440300.127169:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce200/0x85f5fa77adf3d084 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440300.127176:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce200/0x85f5fa77adf3d084 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440300.127226:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787440300.127293:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee0800a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+47:2361:x1874266681334912:12345-192.168.206.58@tcp:103:ldlm_bl.0 Request processed in 209us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440300.127302:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 79 00010000:00010000:0.0:1787440300.127369:0:5853:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce200/0x85f5fa77adf3d084 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440300.127376:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce200/0x85f5fa77adf3d084 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787440300.127541:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000001:00080000:0.0:1787440300.127728:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:0.0:1787440300.127827:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee0800a4380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5853:1874266701248640:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787440300.127871:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440300.127897:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee042d78480 going to sleep for 11 seconds 00000100:00100000:3.0:1787440300.128033:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701248640 00000100:00100000:3.0:1787440300.128038:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701248640 00000100:00100000:3.0:1787440300.128098:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787440300.128107:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee0800a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5853:x1874266701248640:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1787440300.128175:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee0800a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5853:x1874266701248640:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 70us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440300.128183:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:0.0:1787440300.128234:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787440300.128262:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee0800a4380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5853:1874266701248640:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1787440300.128812:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00000100:00100000:0.0:1787440300.128870:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee0800a4380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5853:1874266701248768:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787440300.128901:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440300.128923:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee042d780c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787440300.129052:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701248768 00000100:00100000:3.0:1787440300.129068:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701248768 00000100:00100000:3.0:1787440300.129094:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787440300.129100:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee0800a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5853:x1874266701248768:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1787440300.129249:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee0800a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5853:x1874266701248768:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 147us (345us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1787440300.129256:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787440300.130019:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee0800a4380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5853:1874266701248768:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1787440300.130096:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:0.0:1787440300.130140:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce200/0x85f5fa77adf3d084 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440300.130151:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce200/0x85f5fa77adf3d084 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440300.130158:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce200/0x85f5fa77adf3d084 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440300.130163:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee04cbce200 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:0.0:1787440300.130168:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce200/0x85f5fa77adf3d084 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440300.130175:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce200/0x85f5fa77adf3d084 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440300.130201:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8ee050ca1e00) 00010000:00010000:0.0:1787440300.130203:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1787440300.130209:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce200/0x85f5fa77adf3d084 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440300.130214:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce200/0x85f5fa77adf3d084 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787440300.130399:0:5853:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1787440300.130517:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00000004:00080000:0.0:1787440300.130530:0:5853:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 398501036477ns, next at 399501033220ns, rc = 0 00000001:00080000:0.0:1787440300.130537:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967494 00010000:00010000:0.0:1787440300.130571:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8ee050ca1e00) 00010000:00010000:0.0:1787440300.130575:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787440300.130582:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86fc00/0x85f5fa77adf3d06f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62471 expref: 51 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440300.130678:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee079baf450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+50:11589:x1874266681334784:12345-192.168.206.58@tcp:35:lfs.0 Request processed in 10669us (24327us total) trans 4294967495 rc 0/0 00000100:00100000:0.0:1787440300.130687:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 56 00000020:00080000:0.0:1787440300.130691:0:5853:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1787440300.138175:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440300.138343:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681335040 00000100:00100000:3.0:1787440300.138352:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681335040 00000100:00100000:3.0:1787440300.138403:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 203 00000100:00100000:3.0:1787440300.138411:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee05fb60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+50:11589:x1874266681335040:12345-192.168.206.58@tcp:101:lfs.0 00010000:00010000:3.0:1787440300.138433:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440300.138453:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95c00/0x85f5fa77adf3d08b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fab14535dc62478 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440300.138696:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95c00/0x85f5fa77adf3d08b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62478 expref: 51 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440300.138711:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95c00/0x85f5fa77adf3d08b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62478 expref: 51 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440300.138730:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8ee0460cc100) 00010000:00010000:3.0:1787440300.138733:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787440300.138746:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee049e95c00, rc 0) 00000100:00100000:3.0:1787440300.138808:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee05fb60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+51:11589:x1874266681335040:12345-192.168.206.58@tcp:101:lfs.0 Request processed in 397us (641us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440300.138817:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 203 00000100:00100000:3.0:1787440300.143965:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:2.0:1787440300.144271:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681335296 00000100:00100000:2.0:1787440300.144280:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681335296 00000100:00100000:2.0:1787440300.144376:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 57 00000100:00100000:2.0:1787440300.144387:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee077839c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+51:11589:x1874266681335296:12345-192.168.206.58@tcp:35:lfs.0 00000100:00100000:2.0:1787440300.144784:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee077839c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+52:11589:x1874266681335296:12345-192.168.206.58@tcp:35:lfs.0 Request processed in 398us (828us total) trans 4294967496 rc 0/0 00000100:00100000:2.0:1787440300.144791:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 57 00000100:00100000:2.0:1787440300.273813:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440300.274016:0:6892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681335424 00000100:00100000:0.0:1787440300.274030:0:6892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681335424 00000100:00100000:0.0:1787440300.274105:0:6892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 204 00000100:00100000:0.0:1787440300.274116:0:6892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee08090c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+52:11599:x1874266681335424:12345-192.168.206.58@tcp:34:lfs.0 00010000:00010000:0.0:1787440300.274203:0:6892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce200/0x85f5fa77adf3d092 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440300.274220:0:6892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce200/0x85f5fa77adf3d092 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440300.274233:0:6892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce200/0x85f5fa77adf3d092 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440300.274253:0:6892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcee00/0x85f5fa77adf3d099 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440300.274271:0:6892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcee00/0x85f5fa77adf3d099 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440300.274280:0:6892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcee00/0x85f5fa77adf3d099 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440300.274383:0:6892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf200/0x85f5fa77adf3d0a0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440300.274391:0:6892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf200/0x85f5fa77adf3d0a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440300.274398:0:6892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf200/0x85f5fa77adf3d0a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787440300.274460:0:6892:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf200/0x85f5fa77adf3d0a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440300.274475:0:6892:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce200/0x85f5fa77adf3d092 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440300.274481:0:6892:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce200/0x85f5fa77adf3d092 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440300.274488:0:6892:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce200/0x85f5fa77adf3d092 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440300.274528:0:6892:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee04cbce200 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:0.0:1787440300.274533:0:6892:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce200/0x85f5fa77adf3d092 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440300.274542:0:6892:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce200/0x85f5fa77adf3d092 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440300.274563:0:6892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8ee05132ea00) 00010000:00010000:0.0:1787440300.274566:0:6892:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440300.274572:0:6892:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce200/0x85f5fa77adf3d092 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440300.274578:0:6892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce200/0x85f5fa77adf3d092 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440300.274594:0:6892:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcee00/0x85f5fa77adf3d099 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440300.274600:0:6892:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcee00/0x85f5fa77adf3d099 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440300.274605:0:6892:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcee00/0x85f5fa77adf3d099 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440300.274609:0:6892:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee04cbcee00 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:0.0:1787440300.274612:0:6892:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcee00/0x85f5fa77adf3d099 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440300.274617:0:6892:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcee00/0x85f5fa77adf3d099 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440300.274623:0:6892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8ee050ca1e00) 00010000:00010000:0.0:1787440300.274625:0:6892:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440300.274628:0:6892:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcee00/0x85f5fa77adf3d099 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440300.274633:0:6892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcee00/0x85f5fa77adf3d099 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440300.274657:0:6892:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf200/0x85f5fa77adf3d0a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440300.274663:0:6892:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf200/0x85f5fa77adf3d0a0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440300.274668:0:6892:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf200/0x85f5fa77adf3d0a0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440300.274673:0:6892:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee04cbcf200 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:0.0:1787440300.274676:0:6892:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf200/0x85f5fa77adf3d0a0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440300.274681:0:6892:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf200/0x85f5fa77adf3d0a0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440300.274687:0:6892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8ee0460cc100) 00010000:00010000:0.0:1787440300.274689:0:6892:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440300.274692:0:6892:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf200/0x85f5fa77adf3d0a0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440300.274697:0:6892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf200/0x85f5fa77adf3d0a0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440300.274778:0:6892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee08090c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+52:11599:x1874266681335424:12345-192.168.206.58@tcp:34:lfs.0 Request processed in 663us (973us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440300.274787:0:6892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 204 00000100:00100000:3.0:1787440300.315733:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:1.0:1787440300.316028:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681335680 00000100:00100000:1.0:1787440300.316038:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681335680 00000100:00100000:1.0:1787440300.316105:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 205 00000100:00100000:1.0:1787440300.316114:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee07783b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+52:11602:x1874266681335680:12345-192.168.206.58@tcp:101:lfs.0 00010000:00010000:1.0:1787440300.316133:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440300.316152:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9ee00/0x85f5fa77adf3d0a7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fab14535dc6247f expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440300.316327:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f200/0x85f5fa77adf3d0ae lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440300.316342:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f200/0x85f5fa77adf3d0ae lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440300.316352:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f200/0x85f5fa77adf3d0ae lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440300.316364:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f000/0x85f5fa77adf3d0b5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440300.316371:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f000/0x85f5fa77adf3d0b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440300.316378:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f000/0x85f5fa77adf3d0b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440300.316564:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9ea00/0x85f5fa77adf3d0bc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440300.316591:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9ea00/0x85f5fa77adf3d0bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440300.316597:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9ea00/0x85f5fa77adf3d0bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787440300.316607:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1787440300.316703:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f200/0x85f5fa77adf3d0ae lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440300.316711:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f200/0x85f5fa77adf3d0ae lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440300.316717:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f200/0x85f5fa77adf3d0ae lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440300.316722:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee07fb9f200 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:1.0:1787440300.316726:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f200/0x85f5fa77adf3d0ae lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440300.316733:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f200/0x85f5fa77adf3d0ae lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440300.317003:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8ee05132ea00) 00010000:00010000:1.0:1787440300.317007:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440300.317012:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f200/0x85f5fa77adf3d0ae lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440300.317018:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f200/0x85f5fa77adf3d0ae lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440300.317031:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f000/0x85f5fa77adf3d0b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440300.317044:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f000/0x85f5fa77adf3d0b5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440300.317050:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f000/0x85f5fa77adf3d0b5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440300.317066:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee07fb9f000 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:1.0:1787440300.317069:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f000/0x85f5fa77adf3d0b5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440300.317075:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f000/0x85f5fa77adf3d0b5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440300.317083:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8ee05132e400) 00010000:00010000:1.0:1787440300.317086:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440300.317089:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f000/0x85f5fa77adf3d0b5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440300.317094:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f000/0x85f5fa77adf3d0b5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440300.317137:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9ee00/0x85f5fa77adf3d0a7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6247f expref: 55 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440300.317150:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9ea00/0x85f5fa77adf3d0bc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6247f expref: 54 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440300.317158:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8ee0460cc100) 00010000:00010000:1.0:1787440300.317160:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787440300.317169:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee07fb9ea00, rc 0) 00000100:00100000:1.0:1787440300.317545:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee07783b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+54:11602:x1874266681335680:12345-192.168.206.58@tcp:101:lfs.0 Request processed in 1431us (1818us total) trans 4294967497 rc 0/0 00000100:00100000:1.0:1787440300.317554:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 205 00000100:00100000:3.0:1787440300.329331:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440300.332712:0:6892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681335808 00000100:00100000:0.0:1787440300.332728:0:6892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681335808 00000100:00100000:0.0:1787440300.332809:0:6892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 206 00000100:00100000:0.0:1787440300.332835:0:6892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04a658a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+54:11602:x1874266681335808:12345-192.168.206.58@tcp:54:lfs.0 00010000:00010000:0.0:1787440300.332905:0:6892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf200/0x85f5fa77adf3d0ca lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440300.332922:0:6892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf200/0x85f5fa77adf3d0ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440300.333085:0:6892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf200/0x85f5fa77adf3d0ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440300.333115:0:6892:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf200/0x85f5fa77adf3d0ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440300.333122:0:6892:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf200/0x85f5fa77adf3d0ca lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440300.333128:0:6892:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf200/0x85f5fa77adf3d0ca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440300.333134:0:6892:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee04cbcf200 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:0.0:1787440300.333138:0:6892:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf200/0x85f5fa77adf3d0ca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440300.333144:0:6892:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf200/0x85f5fa77adf3d0ca lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440300.333155:0:6892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8ee0460cc100) 00010000:00010000:0.0:1787440300.333158:0:6892:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787440300.333162:0:6892:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf200/0x85f5fa77adf3d0ca lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440300.333168:0:6892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf200/0x85f5fa77adf3d0ca lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440300.333391:0:6892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04a658a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+54:11602:x1874266681335808:12345-192.168.206.58@tcp:54:lfs.0 Request processed in 557us (4068us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440300.333399:0:6892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 206 00000100:00100000:0.0:1787440300.339136:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:2.0:1787440300.339232:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681336064 00000100:00100000:2.0:1787440300.339241:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681336064 00000100:00100000:2.0:1787440300.339298:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 58 00000100:00100000:2.0:1787440300.339308:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee077cf3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+54:11602:x1874266681336064:12345-192.168.206.58@tcp:35:lfs.0 00000100:00100000:2.0:1787440300.339577:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee077cf3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+55:11602:x1874266681336064:12345-192.168.206.58@tcp:35:lfs.0 Request processed in 270us (449us total) trans 4294967498 rc 0/0 00000100:00100000:2.0:1787440300.340036:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 58 00000100:00100000:3.0:1787440300.430698:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440300.432861:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681336320 00000100:00100000:0.0:1787440300.432887:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681336320 00000100:00100000:0.0:1787440300.432993:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 207 00000100:00100000:0.0:1787440300.433021:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04a65a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+55:11612:x1874266681336320:12345-192.168.206.58@tcp:101:bash.0 00010000:00010000:0.0:1787440300.433080:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440300.433083:0:5851:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787440300.433118:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e200/0x85f5fa77adf3d04c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62463 expref: 55 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440300.433151:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8ee05132ea00) 00010000:00010000:0.0:1787440300.433156:0:5851:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787440300.433192:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf200/0x85f5fa77adf3d0d1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fab14535dc62486 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440300.433282:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcee00/0x85f5fa77adf3d0d8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440300.433296:0:5851:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9ea00/0x85f5fa77adf3d0bc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6247f expref: 55 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440300.433306:0:5851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcee00/0x85f5fa77adf3d0d8 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440300.433969:0:5851:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9ea00/0x85f5fa77adf3d0bc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6247f expref: 55 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440300.433998:0:5851:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9ea00/0x85f5fa77adf3d0bc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6247f expref: 55 pid: 5849 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440300.434048:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee077cf3480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5851:1874266701248896:192.168.206.58@tcp:104: 00000100:00100000:0.0:1787440300.434216:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee0462846c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787440300.446235:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:2.0:1787440300.446829:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681336448 00000100:00100000:2.0:1787440300.446839:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681336448 00010000:00010000:2.0:1787440300.446880:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9ea00/0x85f5fa77adf3d0bc lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6247f expref: 56 pid: 5849 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440300.446926:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 80 00000100:00100000:2.0:1787440300.446935:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04a659500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+56:2363:x1874266681336448:12345-192.168.206.58@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787440300.446950:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787440300.446957:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9ea00/0x85f5fa77adf3d0bc lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6247f expref: 56 pid: 5849 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440300.446971:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9ea00/0x85f5fa77adf3d0bc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6247f expref: 56 pid: 5849 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440300.446994:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8ee0460cc100) 00010000:00010000:2.0:1787440300.447000:0:5834:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcee00/0x85f5fa77adf3d0d8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440300.447009:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcee00/0x85f5fa77adf3d0d8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440300.447032:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcee00/0x85f5fa77adf3d0d8 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440300.447051:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787440300.447119:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04a659500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+56:2363:x1874266681336448:12345-192.168.206.58@tcp:103:ldlm_bl.0 Request processed in 184us (891us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440300.447127:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 80 00010000:00010000:0.0:1787440300.447761:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9ea00/0x85f5fa77adf3d0bc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6247f expref: 55 pid: 5849 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440300.447782:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee077cf3480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5851:1874266701248896:192.168.206.58@tcp:104: 00010000:00010000:0.0:1787440300.447813:0:5851:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcee00/0x85f5fa77adf3d0d8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440300.447822:0:5851:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcee00/0x85f5fa77adf3d0d8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440300.447828:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcee00/0x85f5fa77adf3d0d8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787440300.447847:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1787440300.448002:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf200/0x85f5fa77adf3d0d1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62486 expref: 56 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440300.448017:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcee00/0x85f5fa77adf3d0d8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62486 expref: 55 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440300.448038:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8ee0460cc100) 00010000:00010000:0.0:1787440300.448041:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787440300.448044:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee04cbcee00, rc 0) 00000100:00100000:0.0:1787440300.448103:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04a65a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+55:11612:x1874266681336320:12345-192.168.206.58@tcp:101:bash.0 Request processed in 15085us (17413us total) trans 4294967499 rc 0/0 00000100:00100000:0.0:1787440300.448111:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 207 00000100:00100000:3.0:1787440300.457164:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440300.458271:0:6892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681336704 00000100:00100000:0.0:1787440300.458283:0:6892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681336704 00000100:00100000:0.0:1787440300.458355:0:6892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 208 00000100:00100000:0.0:1787440300.458366:0:6892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04a65bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+55:11612:x1874266681336704:12345-192.168.206.58@tcp:36:bash.0 00010000:00010000:0.0:1787440300.458667:0:6892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce200/0x85f5fa77adf3d0e6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440300.458685:0:6892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce200/0x85f5fa77adf3d0e6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440300.458697:0:6892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce200/0x85f5fa77adf3d0e6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787440300.458745:0:6892:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967500 00000004:00010000:0.0:1787440300.458770:0:6892:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c4f49c10 reply state 00000000e5d2fad4 transno 4294967501 ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce200/0x85f5fa77adf3d0e6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440300.458778:0:6892:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787440300.458875:0:6892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04a65bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+58:11612:x1874266681336704:12345-192.168.206.58@tcp:36:bash.0 Request processed in 510us (1719us total) trans 4294967501 rc 0/0 00000100:00100000:0.0:1787440300.458882:0:6892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 208 00000020:00080000:0.0:1787440300.458894:0:6892:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1787440300.466449:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:1.0:1787440300.466605:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681336832 00000100:00100000:1.0:1787440300.466614:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681336832 00000100:00100000:1.0:1787440300.466673:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 209 00000100:00100000:1.0:1787440300.466683:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee08090f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+58:11612:x1874266681336832:12345-192.168.206.58@tcp:101:bash.0 00010000:00010000:1.0:1787440300.466709:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440300.466729:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f000/0x85f5fa77adf3d0ed lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fab14535dc6248d expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440300.466820:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f200/0x85f5fa77adf3d0f4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440300.466835:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcee00/0x85f5fa77adf3d0d8 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62486 expref: 59 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440300.466844:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce200/0x85f5fa77adf3d0e6 lrc: 2/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440300.466851:0:5849:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f200/0x85f5fa77adf3d0f4 lrc: 5/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440300.466868:0:5849:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce200/0x85f5fa77adf3d0e6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440300.466893:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcee00/0x85f5fa77adf3d0d8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62486 expref: 59 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440300.466925:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcee00/0x85f5fa77adf3d0d8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62486 expref: 59 pid: 5851 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440300.466940:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee07f9f3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5849:1874266701249024:192.168.206.58@tcp:104: 00000100:00100000:1.0:1787440300.467027:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee047c02480 going to sleep for 11 seconds 00010000:00010000:3.0:1787440300.472104:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce200/0x85f5fa77adf3d0e6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440300.472122:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce200/0x85f5fa77adf3d0e6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440300.472130:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce200/0x85f5fa77adf3d0e6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440300.472136:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee04cbce200 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:3.0:1787440300.472156:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce200/0x85f5fa77adf3d0e6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440300.472174:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce200/0x85f5fa77adf3d0e6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000020 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440300.472192:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8ee0460cc100) 00010000:00010000:3.0:1787440300.472195:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440300.472199:0:3296:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f200/0x85f5fa77adf3d0f4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440300.472210:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce200/0x85f5fa77adf3d0e6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440300.472217:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce200/0x85f5fa77adf3d0e6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440300.475470:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee07f9f3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5849:1874266701249024:192.168.206.58@tcp:104: 00000100:00100000:2.0:1787440300.475650:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00010000:00010000:1.0:1787440300.476117:0:5849:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f200/0x85f5fa77adf3d0f4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440300.476729:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681336960 00000100:00100000:3.0:1787440300.476752:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681336960 00010000:00010000:3.0:1787440300.476959:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcee00/0x85f5fa77adf3d0d8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62486 expref: 59 pid: 5851 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440300.477069:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 81 00000100:00100000:3.0:1787440300.477081:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee08090c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+59:2360:x1874266681336960:12345-192.168.206.58@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787440300.477096:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787440300.477103:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcee00/0x85f5fa77adf3d0d8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62486 expref: 59 pid: 5851 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440300.477116:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcee00/0x85f5fa77adf3d0d8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62486 expref: 59 pid: 5851 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440300.477155:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcee00/0x85f5fa77adf3d0d8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62486 expref: 59 pid: 5851 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440300.477320:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8ee0460cc100) 00010000:00010000:3.0:1787440300.477326:0:5836:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f200/0x85f5fa77adf3d0f4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440300.477404:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f200/0x85f5fa77adf3d0f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440300.477413:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f200/0x85f5fa77adf3d0f4 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440300.477451:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787440300.478083:0:5849:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f200/0x85f5fa77adf3d0f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440300.478093:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f200/0x85f5fa77adf3d0f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787440300.478143:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1787440300.478147:0:5849:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787440300.478176:0:5849:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f200/0x85f5fa77adf3d0f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440300.478210:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f000/0x85f5fa77adf3d0ed lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6248d expref: 59 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440300.478226:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f200/0x85f5fa77adf3d0f4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6248d expref: 58 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440300.478235:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8ee0460cc100) 00010000:00010000:2.0:1787440300.478237:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787440300.478240:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee07fb9f200, rc 0) 00000100:00100000:3.0:1787440300.478345:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee08090c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+58:2360:x1874266681336960:12345-192.168.206.58@tcp:103:ldlm_bl.0 Request processed in 1258us (2688us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440300.478355:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 81 00000100:00100000:2.0:1787440300.480439:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee08090f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+57:11612:x1874266681336832:12345-192.168.206.58@tcp:101:bash.0 Request processed in 13748us (13990us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440300.480451:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 209 00000100:00100000:2.0:1787440300.484557:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440300.484666:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681337216 00000100:00100000:0.0:1787440300.484675:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681337216 00000100:00100000:0.0:1787440300.484981:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 59 00000100:00100000:0.0:1787440300.484993:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee08090ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+57:11612:x1874266681337216:12345-192.168.206.58@tcp:35:bash.0 00000100:00100000:0.0:1787440300.485678:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee08090ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+58:11612:x1874266681337216:12345-192.168.206.58@tcp:35:bash.0 Request processed in 685us (1126us total) trans 4294967502 rc 0/0 00000100:00100000:0.0:1787440300.485688:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 59 00000100:00100000:1.0:1787440300.603965:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440300.605925:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681337344 00000100:00100000:3.0:1787440300.605939:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681337344 00000100:00100000:3.0:1787440300.606075:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 210 00000100:00100000:3.0:1787440300.606086:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee07f9f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+58:11618:x1874266681337344:12345-192.168.206.58@tcp:101:lfs.0 00010000:00010000:3.0:1787440300.606111:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440300.606131:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95a00/0x85f5fa77adf3d0fb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fab14535dc62494 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440300.606195:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94400/0x85f5fa77adf3d102 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440300.606229:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94400/0x85f5fa77adf3d102 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440300.606241:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94400/0x85f5fa77adf3d102 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787440300.606326:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:3.0:1787440300.606330:0:5850:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787440300.606361:0:5850:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94400/0x85f5fa77adf3d102 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440300.606385:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95a00/0x85f5fa77adf3d0fb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62494 expref: 60 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440300.606404:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94400/0x85f5fa77adf3d102 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62494 expref: 59 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440300.606411:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8ee05132ea00) 00010000:00010000:3.0:1787440300.606414:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787440300.606417:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee049e94400, rc 0) 00000100:00100000:3.0:1787440300.606544:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee07f9f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+59:11618:x1874266681337344:12345-192.168.206.58@tcp:101:lfs.0 Request processed in 459us (2587us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440300.606551:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 210 00000100:00100000:2.0:1787440300.619192:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440300.619270:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681337472 00000100:00100000:0.0:1787440300.619279:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681337472 00000100:00100000:0.0:1787440300.619333:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 211 00000100:00100000:0.0:1787440300.619344:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee08090dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+59:11618:x1874266681337472:12345-192.168.206.58@tcp:101:lfs.0 00010000:00010000:0.0:1787440300.619363:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440300.619382:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf200/0x85f5fa77adf3d109 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fab14535dc6249b expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440300.619439:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf600/0x85f5fa77adf3d110 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440300.619452:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf600/0x85f5fa77adf3d110 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440300.619462:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf600/0x85f5fa77adf3d110 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440300.619475:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce800/0x85f5fa77adf3d117 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440300.619482:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce800/0x85f5fa77adf3d117 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440300.619530:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce800/0x85f5fa77adf3d117 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440300.619622:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcec00/0x85f5fa77adf3d11e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440300.619630:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcec00/0x85f5fa77adf3d11e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440300.619636:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcec00/0x85f5fa77adf3d11e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787440300.619667:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1787440300.619849:0:5851:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787440300.619873:0:5851:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcec00/0x85f5fa77adf3d11e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440300.619885:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcec00/0x85f5fa77adf3d11e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440300.619894:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf600/0x85f5fa77adf3d110 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440300.619900:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf600/0x85f5fa77adf3d110 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440300.619906:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf600/0x85f5fa77adf3d110 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440300.619912:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee04cbcf600 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:0.0:1787440300.619916:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf600/0x85f5fa77adf3d110 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440300.619931:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf600/0x85f5fa77adf3d110 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440300.619944:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8ee05132ea00) 00010000:00010000:0.0:1787440300.619947:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440300.619951:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf600/0x85f5fa77adf3d110 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440300.619957:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf600/0x85f5fa77adf3d110 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440300.619971:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce800/0x85f5fa77adf3d117 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440300.619978:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce800/0x85f5fa77adf3d117 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440300.619984:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce800/0x85f5fa77adf3d117 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440300.619989:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee04cbce800 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:0.0:1787440300.619991:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce800/0x85f5fa77adf3d117 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440300.619997:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce800/0x85f5fa77adf3d117 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440300.620004:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8ee050ca1e00) 00010000:00010000:0.0:1787440300.620006:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440300.620008:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce800/0x85f5fa77adf3d117 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440300.620023:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce800/0x85f5fa77adf3d117 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440300.620068:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf200/0x85f5fa77adf3d109 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6249b expref: 61 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440300.620082:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcec00/0x85f5fa77adf3d11e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6249b expref: 60 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440300.620090:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8ee0460cc100) 00010000:00010000:0.0:1787440300.620093:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787440300.620095:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee04cbcec00, rc 0) 00000100:00100000:0.0:1787440300.620211:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee08090dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+60:11618:x1874266681337472:12345-192.168.206.58@tcp:101:lfs.0 Request processed in 868us (1028us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440300.620219:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 211 00000100:00100000:2.0:1787440300.631661:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:2.0:1787440300.632569:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440300.632654:0:6892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681337856 00000100:00100000:0.0:1787440300.632663:0:6892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681337856 00000100:00100000:0.0:1787440300.632720:0:6892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 212 00000100:00100000:0.0:1787440300.632729:0:6892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee08090d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+60:11618:x1874266681337856:12345-192.168.206.58@tcp:101:lfs.0 00010000:00010000:0.0:1787440300.632756:0:6892:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440300.632775:0:6892:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf200/0x85f5fa77adf3d125 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fab14535dc624a2 expref: -99 pid: 6892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440300.632863:0:6892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce800/0x85f5fa77adf3d12c lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440300.632888:0:6892:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f200/0x85f5fa77adf3d0f4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6248d expref: 61 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440300.632910:0:6892:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcec00/0x85f5fa77adf3d11e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6249b expref: 61 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440300.632918:0:6892:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce800/0x85f5fa77adf3d12c lrc: 5/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440300.632949:0:6892:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcec00/0x85f5fa77adf3d11e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6249b expref: 61 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440300.632962:0:6892:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcec00/0x85f5fa77adf3d11e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6249b expref: 61 pid: 5851 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440300.632975:0:6892:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee077cf3480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6892:1874266701249152:192.168.206.58@tcp:104: 00010000:00010000:0.0:1787440300.633084:0:6892:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f200/0x85f5fa77adf3d0f4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6248d expref: 61 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440300.633094:0:6892:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f200/0x85f5fa77adf3d0f4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6248d expref: 61 pid: 5849 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440300.633104:0:6892:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee077cf0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6892:1874266701249280:192.168.206.58@tcp:104: 00000100:00100000:0.0:1787440300.633129:0:6892:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee047f5e0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787440300.633626:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681337600 00000100:00100000:1.0:1787440300.633633:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681337600 00010000:00010000:1.0:1787440300.633661:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcec00/0x85f5fa77adf3d11e lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6249b expref: 62 pid: 5851 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440300.633712:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 82 00000100:00100000:1.0:1787440300.633721:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee06e7e4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+62:2362:x1874266681337600:12345-192.168.206.58@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787440300.633731:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787440300.633737:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcec00/0x85f5fa77adf3d11e lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6249b expref: 62 pid: 5851 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440300.633750:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcec00/0x85f5fa77adf3d11e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6249b expref: 62 pid: 5851 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440300.633769:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8ee0460cc100) 00010000:00010000:1.0:1787440300.634227:0:5834:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce800/0x85f5fa77adf3d12c lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440300.634237:0:5834:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce800/0x85f5fa77adf3d12c lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440300.634243:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787440300.634295:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee06e7e4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+62:2362:x1874266681337600:12345-192.168.206.58@tcp:103:ldlm_bl.0 Request processed in 574us (2641us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440300.634312:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 82 00010000:00010000:0.0:1787440300.636044:0:6892:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.206.58@tcp) returned -22 from blocking AST (req@00000000d82aad5a x1874266701249152) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcec00/0x85f5fa77adf3d11e lrc: 1/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6249b expref: 61 pid: 5851 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440300.636079:0:6892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcec00/0x85f5fa77adf3d11e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6249b expref: 61 pid: 5851 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440300.636110:0:6892:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee077cf3480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6892:1874266701249152:192.168.206.58@tcp:104: 00000100:00100000:0.0:1787440300.636125:0:6892:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee077cf0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6892:1874266701249280:192.168.206.58@tcp:104: 00010000:00010000:0.0:1787440300.636150:0:6892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8ee0460cc100) 00010000:00010000:0.0:1787440300.636154:0:6892:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce800/0x85f5fa77adf3d12c lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440300.636161:0:6892:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce800/0x85f5fa77adf3d12c lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440300.636741:0:6892:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce800/0x85f5fa77adf3d12c lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440300.643093:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:1.0:1787440300.645537:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681337984 00000100:00100000:1.0:1787440300.645554:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681337984 00010000:00010000:0.0:1787440300.645716:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f200/0x85f5fa77adf3d0f4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6248d expref: 61 pid: 5849 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440300.645765:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 83 00000100:00100000:0.0:1787440300.645775:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee08090ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+61:2363:x1874266681337984:12345-192.168.206.58@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787440300.645789:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787440300.645795:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f200/0x85f5fa77adf3d0f4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6248d expref: 61 pid: 5849 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440300.645809:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f200/0x85f5fa77adf3d0f4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6248d expref: 61 pid: 5849 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440300.645830:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f200/0x85f5fa77adf3d0f4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6248d expref: 61 pid: 5849 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440300.645864:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8ee0460cc100) 00010000:00010000:0.0:1787440300.645869:0:5835:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce800/0x85f5fa77adf3d12c lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440300.645890:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce800/0x85f5fa77adf3d12c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440300.645897:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce800/0x85f5fa77adf3d12c lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440300.645928:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787440300.646003:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee08090ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+60:2363:x1874266681337984:12345-192.168.206.58@tcp:103:ldlm_bl.0 Request processed in 229us (2919us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440300.646011:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 83 00010000:00010000:2.0:1787440300.646207:0:6892:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce800/0x85f5fa77adf3d12c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440300.646217:0:6892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce800/0x85f5fa77adf3d12c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787440300.646235:0:6892:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1787440300.646446:0:6892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf200/0x85f5fa77adf3d125 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc624a2 expref: 61 pid: 6892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440300.646464:0:6892:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce800/0x85f5fa77adf3d12c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc624a2 expref: 60 pid: 6892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440300.646472:0:6892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8ee0460cc100) 00010000:00010000:2.0:1787440300.646476:0:6892:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787440300.646479:0:6892:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee04cbce800, rc 0) 00000100:00100000:2.0:1787440300.646541:0:6892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee08090d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+60:11618:x1874266681337856:12345-192.168.206.58@tcp:101:lfs.0 Request processed in 13813us (13974us total) trans 4294967503 rc 0/0 00000100:00100000:2.0:1787440300.646551:0:6892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 212 00000100:00100000:2.0:1787440300.651293:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440300.651389:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681338240 00000100:00100000:0.0:1787440300.651398:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681338240 00000100:00100000:0.0:1787440300.651466:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 15 00000100:00100000:0.0:1787440300.651475:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee08090f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+60:11618:x1874266681338240:12345-192.168.206.58@tcp:103:lfs.0 00010000:00010000:0.0:1787440300.651490:0:6711:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787440300.651543:0:6711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95c00/0x85f5fa77adf3d08b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62478 expref: 60 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440300.651562:0:6711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8ee0460cc100) 00010000:00010000:0.0:1787440300.651567:0:6711:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787440300.651638:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee08090f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+59:11618:x1874266681338240:12345-192.168.206.58@tcp:103:lfs.0 Request processed in 163us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440300.651647:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 15 00000100:00100000:0.0:1787440300.659855:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:2.0:1787440300.660017:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681338368 00000100:00100000:2.0:1787440300.660038:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681338368 00000100:00100000:2.0:1787440300.660102:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 213 00000100:00100000:2.0:1787440300.660111:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee077cf0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+59:11618:x1874266681338368:12345-192.168.206.58@tcp:58:lfs.0 00010000:00010000:2.0:1787440300.660196:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86ec00/0x85f5fa77adf3d13a lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440300.660212:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86ec00/0x85f5fa77adf3d13a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440300.660223:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86ec00/0x85f5fa77adf3d13a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787440300.660414:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:2.0:1787440300.660539:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee077cf0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+59:11618:x1874266681338368:12345-192.168.206.58@tcp:58:lfs.0 Request processed in 428us (693us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440300.660547:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 213 00000100:00100000:2.0:1787440300.663798:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440300.663901:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681338496 00000100:00100000:3.0:1787440300.663909:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681338496 00000100:00100000:3.0:1787440300.664128:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 214 00000100:00100000:3.0:1787440300.664139:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee08090d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+59:11618:x1874266681338496:12345-192.168.206.58@tcp:101:lfs.0 00010000:00010000:3.0:1787440300.664158:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440300.664327:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95a00/0x85f5fa77adf3d141 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fab14535dc624a9 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440300.664550:0:5850:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86ec00/0x85f5fa77adf3d13a lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440300.664562:0:5850:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95a00/0x85f5fa77adf3d141 lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc624a9 expref: 60 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440300.664582:0:5850:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86ec00/0x85f5fa77adf3d13a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440300.664594:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95a00/0x85f5fa77adf3d141 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc624a9 expref: 60 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440300.664675:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8ee0460cc100) 00010000:00010000:3.0:1787440300.664679:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787440300.664683:0:5850:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95a00/0x85f5fa77adf3d141 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc624a9 expref: 60 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440300.664691:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee049e95a00, rc 0) 00000100:00100000:2.0:1787440300.670111:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee08090d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+60:11618:x1874266681338496:12345-192.168.206.58@tcp:101:lfs.0 Request processed in 5963us (6309us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440300.670124:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 214 00000040:00080000:0.0:1787440301.084835:0:11682:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787440301.084845:0:11682:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787440301.084884:0:11682:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:0.0:1787440301.084892:0:11682:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787440301.085113:0:11682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee077cf3480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11682:1874266701249408:192.168.206.58@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787440301.085286:0:11682:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee047f5e540 going to sleep for 11 seconds 00000100:00100000:0.0:1787440301.091213:0:11682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee077cf3480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11682:1874266701249408:192.168.206.58@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787440301.093112:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:2.0:1787440301.093307:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681338624 00000100:00100000:2.0:1787440301.093315:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681338624 00000100:00100000:2.0:1787440301.093391:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 215 00000100:00100000:2.0:1787440301.093402:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee077cf3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+60:11620:x1874266681338624:12345-192.168.206.58@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787440301.093433:0:5849:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787440301.093563:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee077cf3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+60:11620:x1874266681338624:12345-192.168.206.58@tcp:53:lhsmtool_posix.0 Request processed in 162us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440301.093571:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 215 00000100:00080000:0.0:1787440301.094019:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787440301.104418:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440301.104622:0:6892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681338752 00000100:00100000:0.0:1787440301.104632:0:6892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681338752 00000100:00100000:0.0:1787440301.104692:0:6892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 216 00000100:00100000:0.0:1787440301.104703:0:6892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee08090ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+60:11620:x1874266681338752:12345-192.168.206.58@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1787440301.104790:0:6892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce000/0x85f5fa77adf3d148 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440301.104806:0:6892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce000/0x85f5fa77adf3d148 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440301.104817:0:6892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce000/0x85f5fa77adf3d148 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440301.104833:0:6892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfa00/0x85f5fa77adf3d14f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440301.104841:0:6892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfa00/0x85f5fa77adf3d14f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440301.104847:0:6892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfa00/0x85f5fa77adf3d14f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440301.104885:0:6892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcec00/0x85f5fa77adf3d156 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440301.104894:0:6892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcec00/0x85f5fa77adf3d156 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440301.104901:0:6892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcec00/0x85f5fa77adf3d156 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787440301.104935:0:6892:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1787440301.104940:0:6892:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787440301.104952:0:6892:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcec00/0x85f5fa77adf3d156 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440301.104961:0:6892:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce000/0x85f5fa77adf3d148 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440301.104967:0:6892:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce000/0x85f5fa77adf3d148 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440301.104974:0:6892:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce000/0x85f5fa77adf3d148 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440301.104980:0:6892:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee04cbce000 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:0.0:1787440301.104984:0:6892:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce000/0x85f5fa77adf3d148 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440301.104991:0:6892:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce000/0x85f5fa77adf3d148 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440301.105003:0:6892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ee05132e100) 00010000:00010000:0.0:1787440301.105012:0:6892:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440301.105017:0:6892:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce000/0x85f5fa77adf3d148 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440301.105023:0:6892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce000/0x85f5fa77adf3d148 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440301.105038:0:6892:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfa00/0x85f5fa77adf3d14f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440301.105043:0:6892:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfa00/0x85f5fa77adf3d14f lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440301.105048:0:6892:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfa00/0x85f5fa77adf3d14f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440301.105072:0:6892:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee04cbcfa00 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:0.0:1787440301.105075:0:6892:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfa00/0x85f5fa77adf3d14f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440301.105080:0:6892:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfa00/0x85f5fa77adf3d14f lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440301.105088:0:6892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff8ee050ca1e00) 00010000:00010000:0.0:1787440301.105090:0:6892:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440301.105093:0:6892:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfa00/0x85f5fa77adf3d14f lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440301.105099:0:6892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfa00/0x85f5fa77adf3d14f lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440301.105114:0:6892:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcec00/0x85f5fa77adf3d156 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440301.105126:0:6892:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcec00/0x85f5fa77adf3d156 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440301.105132:0:6892:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcec00/0x85f5fa77adf3d156 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440301.105137:0:6892:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee04cbcec00 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:0.0:1787440301.105140:0:6892:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcec00/0x85f5fa77adf3d156 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440301.105146:0:6892:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcec00/0x85f5fa77adf3d156 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440301.105154:0:6892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8ee0460cc100) 00010000:00010000:0.0:1787440301.105156:0:6892:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440301.105160:0:6892:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcec00/0x85f5fa77adf3d156 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440301.105165:0:6892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcec00/0x85f5fa77adf3d156 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440301.105246:0:6892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee08090ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+60:11620:x1874266681338752:12345-192.168.206.58@tcp:34:lhsmtool_posix.0 Request processed in 544us (835us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440301.105253:0:6892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 216 00000100:00100000:1.0:1787440301.113334:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440301.113483:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681339008 00000100:00100000:3.0:1787440301.113522:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681339008 00000100:00100000:3.0:1787440301.113567:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 217 00000100:00100000:3.0:1787440301.113576:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee07f9f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+60:11620:x1874266681339008:12345-192.168.206.58@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787440301.113594:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440301.113611:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94200/0x85f5fa77adf3d15d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fab14535dc624b0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440301.113727:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95c00/0x85f5fa77adf3d164 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440301.113753:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95c00/0x85f5fa77adf3d164 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440301.113764:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95c00/0x85f5fa77adf3d164 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787440301.113775:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1787440301.113868:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95c00/0x85f5fa77adf3d164 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440301.113875:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95c00/0x85f5fa77adf3d164 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440301.113881:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95c00/0x85f5fa77adf3d164 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440301.113886:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee049e95c00 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:3.0:1787440301.113889:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95c00/0x85f5fa77adf3d164 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440301.113896:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95c00/0x85f5fa77adf3d164 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440301.113907:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8ee0460cc100) 00010000:00010000:3.0:1787440301.113909:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787440301.113913:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95c00/0x85f5fa77adf3d164 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440301.113928:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95c00/0x85f5fa77adf3d164 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440301.113968:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94200/0x85f5fa77adf3d15d lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc624b0 expref: 62 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440301.113978:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ee05132e100) 00010000:00010000:3.0:1787440301.113980:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787440301.113984:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94200/0x85f5fa77adf3d15d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc624b0 expref: 62 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440301.113994:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee049e94200, rc 0) 00000100:00100000:3.0:1787440301.114063:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee07f9f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+61:11620:x1874266681339008:12345-192.168.206.58@tcp:101:lhsmtool_posix.0 Request processed in 487us (737us total) trans 4294967504 rc 301/301 00000100:00100000:3.0:1787440301.114071:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 217 00000100:00100000:1.0:1787440301.117798:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440301.117868:0:6892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681339136 00000100:00100000:0.0:1787440301.117877:0:6892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681339136 00000100:00100000:0.0:1787440301.117933:0:6892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 218 00000100:00100000:0.0:1787440301.117942:0:6892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee07f9f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+61:11620:x1874266681339136:12345-192.168.206.58@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787440301.117973:0:6892:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787440301.118083:0:6892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee07f9f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+61:11620:x1874266681339136:12345-192.168.206.58@tcp:53:lhsmtool_posix.0 Request processed in 141us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440301.118091:0:6892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 218 00000100:00100000:1.0:1787440301.129642:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440301.129749:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681339392 00000100:00100000:3.0:1787440301.129759:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681339392 00000100:00100000:3.0:1787440301.129818:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 219 00000100:00100000:3.0:1787440301.129830:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee080325880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+61:11620:x1874266681339392:12345-192.168.206.58@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787440301.129849:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440301.129853:0:5849:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787440301.129881:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94400/0x85f5fa77adf3d102 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62494 expref: 61 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440301.129901:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8ee05132ea00) 00010000:00010000:3.0:1787440301.129906:0:5849:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787440301.129935:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94200/0x85f5fa77adf3d172 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fab14535dc624b7 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787440301.130347:0:5849:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6:0x0], index 1: 0 00010000:00010000:3.0:1787440301.130604:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95c00/0x85f5fa77adf3d179 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440301.130619:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95c00/0x85f5fa77adf3d179 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440301.130630:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95c00/0x85f5fa77adf3d179 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440301.130682:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94200/0x85f5fa77adf3d172 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc624b7 expref: 63 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440301.130697:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95c00/0x85f5fa77adf3d179 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc624b7 expref: 62 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440301.130704:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8ee0460cc300) 00010000:00010000:3.0:1787440301.130707:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787440301.130709:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee049e95c00, rc 0) 00000100:00100000:3.0:1787440301.130776:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee080325880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+62:11620:x1874266681339392:12345-192.168.206.58@tcp:101:lhsmtool_posix.0 Request processed in 949us (1141us total) trans 4294967505 rc 0/0 00000100:00100000:3.0:1787440301.130784:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 219 00000100:00100000:1.0:1787440301.138553:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440301.138638:0:6892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681339648 00000100:00100000:0.0:1787440301.138647:0:6892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681339648 00000100:00100000:0.0:1787440301.138698:0:6892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 220 00000100:00100000:0.0:1787440301.138707:0:6892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee0800a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+62:11620:x1874266681339648:12345-192.168.206.58@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787440301.138775:0:6892:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787440301.138801:0:6892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95c00/0x85f5fa77adf3d179 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc624b7 expref: 62 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440301.138820:0:6892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8ee0460cc300) 00010000:00010000:0.0:1787440301.138830:0:6892:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787440301.138849:0:6892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcec00/0x85f5fa77adf3d187 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440301.138862:0:6892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcec00/0x85f5fa77adf3d187 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440301.138872:0:6892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcec00/0x85f5fa77adf3d187 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440301.138886:0:6892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfa00/0x85f5fa77adf3d18e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x91fa1d4c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440301.138892:0:6892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfa00/0x85f5fa77adf3d18e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x91fa1d4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440301.138899:0:6892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfa00/0x85f5fa77adf3d18e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x91fa1d4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440301.138980:0:6892:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcec00/0x85f5fa77adf3d187 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440301.138987:0:6892:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcec00/0x85f5fa77adf3d187 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440301.138994:0:6892:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcec00/0x85f5fa77adf3d187 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440301.139000:0:6892:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee04cbcec00 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:0.0:1787440301.139004:0:6892:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcec00/0x85f5fa77adf3d187 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440301.139011:0:6892:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcec00/0x85f5fa77adf3d187 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440301.139020:0:6892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8ee05132ea00) 00010000:00010000:0.0:1787440301.139023:0:6892:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440301.139026:0:6892:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcec00/0x85f5fa77adf3d187 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440301.139032:0:6892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcec00/0x85f5fa77adf3d187 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440301.139040:0:6892:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfa00/0x85f5fa77adf3d18e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x91fa1d4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440301.139046:0:6892:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfa00/0x85f5fa77adf3d18e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x91fa1d4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440301.139063:0:6892:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfa00/0x85f5fa77adf3d18e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x91fa1d4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440301.139075:0:6892:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee04cbcfa00 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:0.0:1787440301.139079:0:6892:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfa00/0x85f5fa77adf3d18e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x91fa1d4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440301.139085:0:6892:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfa00/0x85f5fa77adf3d18e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x91fa1d4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440301.139093:0:6892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x91fa1d4c (ffff8ee050ca1e00) 00010000:00010000:0.0:1787440301.139095:0:6892:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440301.139098:0:6892:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfa00/0x85f5fa77adf3d18e lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x91fa1d4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440301.139103:0:6892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfa00/0x85f5fa77adf3d18e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x91fa1d4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440301.139178:0:6892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee0800a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+61:11620:x1874266681339648:12345-192.168.206.58@tcp:36:lhsmtool_posix.0 Request processed in 471us (633us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787440301.139186:0:6892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 220 00000100:00100000:3.0:1787440301.145148:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440301.145297:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681339776 00000100:00100000:0.0:1787440301.145306:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681339776 00000100:00100000:0.0:1787440301.145366:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 221 00000100:00100000:0.0:1787440301.145376:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04a659500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+61:11620:x1874266681339776:12345-192.168.206.58@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787440301.145397:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440301.145420:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce000/0x85f5fa77adf3d195 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fab14535dc624be expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440301.145454:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf200/0x85f5fa77adf3d19c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440301.145484:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf200/0x85f5fa77adf3d19c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440301.145532:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf200/0x85f5fa77adf3d19c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440301.145625:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce000/0x85f5fa77adf3d195 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc624be expref: 63 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440301.145645:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf200/0x85f5fa77adf3d19c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc624be expref: 62 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440301.145653:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8ee050ca1700) 00010000:00010000:0.0:1787440301.145656:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787440301.145659:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee04cbcf200, rc 0) 00000100:00100000:0.0:1787440301.145712:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04a659500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+62:11620:x1874266681339776:12345-192.168.206.58@tcp:101:lhsmtool_posix.0 Request processed in 338us (573us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440301.145720:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 221 00010000:00010000:3.0:1787440301.148707:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787440301.154628:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440301.154679:0:6892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681340032 00000100:00100000:0.0:1787440301.154688:0:6892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681340032 00000100:00100000:0.0:1787440301.154755:0:6892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 222 00000100:00100000:0.0:1787440301.154765:0:6892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee0800a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+62:11620:x1874266681340032:12345-192.168.206.58@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787440301.154851:0:6892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfa00/0x85f5fa77adf3d1a3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440301.154868:0:6892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfa00/0x85f5fa77adf3d1a3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440301.154900:0:6892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfa00/0x85f5fa77adf3d1a3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787440301.155153:0:6892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].8, 88 off8800 00000004:00080000:0.0:1787440301.155162:0:6892:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 399525668891ns, next at 400525666532ns, rc = 0 00000004:00010000:0.0:1787440301.155252:0:6892:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008028ace4 reply state 000000003404d4c0 transno 4294967506 ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfa00/0x85f5fa77adf3d1a3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440301.155262:0:6892:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787440301.155356:0:6892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee0800a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+64:11620:x1874266681340032:12345-192.168.206.58@tcp:36:lhsmtool_posix.0 Request processed in 592us (734us total) trans 4294967506 rc 0/0 00000100:00100000:0.0:1787440301.155363:0:6892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 222 00000100:00100000:1.0:1787440301.158025:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440301.158112:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681340160 00000100:00100000:0.0:1787440301.158121:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681340160 00000100:00100000:0.0:1787440301.158177:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 223 00000100:00100000:0.0:1787440301.158187:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee0806b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+64:11620:x1874266681340160:12345-192.168.206.58@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787440301.158211:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440301.158229:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce000/0x85f5fa77adf3d1aa lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fab14535dc624c5 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440301.158285:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce000/0x85f5fa77adf3d1aa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc624c5 expref: 65 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440301.158299:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce000/0x85f5fa77adf3d1aa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc624c5 expref: 65 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440301.158317:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8ee050ca1700) 00010000:00010000:0.0:1787440301.158333:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787440301.158338:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee04cbce000, rc 0) 00000100:00100000:0.0:1787440301.158386:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee0806b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+65:11620:x1874266681340160:12345-192.168.206.58@tcp:101:lhsmtool_posix.0 Request processed in 201us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440301.158393:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 223 00010000:00010000:2.0:1787440301.158654:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfa00/0x85f5fa77adf3d1a3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440301.158663:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfa00/0x85f5fa77adf3d1a3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440301.158670:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfa00/0x85f5fa77adf3d1a3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440301.158676:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee04cbcfa00 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:2.0:1787440301.158680:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfa00/0x85f5fa77adf3d1a3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440301.158687:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfa00/0x85f5fa77adf3d1a3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440301.158698:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8ee050ca1700) 00010000:00010000:2.0:1787440301.158701:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787440301.158704:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfa00/0x85f5fa77adf3d1a3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440301.158711:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfa00/0x85f5fa77adf3d1a3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440301.163185:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440301.163320:0:9225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681340288 00000100:00100000:0.0:1787440301.163330:0:9225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681340288 00000100:00100000:0.0:1787440301.163439:0:9225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 62 00000100:00100000:0.0:1787440301.163449:0:9225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee0806dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+9:2361:x1874266681340288:12345-192.168.206.58@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1787440301.163810:0:9225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee0806dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+10:2361:x1874266681340288:12345-192.168.206.58@tcp:2:lhsmtool_posix.0 Request processed in 361us (631us total) trans 4294967319 rc 0/0 00000100:00100000:0.0:1787440301.163819:0:9225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 62 00000100:00080000:1.0:1787440301.164180:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787440301.167674:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:2.0:1787440301.167819:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681340544 00000100:00100000:2.0:1787440301.167829:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681340544 00000100:00100000:2.0:1787440301.167885:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 60 00000100:00100000:2.0:1787440301.167895:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee080b44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+64:11620:x1874266681340544:12345-192.168.206.58@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787440301.169021:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee080b44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+65:11620:x1874266681340544:12345-192.168.206.58@tcp:35:lhsmtool_posix.0 Request processed in 1120us (1349us total) trans 4294967507 rc 0/0 00000100:00100000:2.0:1787440301.169046:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 60 00000100:00100000:2.0:1787440301.171956:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440301.172138:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681340800 00000100:00100000:0.0:1787440301.172147:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681340800 00000100:00100000:0.0:1787440301.172241:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 224 00000100:00100000:0.0:1787440301.172251:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee08090f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+65:11620:x1874266681340800:12345-192.168.206.58@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787440301.172585:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee08090f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+65:11620:x1874266681340800:12345-192.168.206.58@tcp:57:lhsmtool_posix.0 Request processed in 334us (635us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440301.172594:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 224 00000100:00100000:1.0:1787440301.177165:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440301.179142:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681340928 00000100:00100000:0.0:1787440301.179155:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681340928 00000100:00100000:0.0:1787440301.179260:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 225 00000100:00100000:0.0:1787440301.179279:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee080b44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+65:11620:x1874266681340928:12345-192.168.206.58@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787440301.179298:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440301.179319:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcec00/0x85f5fa77adf3d1b1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fab14535dc624cc expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440301.179404:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf600/0x85f5fa77adf3d1b8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440301.179418:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf600/0x85f5fa77adf3d1b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440301.179429:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf600/0x85f5fa77adf3d1b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787440301.179462:0:5849:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787440301.179477:0:5849:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf600/0x85f5fa77adf3d1b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440301.179620:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcec00/0x85f5fa77adf3d1b1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc624cc expref: 67 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440301.179638:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf600/0x85f5fa77adf3d1b8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc624cc expref: 66 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440301.179647:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8ee050ca1700) 00010000:00010000:0.0:1787440301.179650:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787440301.179653:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee04cbcf600, rc 0) 00000100:00100000:0.0:1787440301.179801:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee080b44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+66:11620:x1874266681340928:12345-192.168.206.58@tcp:101:lhsmtool_posix.0 Request processed in 523us (2643us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440301.179808:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 225 00000100:00100000:1.0:1787440301.183215:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440301.183624:0:12016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681341056 00000100:00100000:3.0:1787440301.183646:0:12016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681341056 00000100:00100000:3.0:1787440301.183703:0:12016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 63 00000100:00100000:3.0:1787440301.183713:0:12016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee080b46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+10:2361:x1874266681341056:12345-192.168.206.58@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787440301.183730:0:12016:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440301.183761:0:12016:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000971c6fa/0x85f5fa77adf3d1bf lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5fab14535dc624d3 expref: -99 pid: 12016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787440301.183788:0:12016:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8a2cad, blocks: 0x1 00010000:00010000:3.0:1787440301.183806:0:12016:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=399s v=(0 0) 00010000:00010000:3.0:1787440301.183811:0:12016:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787440301.183821:0:12016:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000971c6fa/0x85f5fa77adf3d1bf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc624d3 expref: 11 pid: 12016 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440301.183839:0:12016:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000971c6fa/0x85f5fa77adf3d1bf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc624d3 expref: 11 pid: 12016 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440301.183852:0:12016:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee049e94200, rc 0) 00000100:00100000:3.0:1787440301.183912:0:12016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee080b46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+11:2361:x1874266681341056:12345-192.168.206.58@tcp:101:lhsmtool_posix.0 Request processed in 200us (705us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440301.183928:0:12016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 63 00000100:00100000:2.0:1787440301.188176:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440301.188277:0:6892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681341312 00000100:00100000:0.0:1787440301.188286:0:6892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681341312 00000100:00100000:0.0:1787440301.188344:0:6892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 226 00000100:00100000:0.0:1787440301.188367:0:6892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee08090d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+66:11620:x1874266681341312:12345-192.168.206.58@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787440301.188472:0:6892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee08090d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+66:11620:x1874266681341312:12345-192.168.206.58@tcp:57:lhsmtool_posix.0 Request processed in 107us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440301.188480:0:6892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 226 00000100:00100000:1.0:1787440301.191957:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440301.192031:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681341440 00000100:00100000:0.0:1787440301.192040:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681341440 00000100:00100000:0.0:1787440301.192095:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 64 00000100:00100000:0.0:1787440301.192103:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee080b47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+11:11620:x1874266681341440:12345-192.168.206.58@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787440301.192117:0:6697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440301.192132:0:6697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000103223a1/0x85f5fa77adf3d1c6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5fab14535dc624da expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440301.192160:0:6697:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000971c6fa/0x85f5fa77adf3d1bf lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc624d3 expref: 12 pid: 12016 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440301.192168:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787440301.192173:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787440301.192178:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000103223a1/0x85f5fa77adf3d1c6 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc624da expref: 12 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440301.192205:0:6697:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000971c6fa/0x85f5fa77adf3d1bf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc624d3 expref: 12 pid: 12016 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440301.192217:0:6697:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000971c6fa/0x85f5fa77adf3d1bf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc624d3 expref: 12 pid: 12016 timeout: 499 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440301.192248:0:6697:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee077cf2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6697:1874266701249536:192.168.206.58@tcp:104: 00000100:00100000:0.0:1787440301.192450:0:6697:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee045f0e540 going to sleep for 11 seconds 00000100:00100000:1.0:1787440301.196015:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:2.0:1787440301.196138:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681341568 00000100:00100000:2.0:1787440301.196146:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681341568 00010000:00010000:2.0:1787440301.196185:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000971c6fa/0x85f5fa77adf3d1bf lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc624d3 expref: 13 pid: 12016 timeout: 499 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440301.196224:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 84 00000100:00100000:2.0:1787440301.196234:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee080b44e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+13:2363:x1874266681341568:12345-192.168.206.58@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787440301.196247:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787440301.196381:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000971c6fa/0x85f5fa77adf3d1bf lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc624d3 expref: 13 pid: 12016 timeout: 499 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440301.196396:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000971c6fa/0x85f5fa77adf3d1bf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc624d3 expref: 13 pid: 12016 timeout: 499 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440301.196421:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787440301.196426:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787440301.196434:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000103223a1/0x85f5fa77adf3d1c6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc624da expref: 13 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440301.196443:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000103223a1/0x85f5fa77adf3d1c6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc624da expref: 13 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440301.196536:0:5835:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000103223a1/0x85f5fa77adf3d1c6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc624da expref: 13 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440301.196551:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee08090e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5835:1874266701249664:192.168.206.58@tcp:105: 00000100:00100000:2.0:1787440301.196619:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee0807a93c0 going to sleep for 11 seconds 00010000:00010000:0.0:1787440301.198599:0:6697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000971c6fa/0x85f5fa77adf3d1bf lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc624d3 expref: 13 pid: 12016 timeout: 499 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440301.198620:0:6697:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee077cf2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6697:1874266701249536:192.168.206.58@tcp:104: 00010000:00010000:0.0:1787440301.198650:0:6697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000103223a1/0x85f5fa77adf3d1c6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc624da expref: 12 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440301.198663:0:6697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee04cbcec00, rc 0) 00000100:00100000:0.0:1787440301.198722:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee080b47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+12:11620:x1874266681341440:12345-192.168.206.58@tcp:101:lhsmtool_posix.0 Request processed in 6618us (6771us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440301.198731:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 64 00000100:00100000:2.0:1787440301.201890:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee08090e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5835:1874266701249664:192.168.206.58@tcp:105: 00010000:00010000:2.0:1787440301.201917:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787440301.201974:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee080b44e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+11:2363:x1874266681341568:12345-192.168.206.58@tcp:103:ldlm_bl.0 Request processed in 5740us (5980us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440301.201986:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 84 00000100:00100000:2.0:1787440301.206948:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440301.207099:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681341696 00000100:00100000:0.0:1787440301.207108:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681341696 00002000:00100000:0.0:1787440301.207156:0:6702:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff8ee08090e300 x1874266681341696/t0(0) o4->792563a7-4c22-4ac7-ac25-d49ef7fb41a8@192.168.206.58@tcp:462/0 lens 504/0 e 0 to 0 dl 1787440312 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787440301.207166:0:6702:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ee08090e300 with x1874266681341696 ext(0->12) 00002000:00010000:0.0:1787440301.207172:0:6702:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8ee08090e300 00000100:00100000:0.0:1787440301.207204:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 6 00000100:00100000:0.0:1787440301.207213:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee08090e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+11:2363:x1874266681341696:12345-192.168.206.58@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1787440301.207700:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee08090e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+13:2363:x1874266681341696:12345-192.168.206.58@tcp:4:lhsmtool_posix.0 Request processed in 486us (761us total) trans 4294967320 rc 0/0 00000100:00100000:0.0:1787440301.207714:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 6 00002000:00100000:0.0:1787440301.207722:0:6702:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff8ee08090e300 x1874266681341696/t4294967320(0) o4->792563a7-4c22-4ac7-ac25-d49ef7fb41a8@192.168.206.58@tcp:462/0 lens 504/448 e 0 to 0 dl 1787440312 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787440301.207730:0:6702:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ee08090e300 with x1874266681341696 ext(0->12) 00002000:00010000:0.0:1787440301.208534:0:6702:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8ee08090e300 00000100:00100000:1.0:1787440301.210955:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440301.211059:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681341824 00000100:00100000:3.0:1787440301.211068:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681341824 00000100:00100000:3.0:1787440301.211123:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 227 00000100:00100000:3.0:1787440301.211133:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee0773fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+66:11620:x1874266681341824:12345-192.168.206.58@tcp:44:lhsmtool_posix.0 00000100:00100000:2.0:1787440301.249107:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee0773fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+66:11620:x1874266681341824:12345-192.168.206.58@tcp:44:lhsmtool_posix.0 Request processed in 37966us (38149us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440301.249121:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 227 00000001:00080000:0.0:1787440301.249634:0:5871:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000004:00080000:0.0:1787440301.249641:0:5871:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 9 committed 00000004:00080000:0.0:1787440301.249662:0:5871:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000020:00080000:0.0:1787440301.249689:0:5871:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8ee042d78480 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:0.0:1787440301.249694:0:5871:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8ee08003e700 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8ee042d78cc0 00000020:00080000:0.0:1787440301.249697:0:5871:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8ee08003e300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8ee043ccd400 00000001:00080000:0.0:1787440301.249818:0:5871:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967507 is committed 00000004:00080000:0.0:1787440301.249831:0:5871:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00000020:00080000:0.0:1787440301.249839:0:5871:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8ee049e0a000 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:0.0:1787440301.249843:0:5871:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8ee04c579f00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8ee049e0ab40 00000020:00080000:0.0:1787440301.249845:0:5871:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8ee04c579b00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8ee0776eec00 00000020:00080000:0.0:1787440301.249874:0:5882:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:0.0:1787440301.250145:0:5882:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:2.0:1787440301.250401:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee08090ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1874266701249920:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1787440301.250457:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440301.250526:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787440301.250533:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee08090c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1874266701249792:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1787440301.250558:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440301.250590:0:9225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701249920 00000100:00100000:2.0:1787440301.250596:0:9225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701249920 00000100:00100000:2.0:1787440301.250641:0:9225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701249792 00000100:00100000:2.0:1787440301.250644:0:9225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701249792 00000100:00100000:2.0:1787440301.250666:0:9225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787440301.250673:0:9225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee08090c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3310:x1874266701249920:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1787440301.250894:0:9225:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1787440301.250898:0:9225:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1787440301 00002000:00010000:2.0:1787440301.250900:0:9225:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1787440301.250902:0:9225:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1787440301 -> 1787440301 00002000:00010000:2.0:1787440301.250904:0:9225:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1787440301.250942:0:9225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee08090c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3310:x1874266701249920:12345-0@lo:2:osp-syn-1-0.0 Request processed in 268us (484us total) trans 4294967321 rc 0/0 00000100:00100000:2.0:1787440301.250949:0:9225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787440301.250967:0:9225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787440301.250973:0:9225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee07783a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3310:x1874266701249792:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1787440301.250986:0:9225:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00010000:00010000:2.0:1787440301.251198:0:9225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e22ee83a/0x85f5fa77adf3d1cd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440301.251219:0:9225:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002a4179b0/0x85f5fa77adf3cf8f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62439 expref: 12 pid: 12016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440301.251227:0:9225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1787440301.251232:0:9225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787440301.251236:0:9225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e22ee83a/0x85f5fa77adf3d1cd lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440301.251368:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee0773fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874266701250048:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1787440301.251401:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440301.251485:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701250048 00000100:00100000:1.0:1787440301.251489:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701250048 00000100:00100000:1.0:1787440301.251531:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787440301.251538:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee077cf2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3311:x1874266701250048:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1787440301.251563:0:6697:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00002000:00010000:1.0:1787440301.251587:0:6697:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a8a2cac, atime: 0x6a8a2cac, ctime: 0x6a8a2cac, blocks: 0x1 00010000:00010000:1.0:1787440301.251594:0:6697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001a91b948/0x85f5fa77adf3d1d4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440301.251604:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=399s v=(0 0) 00010000:00010000:1.0:1787440301.251607:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787440301.251613:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001a91b948/0x85f5fa77adf3d1d4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440301.251627:0:6697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001a91b948/0x85f5fa77adf3d1d4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440301.251637:0:6697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001a91b948/0x85f5fa77adf3d1d4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440301.251644:0:6697:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001a91b948/0x85f5fa77adf3d1d4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440301.251668:0:6697:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787440301.252111:0:9225:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002a4179b0/0x85f5fa77adf3cf8f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62439 expref: 12 pid: 12016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440301.252131:0:9225:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002a4179b0/0x85f5fa77adf3cf8f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62439 expref: 12 pid: 12016 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440301.252151:0:9225:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee050483100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9225:1874266701250176:192.168.206.58@tcp:104: 00000100:00100000:2.0:1787440301.252218:0:9225:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee080ca4600 going to sleep for 11 seconds 00000100:00080000:2.0:1787440301.252234:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787440301.252592:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee077cf2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3311:x1874266701250048:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1053us (1188us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1787440301.252600:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00010000:00010000:0.0:1787440301.252685:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787440301.252693:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001a91b948/0x85f5fa77adf3d1d4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440301.252715:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee07fb9e800 already unused, calling callback (ffffffffc15b52a0) 00010000:00010000:0.0:1787440301.252720:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001a91b948/0x85f5fa77adf3d1d4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440301.252806:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001a91b948/0x85f5fa77adf3d1d4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440301.252828:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001a91b948/0x85f5fa77adf3d1d4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440301.252836:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001a91b948/0x85f5fa77adf3d1d4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440301.252855:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787440301.252857:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787440301.252859:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1787440301.252890:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8ee0773fc380/2, rc 0, transno 4294967310 00000100:00100000:0.0:1787440301.252897:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee0773fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874266701250048:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1787440301.253076:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8ee08090ea00/2, rc 0, transno 4294967321 00000100:00100000:2.0:1787440301.253082:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee08090ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1874266701249920:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1787440301.255605:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:2.0:1787440301.255753:0:9225:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee050483100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9225:1874266701250176:192.168.206.58@tcp:104: 00010000:00010000:2.0:1787440301.255781:0:9225:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e22ee83a/0x85f5fa77adf3d1cd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440301.255890:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681341952 00000100:00100000:3.0:1787440301.255898:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681341952 00000100:00100000:3.0:1787440301.256284:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 68 00000100:00100000:3.0:1787440301.256294:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee0773fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+13:2361:x1874266681341952:12345-192.168.206.58@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1787440301.269727:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440301.269769:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681342080 00000100:00100000:0.0:1787440301.269778:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681342080 00010000:00010000:0.0:1787440301.269819:0:6711:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002a4179b0/0x85f5fa77adf3cf8f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62439 expref: 14 pid: 12016 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440301.269861:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 85 00000100:00100000:0.0:1787440301.269871:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee0773fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+14:2361:x1874266681342080:12345-192.168.206.58@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787440301.269894:0:6711:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787440301.269900:0:6711:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002a4179b0/0x85f5fa77adf3cf8f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62439 expref: 14 pid: 12016 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440301.269914:0:6711:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002a4179b0/0x85f5fa77adf3cf8f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62439 expref: 14 pid: 12016 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440301.269936:0:6711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002a4179b0/0x85f5fa77adf3cf8f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62439 expref: 14 pid: 12016 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440301.269951:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787440301.269955:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787440301.269962:0:6711:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e22ee83a/0x85f5fa77adf3d1cd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440301.269971:0:6711:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e22ee83a/0x85f5fa77adf3d1cd lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440301.270123:0:6711:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787440301.270174:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee0773fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+13:2361:x1874266681342080:12345-192.168.206.58@tcp:103:ldlm_bl.0 Request processed in 304us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440301.270183:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 85 00010000:00010000:3.0:1787440301.271026:0:9225:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e22ee83a/0x85f5fa77adf3d1cd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440301.271038:0:9225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e22ee83a/0x85f5fa77adf3d1cd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440301.271065:0:9225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e22ee83a/0x85f5fa77adf3d1cd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440301.271137:0:9225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e22ee83a/0x85f5fa77adf3d1cd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440301.271165:0:9225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787440301.271219:0:5837:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787440301.271226:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e22ee83a/0x85f5fa77adf3d1cd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440301.271248:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee07f86fc00 already unused, calling callback (ffffffffc15b52a0) 00010000:00010000:0.0:1787440301.271252:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e22ee83a/0x85f5fa77adf3d1cd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440301.271261:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e22ee83a/0x85f5fa77adf3d1cd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440301.271350:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e22ee83a/0x85f5fa77adf3d1cd lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440301.271358:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e22ee83a/0x85f5fa77adf3d1cd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440301.271375:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787440301.271377:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787440301.271379:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787440301.272684:0:9225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee07783a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3310:x1874266701249792:12345-0@lo:6:osp-syn-1-0.0 Request processed in 21705us (22119us total) trans 4294967322 rc 0/0 00000100:00100000:3.0:1787440301.272695:0:9225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000004:00080000:1.0:1787440301.272729:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8ee08090c700/2, rc 0, transno 4294967322 00000100:00100000:1.0:1787440301.272745:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee08090c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1874266701249792:0@lo:6:osp-syn-1-0.0 00000001:00080000:1.0:1787440301.300690:0:7640:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967320 is committed 00000001:00080000:1.0:1787440301.300711:0:7640:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967317 is committed 00000001:00080000:1.0:1787440301.300720:0:7640:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967321 is committed 00000100:00100000:3.0:1787440301.300853:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee0773fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+7:2361:x1874266681341952:12345-192.168.206.58@tcp:16:lhsmtool_posix.0 Request processed in 44554us (45249us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440301.300864:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 68 00000100:00100000:1.0:1787440301.304949:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440301.305167:0:6892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681342336 00000100:00100000:0.0:1787440301.305176:0:6892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681342336 00000100:00100000:0.0:1787440301.305344:0:6892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 228 00000100:00100000:0.0:1787440301.305355:0:6892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee080325c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+20:11620:x1874266681342336:12345-192.168.206.58@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787440301.305408:0:6892:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787440301.305434:0:6892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf600/0x85f5fa77adf3d1b8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc624cc expref: 20 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440301.305463:0:6892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8ee050ca1700) 00010000:00010000:0.0:1787440301.305480:0:6892:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787440301.305557:0:6892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcee00/0x85f5fa77adf3d1db lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440301.305572:0:6892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcee00/0x85f5fa77adf3d1db lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440301.305582:0:6892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcee00/0x85f5fa77adf3d1db lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787440301.305847:0:6892:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c3b0f072 reply state 000000009534bb99 transno 4294967508 ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcee00/0x85f5fa77adf3d1db lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440301.305858:0:6892:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787440301.305958:0:6892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee080325c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+21:11620:x1874266681342336:12345-192.168.206.58@tcp:36:lhsmtool_posix.0 Request processed in 605us (1018us total) trans 4294967508 rc 0/0 00000100:00100000:0.0:1787440301.305966:0:6892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 228 00010000:00010000:3.0:1787440301.307364:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcee00/0x85f5fa77adf3d1db lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440301.307378:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcee00/0x85f5fa77adf3d1db lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440301.307384:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcee00/0x85f5fa77adf3d1db lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440301.307821:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee04cbcee00 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:3.0:1787440301.307826:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcee00/0x85f5fa77adf3d1db lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440301.307833:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcee00/0x85f5fa77adf3d1db lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440301.307848:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8ee050ca1700) 00010000:00010000:3.0:1787440301.307851:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440301.307856:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcee00/0x85f5fa77adf3d1db lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440301.307863:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcee00/0x85f5fa77adf3d1db lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440301.308831:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:2.0:1787440301.309046:0:12016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681342464 00000100:00100000:2.0:1787440301.309067:0:12016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681342464 00000100:00100000:2.0:1787440301.309160:0:12016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 69 00000100:00100000:2.0:1787440301.309175:0:12016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee080326d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+7:2363:x1874266681342464:12345-192.168.206.58@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1787440301.309399:0:12016:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:2.0:1787440301.309403:0:12016:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1787440301 -> 1787440300 00002000:00010000:2.0:1787440301.309405:0:12016:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 1787440300 00002000:00010000:2.0:1787440301.309406:0:12016:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1787440301 -> 1787440300 00002000:00010000:2.0:1787440301.309408:0:12016:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1787440301.309589:0:12016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee080326d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+8:2363:x1874266681342464:12345-192.168.206.58@tcp:2:lhsmtool_posix.0 Request processed in 419us (763us total) trans 4294967323 rc 0/0 00000100:00100000:2.0:1787440301.309596:0:12016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 69 00000100:00100000:1.0:1787440301.314873:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440301.315397:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681342720 00000100:00100000:0.0:1787440301.315406:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681342720 00000100:00100000:0.0:1787440301.315468:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 229 00000100:00100000:0.0:1787440301.315478:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee080327800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+20:11620:x1874266681342720:12345-192.168.206.58@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1787440301.315576:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf600/0x85f5fa77adf3d1e2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440301.315592:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf200/0x85f5fa77adf3d19c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc624be expref: 20 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440301.315601:0:5849:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf600/0x85f5fa77adf3d1e2 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440301.315631:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf200/0x85f5fa77adf3d19c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc624be expref: 20 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440301.315658:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf200/0x85f5fa77adf3d19c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc624be expref: 20 pid: 5849 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440301.315671:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee077cf1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5849:1874266701250304:192.168.206.58@tcp:104: 00000100:00100000:0.0:1787440301.315915:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee045f0e540 going to sleep for 11 seconds 00000100:00100000:2.0:1787440301.325804:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440301.325883:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681342848 00000100:00100000:3.0:1787440301.325893:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681342848 00010000:00010000:3.0:1787440301.325931:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf200/0x85f5fa77adf3d19c lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc624be expref: 21 pid: 5849 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440301.325972:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 86 00000100:00100000:3.0:1787440301.325982:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee050483100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+21:2362:x1874266681342848:12345-192.168.206.58@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787440301.326005:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787440301.326014:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf200/0x85f5fa77adf3d19c lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc624be expref: 21 pid: 5849 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440301.326028:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf200/0x85f5fa77adf3d19c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc624be expref: 21 pid: 5849 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440301.326087:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8ee050ca1700) 00010000:00010000:3.0:1787440301.326092:0:5836:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf600/0x85f5fa77adf3d1e2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440301.326102:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf600/0x85f5fa77adf3d1e2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440301.326109:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf600/0x85f5fa77adf3d1e2 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440301.326128:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787440301.326186:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee050483100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+21:2362:x1874266681342848:12345-192.168.206.58@tcp:103:ldlm_bl.0 Request processed in 205us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440301.326194:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 86 00010000:00010000:0.0:1787440301.327986:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf200/0x85f5fa77adf3d19c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc624be expref: 20 pid: 5849 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440301.328151:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee077cf1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5849:1874266701250304:192.168.206.58@tcp:104: 00010000:00010000:0.0:1787440301.328175:0:5849:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf600/0x85f5fa77adf3d1e2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440301.328185:0:5849:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf600/0x85f5fa77adf3d1e2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440301.328192:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf600/0x85f5fa77adf3d1e2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440301.328222:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf600/0x85f5fa77adf3d1e2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440301.328230:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf600/0x85f5fa77adf3d1e2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440301.328237:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf600/0x85f5fa77adf3d1e2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440301.328243:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee04cbcf600 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:0.0:1787440301.328262:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf600/0x85f5fa77adf3d1e2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440301.328270:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf600/0x85f5fa77adf3d1e2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440301.328336:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8ee050ca1700) 00010000:00010000:0.0:1787440301.328340:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1787440301.328346:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf600/0x85f5fa77adf3d1e2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440301.328352:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf600/0x85f5fa77adf3d1e2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440301.328543:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee080327800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+19:11620:x1874266681342720:12345-192.168.206.58@tcp:55:lhsmtool_posix.0 Request processed in 13065us (13677us total) trans 0 rc -22/-22 00000100:00100000:0.0:1787440301.328554:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 229 00000100:00100000:2.0:1787440301.331672:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:1.0:1787440301.331838:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681342976 00000100:00100000:1.0:1787440301.331848:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681342976 00000100:00100000:1.0:1787440301.331945:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 70 00000100:00100000:1.0:1787440301.331954:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee050480000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+8:2362:x1874266681342976:12345-192.168.206.58@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1787440301.332008:0:6697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000006fff68b8/0x85f5fa77adf3d1e9 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440301.332029:0:6697:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000103223a1/0x85f5fa77adf3d1c6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc624da expref: 8 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440301.332037:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787440301.332041:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787440301.332045:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006fff68b8/0x85f5fa77adf3d1e9 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440301.332213:0:6697:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000103223a1/0x85f5fa77adf3d1c6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc624da expref: 8 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440301.332227:0:6697:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000103223a1/0x85f5fa77adf3d1c6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc624da expref: 8 pid: 6697 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440301.332256:0:6697:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee05fcdf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6697:1874266701250432:192.168.206.58@tcp:104: 00000100:00100000:1.0:1787440301.332344:0:6697:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee047c02300 going to sleep for 11 seconds 00000100:00100000:0.0:1787440301.337022:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440301.337213:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681343104 00000100:00100000:3.0:1787440301.337223:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681343104 00010000:00010000:3.0:1787440301.337262:0:6711:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000103223a1/0x85f5fa77adf3d1c6 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc624da expref: 9 pid: 6697 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440301.337307:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 87 00000100:00100000:3.0:1787440301.337317:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee077cf1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+9:2363:x1874266681343104:12345-192.168.206.58@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787440301.337332:0:6711:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787440301.337356:0:6711:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000103223a1/0x85f5fa77adf3d1c6 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc624da expref: 9 pid: 6697 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440301.337370:0:6711:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000103223a1/0x85f5fa77adf3d1c6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc624da expref: 9 pid: 6697 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440301.337418:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787440301.337422:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787440301.337428:0:6711:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006fff68b8/0x85f5fa77adf3d1e9 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440301.337438:0:6711:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006fff68b8/0x85f5fa77adf3d1e9 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440301.337471:0:6711:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787440301.337550:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee077cf1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+9:2363:x1874266681343104:12345-192.168.206.58@tcp:103:ldlm_bl.0 Request processed in 233us (536us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440301.337558:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 87 00010000:00010000:1.0:1787440301.339805:0:6697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000103223a1/0x85f5fa77adf3d1c6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc624da expref: 8 pid: 6697 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440301.339829:0:6697:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee05fcdf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6697:1874266701250432:192.168.206.58@tcp:104: 00010000:00010000:1.0:1787440301.339853:0:6697:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000006fff68b8/0x85f5fa77adf3d1e9 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440301.339953:0:6697:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000006fff68b8/0x85f5fa77adf3d1e9 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440301.339962:0:6697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006fff68b8/0x85f5fa77adf3d1e9 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440301.340142:0:6697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000006fff68b8/0x85f5fa77adf3d1e9 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440301.340153:0:6697:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006fff68b8/0x85f5fa77adf3d1e9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440301.340185:0:6697:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006fff68b8/0x85f5fa77adf3d1e9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440301.340193:0:6697:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee07fb9e400 already unused, calling callback (ffffffffc15b52a0) 00010000:00010000:0.0:1787440301.340197:0:6697:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006fff68b8/0x85f5fa77adf3d1e9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440301.340206:0:6697:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006fff68b8/0x85f5fa77adf3d1e9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440301.340225:0:6697:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006fff68b8/0x85f5fa77adf3d1e9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440301.340233:0:6697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006fff68b8/0x85f5fa77adf3d1e9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440301.340376:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee050480000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+7:2362:x1874266681342976:12345-192.168.206.58@tcp:1:lhsmtool_posix.0 Request processed in 8422us (8711us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440301.340386:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 70 00000100:00100000:0.0:1787440301.347829:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:2.0:1787440301.347930:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681343360 00000100:00100000:2.0:1787440301.347940:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681343360 00000100:00100000:2.0:1787440301.348116:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 230 00000100:00100000:2.0:1787440301.348128:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee077cf1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+19:11620:x1874266681343360:12345-192.168.206.58@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1787440301.348216:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86ee00/0x85f5fa77adf3d1f0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440301.348234:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86ee00/0x85f5fa77adf3d1f0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440301.348247:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86ee00/0x85f5fa77adf3d1f0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440301.348481:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e200/0x85f5fa77adf3d1f7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440301.348530:0:5850:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce000/0x85f5fa77adf3d1aa lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc624c5 expref: 20 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440301.348540:0:5850:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e200/0x85f5fa77adf3d1f7 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440301.348578:0:5850:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce000/0x85f5fa77adf3d1aa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc624c5 expref: 20 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440301.348595:0:5850:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce000/0x85f5fa77adf3d1aa lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc624c5 expref: 20 pid: 5849 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440301.348611:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee050480a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5850:1874266701250560:192.168.206.58@tcp:104: 00000100:00100000:2.0:1787440301.348706:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee047f96d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787440301.351320:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee050480a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5850:1874266701250560:192.168.206.58@tcp:104: 00010000:00010000:3.0:1787440301.351350:0:5850:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e200/0x85f5fa77adf3d1f7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440301.352808:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440301.352886:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681343488 00000100:00100000:3.0:1787440301.352894:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681343488 00010000:00010000:3.0:1787440301.352929:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce000/0x85f5fa77adf3d1aa lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc624c5 expref: 21 pid: 5849 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440301.352968:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 88 00000100:00100000:3.0:1787440301.352978:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee06e7e6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+21:2362:x1874266681343488:12345-192.168.206.58@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787440301.352992:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787440301.353007:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce000/0x85f5fa77adf3d1aa lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc624c5 expref: 21 pid: 5849 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440301.353031:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce000/0x85f5fa77adf3d1aa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc624c5 expref: 21 pid: 5849 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440301.353062:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce000/0x85f5fa77adf3d1aa lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc624c5 expref: 21 pid: 5849 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440301.353077:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8ee050ca1700) 00010000:00010000:3.0:1787440301.353089:0:5836:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e200/0x85f5fa77adf3d1f7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440301.353098:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e200/0x85f5fa77adf3d1f7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440301.353105:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e200/0x85f5fa77adf3d1f7 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440301.353131:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787440301.353172:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee06e7e6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+20:2362:x1874266681343488:12345-192.168.206.58@tcp:103:ldlm_bl.0 Request processed in 196us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440301.353179:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 88 00010000:00010000:0.0:1787440301.353344:0:5850:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e200/0x85f5fa77adf3d1f7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440301.353352:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e200/0x85f5fa77adf3d1f7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787440301.353549:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:0.0:1787440301.353672:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000001:00080000:0.0:1787440301.353727:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:0.0:1787440301.353829:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee077cf3100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5850:1874266701250688:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1787440301.353876:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440301.353900:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee045f0e9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787440301.354539:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701250688 00000100:00100000:3.0:1787440301.354547:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701250688 00000100:00100000:3.0:1787440301.354603:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787440301.354611:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee077cf1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5850:x1874266701250688:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1787440301.354684:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee077cf1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5850:x1874266701250688:12345-0@lo:1000:mdt00_001.0 Request processed in 73us (807us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440301.354691:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787440301.355242:0:5850:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967321 gen 2 00000004:00080000:0.0:1787440301.355249:0:5850:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967321 00000004:00080000:0.0:1787440301.355266:0:5850:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8ee08090ea00, transno 4294967321 00000100:00100000:0.0:1787440301.355324:0:5850:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff8ee08090c700 x1874266701249792/t4294967322(4294967322) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1787440317 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787440301.355337:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee077cf3100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5850:1874266701250688:0@lo:1000:mdt00_001.0 00000001:00080000:0.0:1787440301.355853:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967512 00000100:00100000:0.0:1787440301.355923:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee077cf3100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5850:1874266701250816:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1787440301.355973:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440301.356013:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee045f0e540 going to sleep for 11 seconds 00000100:00100000:3.0:1787440301.357324:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701250816 00000100:00100000:3.0:1787440301.357335:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701250816 00000100:00100000:3.0:1787440301.357397:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787440301.357406:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee080b05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5850:x1874266701250816:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1787440301.357682:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee080b05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5850:x1874266701250816:12345-0@lo:1000:mdt00_001.0 Request processed in 276us (1707us total) trans 4294967324 rc 0/0 00000100:00100000:3.0:1787440301.357690:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787440301.357802:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee077cf3100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5850:1874266701250816:0@lo:1000:mdt00_001.0 00010000:00010000:1.0:1787440301.357841:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e200/0x85f5fa77adf3d1f7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440301.357851:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e200/0x85f5fa77adf3d1f7 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440301.357859:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e200/0x85f5fa77adf3d1f7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440301.357866:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee07f86e200 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:1.0:1787440301.357870:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e200/0x85f5fa77adf3d1f7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440301.357878:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e200/0x85f5fa77adf3d1f7 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440301.357908:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8ee050ca1700) 00010000:00010000:1.0:1787440301.357911:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787440301.357915:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e200/0x85f5fa77adf3d1f7 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440301.357922:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e200/0x85f5fa77adf3d1f7 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440301.357952:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86ec00/0x85f5fa77adf3d13a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440301.357958:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86ec00/0x85f5fa77adf3d13a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440301.357963:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86ec00/0x85f5fa77adf3d13a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440301.357968:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee07f86ec00 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:1.0:1787440301.357971:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86ec00/0x85f5fa77adf3d13a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440301.357977:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86ec00/0x85f5fa77adf3d13a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440301.357984:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8ee0460cc100) 00010000:00010000:1.0:1787440301.357986:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787440301.357993:0:5850:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95a00/0x85f5fa77adf3d141 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc624a9 expref: 23 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440301.358014:0:5850:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95a00/0x85f5fa77adf3d141 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc624a9 expref: 23 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440301.358030:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95a00/0x85f5fa77adf3d141 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc624a9 expref: 23 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440301.358233:0:5850:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95a00/0x85f5fa77adf3d141 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc624a9 expref: 23 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440301.358251:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee05fcdf800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5850:1874266701250944:192.168.206.58@tcp:105: 00000100:00100000:1.0:1787440301.358327:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee047c02300 going to sleep for 11 seconds 00000100:00100000:0.0:1787440301.362369:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:1.0:1787440301.362454:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee05fcdf800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5850:1874266701250944:192.168.206.58@tcp:105: 00010000:00010000:1.0:1787440301.362480:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86ec00/0x85f5fa77adf3d13a lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440301.362512:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86ec00/0x85f5fa77adf3d13a lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440301.362546:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fa00/0x85f5fa77adf3d1fe lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440301.362559:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fa00/0x85f5fa77adf3d1fe lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440301.362569:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fa00/0x85f5fa77adf3d1fe lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440301.362578:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fa00/0x85f5fa77adf3d1fe lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440301.362584:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fa00/0x85f5fa77adf3d1fe lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440301.362603:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fa00/0x85f5fa77adf3d1fe lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440301.362609:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee07fb9fa00 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:1.0:1787440301.362612:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fa00/0x85f5fa77adf3d1fe lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440301.362618:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fa00/0x85f5fa77adf3d1fe lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440301.362628:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8ee0460cc100) 00010000:00010000:1.0:1787440301.362631:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440301.362634:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fa00/0x85f5fa77adf3d1fe lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440301.362639:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fa00/0x85f5fa77adf3d1fe lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440301.362647:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86ee00/0x85f5fa77adf3d1f0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440301.362652:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86ee00/0x85f5fa77adf3d1f0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440301.362657:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86ee00/0x85f5fa77adf3d1f0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440301.362661:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee07f86ee00 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:1.0:1787440301.362663:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86ee00/0x85f5fa77adf3d1f0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440301.362677:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86ee00/0x85f5fa77adf3d1f0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440301.362684:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8ee0460cc100) 00010000:00010000:1.0:1787440301.362686:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787440301.362689:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86ee00/0x85f5fa77adf3d1f0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440301.362693:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86ee00/0x85f5fa77adf3d1f0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440301.362914:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee077cf1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+23:11620:x1874266681343360:12345-192.168.206.58@tcp:57:lhsmtool_posix.0 Request processed in 14788us (15100us total) trans 4294967513 rc 0/0 00000100:00100000:1.0:1787440301.362924:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 230 00000020:00080000:1.0:1787440301.362930:0:5850:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1787440301.363323:0:11682:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787440301.363328:0:11682:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787440301.363854:0:11682:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:0.0:1787440301.363862:0:11682:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787440301.364110:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681343616 00000100:00100000:3.0:1787440301.364120:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681343616 00000100:00100000:3.0:1787440301.364173:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 61 00000100:00100000:3.0:1787440301.364184:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee080b07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+23:11618:x1874266681343616:12345-192.168.206.58@tcp:49:lfs.0 00000100:00100000:3.0:1787440301.364302:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee080b07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+23:11618:x1874266681343616:12345-192.168.206.58@tcp:49:lfs.0 Request processed in 120us (1941us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440301.364309:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 61 00000100:00100000:0.0:1787440301.372900:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440301.373006:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:2.0:1787440301.373201:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681344128 00000100:00100000:2.0:1787440301.373210:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681344128 00000100:00100000:2.0:1787440301.373268:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 231 00000100:00100000:2.0:1787440301.373278:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee06e6cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+23:11618:x1874266681344128:12345-192.168.206.58@tcp:58:lfs.0 00000040:00080000:2.0:1787440301.373660:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:2.0:1787440301.373745:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee06e6cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+23:11618:x1874266681344128:12345-192.168.206.58@tcp:58:lfs.0 Request processed in 456us (735us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440301.373752:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 231 00000100:00100000:3.0:1787440301.374626:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681343872 00000100:00100000:3.0:1787440301.374635:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681343872 00000100:00100000:3.0:1787440301.374674:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 62 00000100:00100000:3.0:1787440301.374683:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee079baf850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+23:11620:x1874266681343872:12345-192.168.206.58@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1787440301.375389:0:5852:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1787440301.375556:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967514 00010000:00010000:3.0:1787440301.375607:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94400/0x85f5fa77adf3d205 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440301.375623:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94400/0x85f5fa77adf3d205 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440301.375634:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94400/0x85f5fa77adf3d205 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440301.375654:0:5852:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94400/0x85f5fa77adf3d205 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440301.375661:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94400/0x85f5fa77adf3d205 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440301.375667:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94400/0x85f5fa77adf3d205 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440301.375685:0:5852:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787440301.375788:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee079baf850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+25:11620:x1874266681343872:12345-192.168.206.58@tcp:35:lhsmtool_posix.0 Request processed in 1103us (2893us total) trans 4294967515 rc 0/0 00000100:00100000:3.0:1787440301.375796:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 62 00000020:00080000:3.0:1787440301.375801:0:5852:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787440301.375975:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787440301.375982:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94400/0x85f5fa77adf3d205 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440301.375990:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee049e94400 already unused, calling callback (ffffffffc15b52a0) 00010000:00010000:1.0:1787440301.375995:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94400/0x85f5fa77adf3d205 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440301.376002:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94400/0x85f5fa77adf3d205 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440301.376015:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8ee0460cc300) 00010000:00010000:1.0:1787440301.376018:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787440301.376022:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94400/0x85f5fa77adf3d205 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440301.376039:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94400/0x85f5fa77adf3d205 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440301.376068:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787440301.376070:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787440301.376082:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787440301.419169:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:2.0:1787440301.419348:0:6892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681344256 00000100:00100000:2.0:1787440301.419357:0:6892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681344256 00000100:00100000:2.0:1787440301.419416:0:6892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 232 00000100:00100000:2.0:1787440301.419427:0:6892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee077ec0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+25:11622:x1874266681344256:12345-192.168.206.58@tcp:101:lfs.0 00010000:00010000:2.0:1787440301.419459:0:6892:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440301.419480:0:6892:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e400/0x85f5fa77adf3d20c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fab14535dc624e1 expref: -99 pid: 6892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440301.419573:0:6892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86fc00/0x85f5fa77adf3d213 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440301.419588:0:6892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86fc00/0x85f5fa77adf3d213 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440301.419600:0:6892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86fc00/0x85f5fa77adf3d213 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440301.419616:0:6892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f000/0x85f5fa77adf3d21a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440301.419624:0:6892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f000/0x85f5fa77adf3d21a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440301.419651:0:6892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f000/0x85f5fa77adf3d21a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440301.419960:0:6892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86ee00/0x85f5fa77adf3d221 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440301.419972:0:6892:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce800/0x85f5fa77adf3d12c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc624a2 expref: 26 pid: 6892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440301.419981:0:6892:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86ee00/0x85f5fa77adf3d221 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440301.420014:0:6892:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce800/0x85f5fa77adf3d12c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc624a2 expref: 26 pid: 6892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440301.420027:0:6892:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce800/0x85f5fa77adf3d12c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc624a2 expref: 26 pid: 6892 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440301.420063:0:6892:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee050480700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6892:1874266701251072:192.168.206.58@tcp:104: 00000100:00100000:2.0:1787440301.420410:0:6892:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee047f960c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787440301.427600:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440301.427748:0:6892:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee050480700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6892:1874266701251072:192.168.206.58@tcp:104: 00010000:00010000:0.0:1787440301.427776:0:6892:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86ee00/0x85f5fa77adf3d221 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440301.431152:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681344512 00000100:00100000:3.0:1787440301.431171:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681344512 00000100:00100000:3.0:1787440301.432088:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 63 00000100:00100000:3.0:1787440301.432105:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee050483800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+27:5601:x1874266681344512:12345-192.168.206.58@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1787440301.432373:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee050483800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+28:5601:x1874266681344512:12345-192.168.206.58@tcp:35:ldlm_bl.0 Request processed in 274us (4782us total) trans 4294967516 rc 0/0 00000100:00100000:3.0:1787440301.432381:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 63 00000100:00100000:1.0:1787440301.437990:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440301.438874:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681344640 00000100:00100000:3.0:1787440301.438886:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681344640 00010000:00010000:3.0:1787440301.438929:0:6711:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce800/0x85f5fa77adf3d12c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc624a2 expref: 28 pid: 6892 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440301.439027:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 89 00000100:00100000:3.0:1787440301.439037:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee05fcdf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+28:2362:x1874266681344640:12345-192.168.206.58@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787440301.439090:0:6711:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787440301.439098:0:6711:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce800/0x85f5fa77adf3d12c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc624a2 expref: 28 pid: 6892 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440301.439111:0:6711:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce800/0x85f5fa77adf3d12c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc624a2 expref: 28 pid: 6892 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440301.439133:0:6711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce800/0x85f5fa77adf3d12c lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc624a2 expref: 28 pid: 6892 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440301.439150:0:6711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8ee0460cc100) 00010000:00010000:3.0:1787440301.439155:0:6711:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86ee00/0x85f5fa77adf3d221 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440301.439164:0:6711:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86ee00/0x85f5fa77adf3d221 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440301.439171:0:6711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86ee00/0x85f5fa77adf3d221 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440301.439206:0:6711:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787440301.439311:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee05fcdf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+27:2362:x1874266681344640:12345-192.168.206.58@tcp:103:ldlm_bl.0 Request processed in 275us (1328us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440301.439319:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 89 00010000:00010000:0.0:1787440301.442312:0:6892:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86ee00/0x85f5fa77adf3d221 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440301.442329:0:6892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86ee00/0x85f5fa77adf3d221 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787440301.442378:0:6892:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1787440301.442383:0:6892:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787440301.442404:0:6892:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86ee00/0x85f5fa77adf3d221 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440301.442420:0:6892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86ee00/0x85f5fa77adf3d221 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440301.442430:0:6892:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86fc00/0x85f5fa77adf3d213 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440301.442436:0:6892:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86fc00/0x85f5fa77adf3d213 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440301.442442:0:6892:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86fc00/0x85f5fa77adf3d213 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440301.442465:0:6892:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee07f86fc00 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:0.0:1787440301.442469:0:6892:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86fc00/0x85f5fa77adf3d213 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440301.442476:0:6892:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86fc00/0x85f5fa77adf3d213 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440301.442490:0:6892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8ee05132ea00) 00010000:00010000:0.0:1787440301.442539:0:6892:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440301.442545:0:6892:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86fc00/0x85f5fa77adf3d213 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440301.442552:0:6892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86fc00/0x85f5fa77adf3d213 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440301.442571:0:6892:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f000/0x85f5fa77adf3d21a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440301.442577:0:6892:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f000/0x85f5fa77adf3d21a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440301.442582:0:6892:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f000/0x85f5fa77adf3d21a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440301.442587:0:6892:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee07f86f000 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:0.0:1787440301.442589:0:6892:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f000/0x85f5fa77adf3d21a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440301.442594:0:6892:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f000/0x85f5fa77adf3d21a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440301.442602:0:6892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8ee054b3c600) 00010000:00010000:0.0:1787440301.442605:0:6892:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440301.442607:0:6892:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f000/0x85f5fa77adf3d21a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440301.442612:0:6892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f000/0x85f5fa77adf3d21a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440301.442659:0:6892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e400/0x85f5fa77adf3d20c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc624e1 expref: 27 pid: 6892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440301.442687:0:6892:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86ee00/0x85f5fa77adf3d221 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc624e1 expref: 26 pid: 6892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440301.442694:0:6892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8ee0460cc100) 00010000:00010000:0.0:1787440301.442697:0:6892:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787440301.442699:0:6892:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee07f86ee00, rc 0) 00000100:00100000:0.0:1787440301.442759:0:6892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee077ec0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+26:11622:x1874266681344256:12345-192.168.206.58@tcp:101:lfs.0 Request processed in 23334us (23599us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440301.442768:0:6892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 232 00010000:00010000:1.0:1787440302.177910:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787440302.328796:0:12509:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787440302.328805:0:12509:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787440302.328851:0:12509:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1787440302.329619:0:12509:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:0.0:1787440302.365889:0:11682:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787440302.365897:0:11682:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787440302.365933:0:11682:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1787440302.365938:0:11682:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787440302.366067:0:11682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee077ec3b80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11682:1874266701251200:192.168.206.58@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787440302.366156:0:11682:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee04a6e8d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787440302.380553:0:11682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee077ec3b80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11682:1874266701251200:192.168.206.58@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787440302.391172:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440302.392222:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681344768 00000100:00100000:3.0:1787440302.392234:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681344768 00000100:00100000:3.0:1787440302.392316:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 233 00000100:00100000:3.0:1787440302.392327:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee05fcdea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+26:11633:x1874266681344768:12345-192.168.206.58@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787440302.392377:0:5851:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787440302.392486:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee05fcdea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+26:11633:x1874266681344768:12345-192.168.206.58@tcp:53:lhsmtool_posix.0 Request processed in 160us (1323us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440302.392530:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 233 00000100:00100000:1.0:1787440302.413189:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440302.414305:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681345024 00000100:00100000:0.0:1787440302.414318:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681345024 00000100:00100000:0.0:1787440302.414387:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 234 00000100:00100000:0.0:1787440302.414398:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee049044380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+26:11633:x1874266681345024:12345-192.168.206.58@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787440302.414419:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440302.414450:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce800/0x85f5fa77adf3d228 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fab14535dc624e8 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440302.414570:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce000/0x85f5fa77adf3d22f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440302.414584:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce000/0x85f5fa77adf3d22f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440302.414596:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce000/0x85f5fa77adf3d22f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787440302.414607:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1787440302.414752:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce800/0x85f5fa77adf3d228 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc624e8 expref: 29 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440302.414771:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce000/0x85f5fa77adf3d22f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc624e8 expref: 28 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440302.415194:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8ee0460cc100) 00010000:00010000:0.0:1787440302.415197:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787440302.415200:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee04cbce000, rc 0) 00000100:00100000:0.0:1787440302.415273:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee049044380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+28:11633:x1874266681345024:12345-192.168.206.58@tcp:101:lhsmtool_posix.0 Request processed in 878us (2091us total) trans 4294967517 rc 0/0 00000100:00100000:0.0:1787440302.415281:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 234 00000100:00100000:2.0:1787440302.424677:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440302.424898:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681345152 00000100:00100000:0.0:1787440302.424913:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681345152 00000100:00100000:0.0:1787440302.424980:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 16 00000100:00100000:0.0:1787440302.424990:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee050482300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+28:2360:x1874266681345152:12345-192.168.206.58@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787440302.425022:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787440302.425062:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce000/0x85f5fa77adf3d22f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc624e8 expref: 28 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440302.425081:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8ee0460cc100) 00010000:00010000:0.0:1787440302.425086:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787440302.425146:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee050482300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+27:2360:x1874266681345152:12345-192.168.206.58@tcp:103:ldlm_bl.0 Request processed in 156us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440302.425153:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 16 00000100:00100000:2.0:1787440302.431421:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440302.431577:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681345408 00000100:00100000:0.0:1787440302.431588:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681345408 00000100:00100000:0.0:1787440302.431656:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 235 00000100:00100000:0.0:1787440302.431666:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee050480700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+27:11633:x1874266681345408:12345-192.168.206.58@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787440302.431748:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce000/0x85f5fa77adf3d23d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440302.431765:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce000/0x85f5fa77adf3d23d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440302.431776:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce000/0x85f5fa77adf3d23d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440302.431968:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce000/0x85f5fa77adf3d23d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440302.431976:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce000/0x85f5fa77adf3d23d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440302.431983:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce000/0x85f5fa77adf3d23d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440302.432001:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee04cbce000 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:0.0:1787440302.432006:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce000/0x85f5fa77adf3d23d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440302.432012:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce000/0x85f5fa77adf3d23d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440302.432024:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8ee0460cc100) 00010000:00010000:0.0:1787440302.432027:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787440302.432031:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce000/0x85f5fa77adf3d23d lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440302.432037:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce000/0x85f5fa77adf3d23d lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440302.432622:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee050480700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+28:11633:x1874266681345408:12345-192.168.206.58@tcp:57:lhsmtool_posix.0 Request processed in 955us (1211us total) trans 4294967518 rc 0/0 00000100:00100000:0.0:1787440302.432633:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 235 00000040:00080000:1.0:1787440302.433006:0:11682:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787440302.433011:0:11682:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787440302.433543:0:11682:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1787440302.433551:0:11682:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787440302.436380:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:2.0:1787440302.436489:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681345664 00000100:00100000:2.0:1787440302.436518:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681345664 00000100:00100000:2.0:1787440302.436568:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 64 00000100:00100000:2.0:1787440302.436578:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee077ec3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+28:11633:x1874266681345664:12345-192.168.206.58@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787440302.436809:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee077ec3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+29:11633:x1874266681345664:12345-192.168.206.58@tcp:35:lhsmtool_posix.0 Request processed in 232us (437us total) trans 4294967519 rc 0/0 00000100:00100000:2.0:1787440302.436818:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 64 00000100:00100000:3.0:1787440303.161301:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440303.161340:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440303.161371:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440303.161403:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440303.161443:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440303.161482:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681346176 00000100:00100000:3.0:1787440303.161516:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681346176 00000100:00100000:3.0:1787440303.161571:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681346048 00000100:00100000:3.0:1787440303.161574:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681346048 00000100:00100000:3.0:1787440303.161596:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 95 00000100:00100000:2.0:1787440303.161608:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 96 00000100:00100000:3.0:1787440303.161609:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee077cf3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+7:2361:x1874266681346176:12345-192.168.206.58@tcp:400:kworker.0 00000100:00100000:2.0:1787440303.161623:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee080b07b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+7:2361:x1874266681346048:12345-192.168.206.58@tcp:400:kworker.0 00000100:00100000:0.0:1787440303.161726:0:6892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681345920 00000100:00100000:0.0:1787440303.161731:0:6892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681345920 00000100:00100000:0.0:1787440303.161778:0:6892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681346304 00000100:00100000:0.0:1787440303.161781:0:6892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681346304 00000100:00100000:0.0:1787440303.161805:0:6892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 160 00000100:00100000:0.0:1787440303.161812:0:6892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee077839c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+29:2361:x1874266681345920:12345-192.168.206.58@tcp:400:kworker.0 00000100:00100000:1.0:1787440303.161884:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681345792 00000100:00100000:1.0:1787440303.161888:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681345792 00000100:00100000:1.0:1787440303.161917:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 300 00000100:00100000:1.0:1787440303.161924:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee06d270850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+13:2361:x1874266681345792:12345-192.168.206.58@tcp:400:kworker.0 00000100:00100000:3.0:1787440303.161983:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee077cf3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+7:2361:x1874266681346176:12345-192.168.206.58@tcp:400:kworker.0 Request processed in 378us (640us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440303.161991:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 95 00000100:00100000:3.0:1787440303.162017:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 161 00000100:00100000:3.0:1787440303.162024:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee08090ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fde7b340-91f7-42a0-a1a3-5665ea2691c9+5:2361:x1874266681346304:12345-192.168.206.58@tcp:400:kworker.0 00000100:00100000:2.0:1787440303.164671:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee080b07b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+7:2361:x1874266681346048:12345-192.168.206.58@tcp:400:kworker.0 Request processed in 3040us (3254us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440303.164686:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 96 00000100:00080000:2.0:1787440303.164759:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787440303.164767:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787440303.164770:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787440303.169440:0:6892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee077839c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+29:2361:x1874266681345920:12345-192.168.206.58@tcp:400:kworker.0 Request processed in 7617us (8138us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440303.169455:0:6892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 160 00000100:00100000:1.0:1787440303.170997:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee06d270850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+13:2361:x1874266681345792:12345-192.168.206.58@tcp:400:kworker.0 Request processed in 9068us (9620us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440303.171009:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 300 00000100:00100000:3.0:1787440303.181152:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee08090ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fde7b340-91f7-42a0-a1a3-5665ea2691c9+5:2361:x1874266681346304:12345-192.168.206.58@tcp:400:kworker.0 Request processed in 19117us (19698us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440303.181166:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 161 00010000:00010000:1.0:1787440303.197091:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787440303.524401:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787440303.524425:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee077ec3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874266701251328:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787440303.524510:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440303.524650:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701251328 00000100:00100000:0.0:1787440303.524841:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701251328 00000100:00100000:0.0:1787440303.524965:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787440303.524977:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee05035a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3311:x1874266701251328:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787440303.524978:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:0.0:1787440303.525016:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 52756480 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787440303.525359:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee05035a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3311:x1874266701251328:12345-0@lo:13:osp-pre-0-0.0 Request processed in 384us (865us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440303.525367:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787440303.525419:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee077ec3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874266701251328:0@lo:13:osp-pre-0-0.0 00000001:00080000:0.0:1787440304.100426:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000001:00080000:0.0:1787440304.100440:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000040:00080000:3.0:1787440304.186376:0:12560:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787440304.186384:0:12560:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787440304.186437:0:12560:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1787440304.186446:0:12560:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1787440304.221154:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787440304.423307:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440304.423554:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681346560 00000100:00100000:0.0:1787440304.423566:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681346560 00000100:00100000:0.0:1787440304.423622:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 236 00000100:00100000:0.0:1787440304.423633:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee050483100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+29:11654:x1874266681346560:12345-192.168.206.58@tcp:101:lfs.0 00010000:00010000:0.0:1787440304.423654:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440304.423673:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce000/0x85f5fa77adf3d244 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fab14535dc624ef expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440304.423783:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce800/0x85f5fa77adf3d24b lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440304.423798:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce800/0x85f5fa77adf3d24b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440304.423827:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce800/0x85f5fa77adf3d24b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787440304.423840:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1787440304.423981:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce000/0x85f5fa77adf3d244 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc624ef expref: 32 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440304.423997:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce800/0x85f5fa77adf3d24b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc624ef expref: 31 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440304.424006:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8ee0460cc100) 00010000:00010000:0.0:1787440304.424009:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1787440304.424013:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee04cbce800, rc 0) 00000100:00100000:0.0:1787440304.424085:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee050483100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+31:11654:x1874266681346560:12345-192.168.206.58@tcp:101:lfs.0 Request processed in 453us (786us total) trans 4294967520 rc 0/0 00000100:00100000:0.0:1787440304.424093:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 236 00000100:00100000:2.0:1787440304.426810:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440304.428598:0:6892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681346688 00000100:00100000:0.0:1787440304.428611:0:6892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681346688 00000100:00100000:0.0:1787440304.428675:0:6892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 237 00000100:00100000:0.0:1787440304.428685:0:6892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee050480a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+31:11654:x1874266681346688:12345-192.168.206.58@tcp:54:lfs.0 00010000:00010000:0.0:1787440304.429382:0:6892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce600/0x85f5fa77adf3d259 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440304.429409:0:6892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce600/0x85f5fa77adf3d259 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440304.429421:0:6892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce600/0x85f5fa77adf3d259 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440304.429461:0:6892:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce600/0x85f5fa77adf3d259 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440304.429468:0:6892:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce600/0x85f5fa77adf3d259 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440304.429475:0:6892:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce600/0x85f5fa77adf3d259 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440304.429480:0:6892:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee04cbce600 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:0.0:1787440304.429485:0:6892:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce600/0x85f5fa77adf3d259 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440304.429525:0:6892:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce600/0x85f5fa77adf3d259 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440304.429538:0:6892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8ee0460cc100) 00010000:00010000:0.0:1787440304.429542:0:6892:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787440304.429546:0:6892:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce600/0x85f5fa77adf3d259 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440304.429552:0:6892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce600/0x85f5fa77adf3d259 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6892 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440304.429633:0:6892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee050480a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+31:11654:x1874266681346688:12345-192.168.206.58@tcp:54:lfs.0 Request processed in 948us (2830us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440304.429642:0:6892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 237 00000100:00100000:2.0:1787440304.541417:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee0804c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1874266701251840:0@lo:400:kworker.0 00000100:00100000:2.0:1787440304.541507:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440304.541569:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787440304.541576:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee0804c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3312:1874266701251712:0@lo:400:kworker.0 00000100:00100000:2.0:1787440304.541604:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440304.541641:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701251712 00000100:00100000:2.0:1787440304.541647:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701251712 00000100:00100000:2.0:1787440304.541696:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1787440304.541718:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee0804c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874266701251712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787440304.541767:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee0804c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874266701251712:12345-0@lo:400:kworker.0 Request processed in 64us (162us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440304.541774:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00080000:2.0:1787440304.541808:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787440304.541931:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee0804c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3312:1874266701251712:0@lo:400:kworker.0 00000100:00100000:1.0:1787440304.542042:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee0804c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874266701251584:0@lo:400:kworker.0 00000100:00100000:1.0:1787440304.542072:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440304.542099:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee0804c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1874266701252096:0@lo:400:kworker.0 00000100:00100000:1.0:1787440304.542119:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440304.542144:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1787440304.542150:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee0804c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:168176ea-29d1-49de-a254-317e90d54802:3310:1874266701251456:0@lo:400:kworker.0 00000100:00100000:1.0:1787440304.542177:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440304.542195:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee0804c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3310:1874266701251968:0@lo:400:kworker.0 00000100:00100000:1.0:1787440304.542215:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440304.542415:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701251840 00000100:00100000:0.0:1787440304.542420:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701251840 00000100:00100000:0.0:1787440304.542460:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701252096 00000100:00100000:0.0:1787440304.542468:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701252096 00000100:00100000:0.0:1787440304.542524:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1787440304.542532:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee0804c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1874266701251840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787440304.542577:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee0804c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1874266701251840:12345-0@lo:400:kworker.0 Request processed in 45us (1085us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440304.542584:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1787440304.542597:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1787440304.542603:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee049045c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3310:x1874266701252096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787440304.542636:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee049045c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3310:x1874266701252096:12345-0@lo:400:kworker.0 Request processed in 33us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440304.542642:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00080000:0.0:1787440304.542659:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787440304.542678:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee0804c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1874266701252096:0@lo:400:kworker.0 00000100:00100000:0.0:1787440304.542699:0:3312:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:0.0:1787440304.542704:0:3312:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967310 00000004:00080000:0.0:1787440304.542717:0:3312:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8ee0773fc380, transno 4294967310 00000100:00100000:0.0:1787440304.542727:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee0804c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1874266701251840:0@lo:400:kworker.0 00000100:00100000:1.0:1787440304.542995:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701251584 00000100:00100000:1.0:1787440304.543000:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701251584 00000100:00100000:1.0:1787440304.543024:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701251968 00000100:00100000:1.0:1787440304.543026:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701251968 00000100:00100000:1.0:1787440304.543059:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1787440304.543066:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee049047480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874266701251584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440304.543103:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee049047480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874266701251584:12345-0@lo:400:kworker.0 Request processed in 38us (1030us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440304.543109:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1787440304.543121:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1787440304.543127:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee049045f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874266701251968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440304.543153:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee049045f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874266701251968:12345-0@lo:400:kworker.0 Request processed in 27us (937us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440304.543159:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00080000:1.0:1787440304.543180:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787440304.543205:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee0804c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3310:1874266701251968:0@lo:400:kworker.0 00000100:00100000:1.0:1787440304.543214:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee0804c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874266701251584:0@lo:400:kworker.0 00000100:00100000:2.0:1787440304.543429:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701251456 00000100:00100000:2.0:1787440304.543433:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701251456 00000100:00100000:2.0:1787440304.543472:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:2.0:1787440304.543479:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee06d271050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:168176ea-29d1-49de-a254-317e90d54802+19:3310:x1874266701251456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787440304.543538:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee06d271050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:168176ea-29d1-49de-a254-317e90d54802+19:3310:x1874266701251456:12345-0@lo:400:kworker.0 Request processed in 59us (1360us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440304.543543:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:1.0:1787440304.544057:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee0804c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:168176ea-29d1-49de-a254-317e90d54802:3310:1874266701251456:0@lo:400:kworker.0 00000100:00100000:2.0:1787440304.556205:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440304.556291:0:9225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681346816 00000100:00100000:3.0:1787440304.556300:0:9225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681346816 00000100:00100000:3.0:1787440304.556354:0:9225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 71 00000100:00100000:3.0:1787440304.556364:0:9225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee0804c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+7:2362:x1874266681346816:12345-192.168.206.58@tcp:101:cat.0 00010000:00010000:3.0:1787440304.556379:0:9225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440304.556398:0:9225:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000de97f61a/0x85f5fa77adf3d260 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5fab14535dc624f6 expref: -99 pid: 9225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787440304.556424:0:9225:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 13, mtime: 0x6a8a2cac, atime: 0x6a8a2cac, ctime: 0x6a8a2cac, blocks: 0xb 00010000:00010000:3.0:1787440304.556442:0:9225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=402s v=(0 0) 00010000:00010000:3.0:1787440304.556446:0:9225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787440304.556456:0:9225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000de97f61a/0x85f5fa77adf3d260 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc624f6 expref: 8 pid: 9225 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440304.556471:0:9225:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000de97f61a/0x85f5fa77adf3d260 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc624f6 expref: 8 pid: 9225 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440304.556483:0:9225:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee049e95400, rc 0) 00000100:00100000:3.0:1787440304.556578:0:9225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee0804c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+8:2362:x1874266681346816:12345-192.168.206.58@tcp:101:cat.0 Request processed in 216us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440304.556585:0:9225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 71 00000100:00100000:2.0:1787440304.568336:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440304.568436:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681346944 00000100:00100000:0.0:1787440304.568446:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681346944 00002000:00100000:0.0:1787440304.568531:0:6703:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff8ee0804c4000 x1874266681346944/t0(0) o3->792563a7-4c22-4ac7-ac25-d49ef7fb41a8@192.168.206.58@tcp:465/0 lens 488/0 e 0 to 0 dl 1787440315 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787440304.568543:0:6703:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ee0804c4000 with x1874266681346944 ext(0->4095) 00002000:00010000:0.0:1787440304.568549:0:6703:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8ee0804c4000 00000100:00100000:0.0:1787440304.568572:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 7 00000100:00100000:0.0:1787440304.568580:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee0804c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+8:2362:x1874266681346944:12345-192.168.206.58@tcp:3:cat.0 00000100:00100000:0.0:1787440304.568806:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee0804c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+8:2362:x1874266681346944:12345-192.168.206.58@tcp:3:cat.0 Request processed in 225us (481us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787440304.568813:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 7 00002000:00100000:0.0:1787440304.568820:0:6703:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff8ee0804c4000 x1874266681346944/t0(0) o3->792563a7-4c22-4ac7-ac25-d49ef7fb41a8@192.168.206.58@tcp:465/0 lens 488/4536 e 0 to 0 dl 1787440315 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787440304.568828:0:6703:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ee0804c4000 with x1874266681346944 ext(0->4095) 00002000:00010000:0.0:1787440304.568832:0:6703:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8ee0804c4000 00000100:00100000:2.0:1787440305.053274:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787440305.053296:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee08090ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1874266701252224:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787440305.053365:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440305.053488:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701252224 00000100:00100000:3.0:1787440305.053512:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701252224 00000100:00100000:3.0:1787440305.053561:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787440305.053570:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee0804c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3312:x1874266701252224:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787440305.053618:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787440305.053668:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee0804c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3312:x1874266701252224:12345-0@lo:13:osp-pre-1-0.0 Request processed in 99us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440305.053676:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787440305.053860:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee08090ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1874266701252224:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787440305.245049:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787440306.269275:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787440306.655722:0:5871:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:0.0:1787440306.655744:0:5871:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8ee049e0a9c0 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:0.0:1787440306.655749:0:5871:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8ee08003e100 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8ee049e0ab40 00000020:00080000:0.0:1787440306.655753:0:5871:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8ee08003e500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8ee07f941c00 00000020:00080000:0.0:1787440306.655780:0:5871:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:0.0:1787440306.655822:0:5882:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:0.0:1787440306.656005:0:5882:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000001:00080000:0.0:1787440306.659397:0:7640:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967323 is committed 00000001:00080000:0.0:1787440306.659413:0:7640:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967324 is committed 00010000:00010000:1.0:1787440307.296661:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787440307.549430:0:11682:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787440307.549438:0:11682:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787440307.549664:0:11682:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1787440307.549671:0:11682:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787440308.284683:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:2.0:1787440308.284730:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:2.0:1787440308.284763:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:2.0:1787440308.284792:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:2.0:1787440308.284819:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:1.0:1787440308.284907:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681347072 00000100:00100000:1.0:1787440308.284926:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681347072 00000100:00100000:1.0:1787440308.284976:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 302 00000100:00100000:1.0:1787440308.284986:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee06d271450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+13:2361:x1874266681347072:12345-192.168.206.58@tcp:400:kworker.0 00000100:00100000:1.0:1787440308.285056:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee06d271450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+13:2361:x1874266681347072:12345-192.168.206.58@tcp:400:kworker.0 Request processed in 72us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440308.285063:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 302 00000100:00100000:1.0:1787440308.285092:0:6892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681347584 00000100:00100000:1.0:1787440308.285095:0:6892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681347584 00000100:00100000:1.0:1787440308.285123:0:6892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681347200 00000100:00100000:1.0:1787440308.285125:0:6892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681347200 00000100:00100000:1.0:1787440308.285142:0:6892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 165 00000100:00100000:1.0:1787440308.285147:0:6892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee0804c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fde7b340-91f7-42a0-a1a3-5665ea2691c9+5:2361:x1874266681347584:12345-192.168.206.58@tcp:400:kworker.0 00000100:00100000:1.0:1787440308.285171:0:6892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee0804c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fde7b340-91f7-42a0-a1a3-5665ea2691c9+5:2361:x1874266681347584:12345-192.168.206.58@tcp:400:kworker.0 Request processed in 25us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440308.285177:0:6892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 165 00000100:00100000:1.0:1787440308.285186:0:6892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 166 00000100:00100000:1.0:1787440308.285192:0:6892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee0804c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+18:2361:x1874266681347200:12345-192.168.206.58@tcp:400:kworker.0 00000100:00100000:1.0:1787440308.285212:0:6892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee0804c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+18:2361:x1874266681347200:12345-192.168.206.58@tcp:400:kworker.0 Request processed in 21us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440308.285217:0:6892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 166 00000100:00100000:1.0:1787440308.285231:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681347328 00000100:00100000:1.0:1787440308.285234:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681347328 00000100:00100000:1.0:1787440308.285255:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681347456 00000100:00100000:1.0:1787440308.285257:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681347456 00000100:00100000:1.0:1787440308.285275:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 99 00000100:00100000:1.0:1787440308.285280:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee0804c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+5:2361:x1874266681347328:12345-192.168.206.58@tcp:400:kworker.0 00000100:00100000:1.0:1787440308.285311:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee0804c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+5:2361:x1874266681347328:12345-192.168.206.58@tcp:400:kworker.0 Request processed in 31us (581us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440308.285317:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 99 00000100:00100000:1.0:1787440308.285327:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 100 00000100:00100000:1.0:1787440308.285333:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee08032df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+7:2361:x1874266681347456:12345-192.168.206.58@tcp:400:kworker.0 00000100:00100000:1.0:1787440308.285357:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee08032df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+7:2361:x1874266681347456:12345-192.168.206.58@tcp:400:kworker.0 Request processed in 24us (538us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440308.285362:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 100 00000100:00080000:1.0:1787440308.285485:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787440308.285489:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787440308.285522:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787440308.318117:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787440308.636854:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee0800a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1874266701252352:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787440308.636924:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440308.639243:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701252352 00000100:00100000:1.0:1787440308.639256:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701252352 00000100:00100000:1.0:1787440308.639344:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787440308.639353:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee08090ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874266701252352:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787440308.639388:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1787440308.639481:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787440308.640652:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee08090ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874266701252352:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1295us (3723us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440308.640664:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787440308.641381:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee0800a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1874266701252352:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787440309.341045:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787440309.661656:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee08032c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1874266701252864:0@lo:400:kworker.0 00000100:00100000:1.0:1787440309.661656:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee08032c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:168176ea-29d1-49de-a254-317e90d54802:3309:1874266701252480:0@lo:400:kworker.0 00000100:00100000:2.0:1787440309.661719:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440309.661719:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440309.661763:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee08032ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1874266701252992:0@lo:400:kworker.0 00000100:00100000:2.0:1787440309.661769:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787440309.661773:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee08032d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3312:1874266701252736:0@lo:400:kworker.0 00000100:00100000:1.0:1787440309.661788:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440309.661808:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1787440309.661822:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee08032f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874266701252608:0@lo:400:kworker.0 00000100:00100000:1.0:1787440309.661845:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440309.661871:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee08032dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874266701253120:0@lo:400:kworker.0 00000100:00100000:1.0:1787440309.661890:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440309.661919:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701252480 00000100:00100000:1.0:1787440309.661925:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701252480 00000100:00100000:1.0:1787440309.662079:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:1.0:1787440309.662088:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee06d272450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:168176ea-29d1-49de-a254-317e90d54802+19:3309:x1874266701252480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440309.662135:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee06d272450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:168176ea-29d1-49de-a254-317e90d54802+19:3309:x1874266701252480:12345-0@lo:400:kworker.0 Request processed in 48us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440309.662142:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:2.0:1787440309.662148:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701252992 00000100:00100000:2.0:1787440309.662152:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701252992 00000100:00100000:0.0:1787440309.663936:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701252864 00000100:00100000:0.0:1787440309.663949:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701252864 00000100:00100000:2.0:1787440309.667154:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701252608 00000100:00100000:0.0:1787440309.667154:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701253120 00000100:00100000:0.0:1787440309.667168:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701253120 00000100:00100000:2.0:1787440309.667176:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701252608 00000100:00100000:2.0:1787440309.667235:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1787440309.667235:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1787440309.667252:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee08032ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1874266701252864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787440309.667253:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee049044e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1874266701252992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440309.667371:0:6892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1787440309.667381:0:6892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee049044000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874266701252608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787440309.667547:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee08032ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1874266701252864:12345-0@lo:400:kworker.0 Request processed in 301us (5826us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440309.667552:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee049044e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1874266701252992:12345-0@lo:400:kworker.0 Request processed in 303us (5760us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440309.667560:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1787440309.667573:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1787440309.667583:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1787440309.667592:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee047a7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1874266701253120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787440309.667626:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee047a7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1874266701253120:12345-0@lo:400:kworker.0 Request processed in 36us (5734us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440309.667632:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00080000:0.0:1787440309.667651:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787440309.667656:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787440309.668305:0:6892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee049044000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874266701252608:12345-0@lo:400:kworker.0 Request processed in 925us (6456us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440309.668313:0:6892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1787440309.668357:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440309.668446:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee08032c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1874266701252864:0@lo:400:kworker.0 00000100:00100000:1.0:1787440309.668479:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee08032f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874266701252608:0@lo:400:kworker.0 00000100:00100000:1.0:1787440309.668521:0:3309:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:1.0:1787440309.668527:0:3309:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8ee08090c700, transno 4294967322 00000004:00080000:1.0:1787440309.668539:0:3309:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:1.0:1787440309.668569:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee08032dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874266701253120:0@lo:400:kworker.0 00000100:00100000:1.0:1787440309.668582:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee08032c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:168176ea-29d1-49de-a254-317e90d54802:3309:1874266701252480:0@lo:400:kworker.0 00000100:00100000:1.0:1787440309.668594:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee08032ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1874266701252992:0@lo:400:kworker.0 00000100:00100000:3.0:1787440309.671452:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701252736 00000100:00100000:3.0:1787440309.671464:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701252736 00000100:00100000:3.0:1787440309.671652:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1787440309.671662:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee047a7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874266701252736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440309.671755:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee047a7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874266701252736:12345-0@lo:400:kworker.0 Request processed in 94us (3397us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440309.671762:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1787440309.671978:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee08032d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3312:1874266701252736:0@lo:400:kworker.0 00000100:00080000:0.0:1787440309.675101:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787440309.868815:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:1.0:1787440309.869234:0:6892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681347712 00000100:00100000:1.0:1787440309.869245:0:6892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681347712 00000100:00100000:1.0:1787440309.869311:0:6892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 238 00000100:00100000:1.0:1787440309.869321:0:6892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee08090f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+18:11307:x1874266681347712:12345-192.168.206.58@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1787440309.869440:0:6892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee08090f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+18:11307:x1874266681347712:12345-192.168.206.58@tcp:60:lhsmtool_posix.0 Request processed in 120us (634us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440309.869449:0:6892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 238 00000100:00100000:1.0:1787440309.874280:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440309.874536:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681347968 00000100:00100000:0.0:1787440309.874546:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681347968 00000100:00100000:0.0:1787440309.874609:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 65 00000100:00100000:0.0:1787440309.874620:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee047a7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+18:11307:x1874266681347968:12345-192.168.206.58@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787440309.875191:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee047a7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+19:11307:x1874266681347968:12345-192.168.206.58@tcp:35:lhsmtool_posix.0 Request processed in 570us (916us total) trans 4294967521 rc 0/0 00000100:00100000:0.0:1787440309.875199:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 65 00000100:00100000:0.0:1787440310.048035:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:1.0:1787440310.048119:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681348096 00000100:00100000:1.0:1787440310.048131:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681348096 00000100:00080000:0.0:1787440310.048315:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787440310.048329:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 239 00000100:00100000:1.0:1787440310.048344:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee0800a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fde7b340-91f7-42a0-a1a3-5665ea2691c9+5:12105:x1874266681348096:12345-192.168.206.58@tcp:101:lsof.0 00010000:00010000:1.0:1787440310.048364:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440310.048382:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fa00/0x85f5fa77adf3d267 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fab14535dc624fd expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440310.048439:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e000/0x85f5fa77adf3d26e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440310.048452:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e000/0x85f5fa77adf3d26e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440310.048464:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e000/0x85f5fa77adf3d26e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787440310.048767:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787440310.048777:0:5850:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:1.0:1787440310.048861:0:5850:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e000/0x85f5fa77adf3d26e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440310.048899:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fa00/0x85f5fa77adf3d267 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc624fd expref: 7 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440310.048916:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e000/0x85f5fa77adf3d26e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc624fd expref: 6 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440310.048924:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ee054b3cb00) 00010000:00010000:1.0:1787440310.048927:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787440310.048930:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee07fb9e000, rc 0) 00000100:00100000:1.0:1787440310.049016:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee0800a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fde7b340-91f7-42a0-a1a3-5665ea2691c9+6:12105:x1874266681348096:12345-192.168.206.58@tcp:101:lsof.0 Request processed in 662us (980us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440310.049024:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 239 00000100:00100000:0.0:1787440310.172776:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee08090c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874266701253248:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787440310.172859:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440310.173028:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701253248 00000100:00100000:3.0:1787440310.173037:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701253248 00000100:00100000:3.0:1787440310.173103:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1787440310.173115:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee077ec3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874266701253248:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787440310.173153:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787440310.173219:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee077ec3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874266701253248:12345-0@lo:13:osp-pre-1-0.0 Request processed in 105us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440310.173228:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1787440310.173287:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee08090c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874266701253248:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787440310.364806:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787440311.389104:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787440311.786606:0:5871:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967521 is committed 00000020:00080000:0.0:1787440311.786634:0:5871:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:1.0:1787440311.786763:0:5882:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:1.0:1787440311.786783:0:5882:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:0.0:1787440312.415235:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787440313.404045:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440313.404102:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440313.404129:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440313.404153:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440313.404179:0:12016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681348480 00000100:00100000:3.0:1787440313.404188:0:12016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681348480 00000100:00100000:3.0:1787440313.404235:0:12016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681348608 00000100:00100000:3.0:1787440313.404238:0:12016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681348608 00000100:00100000:3.0:1787440313.404262:0:12016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 103 00000100:00100000:3.0:1787440313.404272:0:12016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee08090c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+5:2360:x1874266681348480:12345-192.168.206.58@tcp:400:kworker.0 00000100:00100000:3.0:1787440313.404338:0:12016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee08090c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+5:2360:x1874266681348480:12345-192.168.206.58@tcp:400:kworker.0 Request processed in 68us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440313.404346:0:12016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 103 00000100:00100000:3.0:1787440313.404362:0:12016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 104 00000100:00100000:3.0:1787440313.404369:0:12016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee080b44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+7:2360:x1874266681348608:12345-192.168.206.58@tcp:400:kworker.0 00000100:00100000:3.0:1787440313.404394:0:12016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee080b44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+7:2360:x1874266681348608:12345-192.168.206.58@tcp:400:kworker.0 Request processed in 26us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440313.404400:0:12016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 104 00000100:00100000:3.0:1787440313.404417:0:6892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681348352 00000100:00100000:3.0:1787440313.404420:0:6892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681348352 00000100:00100000:3.0:1787440313.404459:0:6892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 170 00000100:00100000:3.0:1787440313.404465:0:6892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee08090ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+18:2360:x1874266681348352:12345-192.168.206.58@tcp:400:kworker.0 00000100:00100000:3.0:1787440313.404513:0:6892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee08090ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+18:2360:x1874266681348352:12345-192.168.206.58@tcp:400:kworker.0 Request processed in 28us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440313.404519:0:6892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 170 00000100:00080000:3.0:1787440313.404532:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787440313.404536:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787440313.404544:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787440313.405293:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681348224 00000100:00100000:0.0:1787440313.405300:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681348224 00000100:00100000:0.0:1787440313.405333:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 304 00000100:00100000:0.0:1787440313.405340:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee06d272850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+13:2360:x1874266681348224:12345-192.168.206.58@tcp:400:kworker.0 00000100:00100000:0.0:1787440313.405388:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee06d272850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+13:2360:x1874266681348224:12345-192.168.206.58@tcp:400:kworker.0 Request processed in 48us (1349us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440313.405396:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 304 00000100:00100000:0.0:1787440313.415652:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440313.415907:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681348736 00000100:00100000:3.0:1787440313.415917:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681348736 00000100:00100000:3.0:1787440313.416004:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 171 00000100:00100000:3.0:1787440313.416014:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee047a23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fde7b340-91f7-42a0-a1a3-5665ea2691c9+6:2361:x1874266681348736:12345-192.168.206.58@tcp:400:kworker.0 00000100:00100000:3.0:1787440313.416085:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee047a23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fde7b340-91f7-42a0-a1a3-5665ea2691c9+6:2361:x1874266681348736:12345-192.168.206.58@tcp:400:kworker.0 Request processed in 72us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440313.416092:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 171 00000100:00080000:2.0:1787440313.416240:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:1.0:1787440313.433921:0:12763:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 19:11:52 (1787440312) 00010000:00010000:0.0:1787440313.440047:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787440313.756687:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee047a22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1874266701253376:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787440313.756752:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440313.756827:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701253376 00000100:00100000:1.0:1787440313.756964:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701253376 00000100:00100000:1.0:1787440313.757030:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787440313.757038:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee047a7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874266701253376:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787440313.757072:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787440313.757124:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee047a7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874266701253376:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440313.757130:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787440313.757176:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee047a22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1874266701253376:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787440313.758404:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787440314.462821:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787440314.781637:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee08032c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1874266701253760:0@lo:400:kworker.0 00000100:00100000:2.0:1787440314.781714:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440314.781725:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee08032d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:168176ea-29d1-49de-a254-317e90d54802:3309:1874266701253504:0@lo:400:kworker.0 00000100:00100000:2.0:1787440314.781771:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787440314.781777:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee08032dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874266701253888:0@lo:400:kworker.0 00000100:00100000:2.0:1787440314.781805:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440314.781838:0:9225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701253888 00000100:00100000:2.0:1787440314.781845:0:9225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701253888 00000100:00100000:2.0:1787440314.781889:0:9225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1787440314.781899:0:9225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee047a7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1874266701253888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787440314.781951:0:9225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee047a7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1874266701253888:12345-0@lo:400:kworker.0 Request processed in 55us (145us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440314.781959:0:9225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1787440314.782013:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee08032dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874266701253888:0@lo:400:kworker.0 00000100:00100000:2.0:1787440314.782057:0:6892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701253760 00000100:00100000:2.0:1787440314.782061:0:6892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701253760 00000100:00100000:2.0:1787440314.782095:0:6892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1787440314.782101:0:6892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee047a7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874266701253760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440314.782117:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440314.782151:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee08032f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1874266701254016:0@lo:400:kworker.0 00000100:00100000:3.0:1787440314.782174:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440314.782190:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787440314.782195:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee08032ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874266701253632:0@lo:400:kworker.0 00000100:00100000:3.0:1787440314.782212:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440314.782223:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee08032c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874266701254144:0@lo:400:kworker.0 00000100:00100000:3.0:1787440314.782244:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440314.782267:0:12016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701254144 00000100:00100000:3.0:1787440314.782271:0:12016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701254144 00000100:00100000:3.0:1787440314.782314:0:12016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1787440314.782320:0:12016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee0773fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3309:x1874266701254144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440314.782351:0:12016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee0773fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3309:x1874266701254144:12345-0@lo:400:kworker.0 Request processed in 32us (107us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440314.782357:0:12016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1787440314.782373:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701254016 00000100:00100000:3.0:1787440314.782375:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701254016 00000100:00100000:3.0:1787440314.782403:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701253632 00000100:00100000:3.0:1787440314.782407:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701253632 00000100:00100000:3.0:1787440314.782419:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1787440314.782425:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee080b45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1874266701254016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440314.782455:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee080b45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1874266701254016:12345-0@lo:400:kworker.0 Request processed in 30us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440314.782465:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1787440314.782478:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1787440314.782483:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee080b44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874266701253632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440314.782531:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee080b44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874266701253632:12345-0@lo:400:kworker.0 Request processed in 48us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440314.782537:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1787440314.782554:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701253504 00000100:00100000:3.0:1787440314.782557:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701253504 00000100:00100000:3.0:1787440314.782576:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:3.0:1787440314.782582:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee06d270450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:168176ea-29d1-49de-a254-317e90d54802+19:3309:x1874266701253504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440314.782614:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee06d270450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:168176ea-29d1-49de-a254-317e90d54802+19:3309:x1874266701253504:12345-0@lo:400:kworker.0 Request processed in 32us (498us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440314.782620:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:3.0:1787440314.782669:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee08032ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874266701253632:0@lo:400:kworker.0 00000100:00100000:3.0:1787440314.782685:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee08032c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874266701254144:0@lo:400:kworker.0 00000100:00100000:3.0:1787440314.782694:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee08032d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:168176ea-29d1-49de-a254-317e90d54802:3309:1874266701253504:0@lo:400:kworker.0 00000100:00100000:3.0:1787440314.782702:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee08032f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1874266701254016:0@lo:400:kworker.0 00000100:00100000:2.0:1787440314.783062:0:6892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee047a7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874266701253760:12345-0@lo:400:kworker.0 Request processed in 959us (1347us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440314.783077:0:6892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00080000:2.0:1787440314.783098:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787440314.783103:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787440314.785144:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee08032c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1874266701253760:0@lo:400:kworker.0 00000100:00100000:0.0:1787440315.292778:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee0773fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874266701254272:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787440315.292849:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440315.292994:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701254272 00000100:00100000:3.0:1787440315.293010:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701254272 00000100:00100000:3.0:1787440315.293073:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1787440315.293081:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee047a23100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874266701254272:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787440315.293115:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787440315.293158:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee047a23100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874266701254272:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440315.293165:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787440315.293472:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee0773fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874266701254272:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787440315.486275:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787440316.508948:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787440316.808866:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:2.0:1787440316.809595:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681348992 00000100:00100000:2.0:1787440316.809606:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681348992 00000100:00100000:2.0:1787440316.809689:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 66 00000100:00100000:2.0:1787440316.809701:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee0773fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+18:12326:x1874266681348992:12345-192.168.206.58@tcp:35:umount.0 00000100:00080000:0.0:1787440316.810012:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787440316.810257:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee0773fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+19:12326:x1874266681348992:12345-192.168.206.58@tcp:35:umount.0 Request processed in 556us (1396us total) trans 4294967522 rc 0/0 00000100:00100000:2.0:1787440316.810266:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 66 00000100:00100000:2.0:1787440316.814228:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440316.815694:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681349248 00000100:00100000:3.0:1787440316.815707:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681349248 00000100:00100000:3.0:1787440316.815830:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 67 00000100:00100000:3.0:1787440316.815841:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee047a79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+19:12326:x1874266681349248:12345-192.168.206.58@tcp:35:umount.0 00000100:00100000:3.0:1787440316.816207:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee047a79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+20:12326:x1874266681349248:12345-192.168.206.58@tcp:35:umount.0 Request processed in 367us (1989us total) trans 4294967523 rc 0/0 00000100:00100000:3.0:1787440316.816216:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 67 00000100:00100000:3.0:1787440316.830252:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440316.830311:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681349504 00000100:00100000:3.0:1787440316.830320:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681349504 00000100:00100000:3.0:1787440316.830368:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 68 00000100:00100000:3.0:1787440316.830378:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee079ba9050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+20:12326:x1874266681349504:12345-192.168.206.58@tcp:35:umount.0 00000100:00100000:2.0:1787440316.835166:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee079ba9050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+21:12326:x1874266681349504:12345-192.168.206.58@tcp:35:umount.0 Request processed in 4782us (4916us total) trans 4294967524 rc 0/0 00000100:00100000:2.0:1787440316.835179:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 68 00000100:00100000:0.0:1787440316.842825:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440316.843694:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681349760 00000100:00100000:3.0:1787440316.843820:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681349760 00000100:00100000:3.0:1787440316.843882:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 69 00000100:00100000:3.0:1787440316.843892:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee047a22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+21:12326:x1874266681349760:12345-192.168.206.58@tcp:35:umount.0 00000100:00100000:3.0:1787440316.844230:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee047a22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+22:12326:x1874266681349760:12345-192.168.206.58@tcp:35:umount.0 Request processed in 338us (1422us total) trans 4294967525 rc 0/0 00000100:00100000:3.0:1787440316.844238:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 69 00000100:00100000:0.0:1787440316.854367:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440316.854400:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440316.854415:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440316.854440:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440316.854468:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681350272 00000100:00100000:0.0:1787440316.854479:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681350272 00000100:00100000:3.0:1787440316.854526:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681350528 00000100:00100000:3.0:1787440316.854531:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681350528 00000100:00100000:0.0:1787440316.854557:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681350400 00000100:00100000:3.0:1787440316.854562:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 17 00000100:00100000:0.0:1787440316.854569:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681350400 00000100:00100000:3.0:1787440316.854574:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee07f9f1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+15:2362:x1874266681350272:12345-192.168.206.58@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1787440316.854596:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 18 00010000:00010000:3.0:1787440316.854600:0:6711:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1787440316.854605:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee07f9f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+15:2362:x1874266681350528:12345-192.168.206.58@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787440316.854615:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787440316.854620:0:6711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ee04cbcf000/0x85f5fa77adf3c2e6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62088 expref: 15 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440316.854628:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ee07f86ea00/0x85f5fa77adf3c4d0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62153 expref: 15 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440316.854636:0:6711:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787440316.854643:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787440316.854683:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee07f9f1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+13:2362:x1874266681350272:12345-192.168.206.58@tcp:103:ldlm_bl.0 Request processed in 110us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440316.854691:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 17 00000100:00100000:1.0:1787440316.854837:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 19 00000100:00100000:1.0:1787440316.854848:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee07f9f2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+13:2362:x1874266681350400:12345-192.168.206.58@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787440316.854858:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787440316.854868:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ee059185000/0x85f5fa77adf3c24c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62050 expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440316.854878:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787440316.854931:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee07f9f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+11:2362:x1874266681350528:12345-192.168.206.58@tcp:103:ldlm_bl.0 Request processed in 327us (529us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440316.854939:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 18 00000100:00100000:0.0:1787440316.854963:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681350144 00000100:00100000:0.0:1787440316.854966:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681350144 00000100:00100000:0.0:1787440316.855025:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 72 00000100:00100000:0.0:1787440316.855033:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee07f9f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+7:2359:x1874266681350144:12345-192.168.206.58@tcp:9:umount.0 00000020:00000080:0.0:1787440316.855055:0:6697:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x85f5fa77adf3c826 00000020:00010000:0.0:1787440316.855063:0:6697:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8ee0513b6000: total 0 00000100:00080000:0.0:1787440316.855068:0:6697:0:(import.c:65:import_set_state_nolock()) ffff8ee0513b5000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787440316.855111:0:6697:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000020:00010000:3.0:1787440316.855176:0:5838:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8ee0513b6000: total 0 00010000:00010000:3.0:1787440316.855216:0:5838:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8ee0513b6000, canceled 0 locks, left on hash table 2. 00010000:00010000:3.0:1787440316.855263:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000024ff31d3/0x85f5fa77adf3cbc2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62328 expref: 6 pid: 12016 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440316.855293:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000de97f61a/0x85f5fa77adf3d260 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc624f6 expref: 6 pid: 9225 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440316.855310:0:5838:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8ee0513b6000, canceled 2 locks, left on hash table 0. 00010000:00010000:3.0:1787440316.855320:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787440316.855322:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787440316.855324:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787440316.855371:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee07f9f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+2:2359:x1874266681350144:12345-192.168.206.58@tcp:9:umount.0 Request processed in 338us (928us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440316.855379:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 72 00000100:00080000:2.0:1787440316.857072:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787440316.861488:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee07f9f2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+10:2362:x1874266681350400:12345-192.168.206.58@tcp:103:ldlm_bl.0 Request processed in 6628us (7056us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440316.861519:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 19 00000100:00100000:1.0:1787440316.874273:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:1.0:1787440316.874323:0:12016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681350656 00000100:00100000:1.0:1787440316.874332:0:12016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681350656 00000100:00100000:1.0:1787440316.874396:0:12016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 73 00000100:00100000:1.0:1787440316.874408:0:12016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee047a7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+5:2359:x1874266681350656:12345-192.168.206.58@tcp:9:umount.0 00000020:00000080:1.0:1787440316.874434:0:12016:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x85f5fa77adf3c5be 00000100:00080000:1.0:1787440316.874444:0:12016:0:(import.c:65:import_set_state_nolock()) ffff8ee077eed800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787440316.874486:0:12016:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00010000:00010000:2.0:1787440316.874574:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787440316.874869:0:12016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee047a7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+2:2359:x1874266681350656:12345-192.168.206.58@tcp:9:umount.0 Request processed in 463us (605us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440316.874877:0:12016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 73 00000100:00080000:1.0:1787440316.874904:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:0.0:1787440316.884685:0:5871:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967522 is committed 00000001:00080000:0.0:1787440316.884703:0:5871:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967523 is committed 00000100:00100000:1.0:1787440316.893092:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440316.893179:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681351680 00000100:00100000:3.0:1787440316.893188:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681351680 00000100:00100000:3.0:1787440316.893314:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 240 00000100:00100000:3.0:1787440316.893325:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee047a7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+20:2359:x1874266681351680:12345-192.168.206.58@tcp:39:umount.0 00000020:00000080:3.0:1787440316.893371:0:5849:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x85f5fa77adf3c25a 00000020:00010000:3.0:1787440316.893391:0:5849:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8ee077fa6000: total 0 00000100:00080000:3.0:1787440316.893395:0:5849:0:(import.c:65:import_set_state_nolock()) ffff8ee077fa2000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787440316.893426:0:5849:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000020:00010000:1.0:1787440316.893889:0:5838:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8ee077fa6000: total 0 00010000:00010000:1.0:1787440316.893895:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787440316.893937:0:5838:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8ee077fa6000, canceled 0 locks, left on hash table 13. 00010000:00010000:1.0:1787440316.893980:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8ee0460cc100) 00010000:00010000:1.0:1787440316.893983:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1787440316.893993:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce800/0x85f5fa77adf3d24b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc624ef expref: 20 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440316.894013:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8ee0460ccf00) 00010000:00010000:1.0:1787440316.894015:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787440316.894019:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94a00/0x85f5fa77adf3c524 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62161 expref: 19 pid: 6892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440316.894038:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8ee050ca1b00) 00010000:00010000:1.0:1787440316.894041:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1787440316.894045:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94e00/0x85f5fa77adf3cbad lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62321 expref: 18 pid: 6892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440316.894056:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8ee0460ccd00) 00010000:00010000:1.0:1787440316.894058:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1787440316.894062:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95e00/0x85f5fa77adf3c594 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6217d expref: 17 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440316.894072:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8ee0460cc100) 00010000:00010000:1.0:1787440316.894074:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787440316.894078:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95a00/0x85f5fa77adf3d141 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc624a9 expref: 16 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440316.894107:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8ee0460ccd00) 00010000:00010000:1.0:1787440316.894109:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787440316.894113:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95000/0x85f5fa77adf3c881 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6224f expref: 15 pid: 6892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440316.894127:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8ee05132ea00) 00010000:00010000:1.0:1787440316.894130:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1787440316.894134:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e600/0x85f5fa77adf3cc40 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6234b expref: 14 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440316.894146:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8ee05132ea00) 00010000:00010000:1.0:1787440316.894148:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787440316.894152:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfe00/0x85f5fa77adf3cf1f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6241d expref: 13 pid: 6892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440316.894166:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8ee050ca1b00) 00010000:00010000:1.0:1787440316.894168:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787440316.894172:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86fe00/0x85f5fa77adf3caa3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc622db expref: 12 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440316.894184:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ee054b3cb00) 00010000:00010000:1.0:1787440316.894186:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787440316.894190:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86e600/0x85f5fa77adf3cc24 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62344 expref: 11 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440316.894201:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ee05132e100) 00010000:00010000:1.0:1787440316.894204:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440316.894214:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9f800/0x85f5fa77adf3c540 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62168 expref: 11 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440316.894229:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8ee050ca1b00) 00010000:00010000:1.0:1787440316.894231:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787440316.894234:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86f600/0x85f5fa77adf3cb83 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62313 expref: 8 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440316.894247:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8ee0460cc100) 00010000:00010000:1.0:1787440316.894249:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787440316.894252:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07f86ee00/0x85f5fa77adf3d221 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc624e1 expref: 7 pid: 6892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440316.894265:0:5838:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8ee077fa6000, canceled 13 locks, left on hash table 0. 00010000:00010000:1.0:1787440316.894276:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787440316.894278:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787440316.894280:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787440316.894412:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee047a7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:792563a7-4c22-4ac7-ac25-d49ef7fb41a8+5:2359:x1874266681351680:12345-192.168.206.58@tcp:39:umount.0 Request processed in 1087us (1327us total) trans 4294967526 rc 0/0 00000100:00100000:3.0:1787440316.894421:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 240 00010000:00010000:2.0:1787440317.535955:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787440317.788745:0:11682:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787440317.788755:0:11682:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787440317.789192:0:11682:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:0.0:1787440317.789199:0:11682:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787440318.530877:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:2.0:1787440318.530932:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:2.0:1787440318.530988:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681351936 00000100:00100000:2.0:1787440318.530998:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681351936 00000100:00100000:2.0:1787440318.531072:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 175 00000100:00100000:2.0:1787440318.531083:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee047a79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fde7b340-91f7-42a0-a1a3-5665ea2691c9+6:2361:x1874266681351936:12345-192.168.206.58@tcp:400:kworker.0 00000100:00100000:2.0:1787440318.531167:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee047a79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fde7b340-91f7-42a0-a1a3-5665ea2691c9+6:2361:x1874266681351936:12345-192.168.206.58@tcp:400:kworker.0 Request processed in 86us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440318.531182:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 175 00000100:00080000:1.0:1787440318.531631:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787440318.531911:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681351808 00000100:00100000:3.0:1787440318.531917:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681351808 00000100:00100000:3.0:1787440318.532041:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 306 00000100:00100000:3.0:1787440318.532051:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee06d273050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+10:2361:x1874266681351808:12345-192.168.206.58@tcp:400:kworker.0 00000100:00100000:3.0:1787440318.532111:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee06d273050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+10:2361:x1874266681351808:12345-192.168.206.58@tcp:400:kworker.0 Request processed in 62us (1243us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440318.532119:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 306 00010000:00010000:1.0:1787440318.556872:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787440318.876692:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787440318.876715:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee07f9f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874266701254400:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787440318.876782:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440318.876903:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701254400 00000100:00100000:3.0:1787440318.876910:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701254400 00000100:00100000:3.0:1787440318.876980:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1787440318.876999:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee047a7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874266701254400:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787440318.877030:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787440318.877076:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee047a7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874266701254400:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440318.877083:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1787440318.877137:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee07f9f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874266701254400:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787440318.877377:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787440319.007072:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:2.0:1787440319.007121:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:2.0:1787440319.007162:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440319.007273:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681352064 00000100:00100000:3.0:1787440319.007293:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681352064 00000100:00100000:3.0:1787440319.007355:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681352192 00000100:00100000:3.0:1787440319.007373:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681352192 00000100:00100000:3.0:1787440319.007393:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681352320 00000100:00100000:3.0:1787440319.007395:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681352320 00000100:00100000:3.0:1787440319.007412:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 20 00000100:00100000:3.0:1787440319.007421:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee047a79500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+12:2363:x1874266681352064:12345-192.168.206.58@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787440319.007436:0:6711:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787440319.007455:0:6711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ee059185c00/0x85f5fa77adf3c32c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6209d expref: 12 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440319.007472:0:6711:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787440319.007554:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee047a79500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+11:2363:x1874266681352064:12345-192.168.206.58@tcp:103:ldlm_bl.0 Request processed in 134us (491us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440319.007561:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 20 00000100:00100000:3.0:1787440319.007577:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 21 00000100:00100000:3.0:1787440319.007583:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee06e7e7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+10:2362:x1874266681352192:12345-192.168.206.58@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787440319.007591:0:6711:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787440319.007599:0:6711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ee059185200/0x85f5fa77adf3c333 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc620c7 expref: 10 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440319.007607:0:6711:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787440319.007621:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee06e7e7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+9:2362:x1874266681352192:12345-192.168.206.58@tcp:103:ldlm_bl.0 Request processed in 39us (500us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440319.007626:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 21 00000100:00100000:3.0:1787440319.007675:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 22 00000100:00100000:3.0:1787440319.007681:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee047a78a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+8:2362:x1874266681352320:12345-192.168.206.58@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787440319.007688:0:6711:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787440319.007696:0:6711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ee07fb9f400/0x85f5fa77adf3c4c9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6214c expref: 8 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440319.007711:0:6711:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787440319.007741:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee047a78a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+7:2362:x1874266681352320:12345-192.168.206.58@tcp:103:ldlm_bl.0 Request processed in 48us (568us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440319.007749:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 22 00000100:00100000:2.0:1787440319.021587:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440319.021676:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681352576 00000100:00100000:3.0:1787440319.021685:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681352576 00000100:00100000:3.0:1787440319.021743:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 241 00000100:00100000:3.0:1787440319.021754:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee047a79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fde7b340-91f7-42a0-a1a3-5665ea2691c9+6:2359:x1874266681352576:12345-192.168.206.58@tcp:39:umount.0 00000020:00000080:3.0:1787440319.021791:0:5849:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x85f5fa77adf3c341 00000020:00010000:3.0:1787440319.021801:0:5849:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8ee080782800: total 0 00000100:00080000:3.0:1787440319.021806:0:5849:0:(import.c:65:import_set_state_nolock()) ffff8ee080787000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787440319.021872:0:5849:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00100000:3.0:1787440319.022110:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee047a79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fde7b340-91f7-42a0-a1a3-5665ea2691c9+5:2359:x1874266681352576:12345-192.168.206.58@tcp:39:umount.0 Request processed in 358us (530us total) trans 4294967527 rc 0/0 00000100:00100000:3.0:1787440319.022118:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 241 00000020:00010000:2.0:1787440319.024841:0:5837:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8ee080782800: total 0 00010000:00010000:2.0:1787440319.024913:0:5837:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8ee080782800, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1787440319.024950:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ee054b3cb00) 00010000:00010000:2.0:1787440319.024954:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787440319.024978:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e000/0x85f5fa77adf3d26e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc624fd expref: 4 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440319.025005:0:5837:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8ee080782800, canceled 1 locks, left on hash table 0. 00010000:00010000:2.0:1787440319.025018:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787440319.025020:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787440319.025021:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787440319.050202:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440319.050810:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681352832 00000100:00100000:0.0:1787440319.050819:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681352832 00000100:00100000:0.0:1787440319.050878:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 307 00000100:00100000:0.0:1787440319.050887:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee06d272c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+7:2359:x1874266681352832:12345-192.168.206.58@tcp:251:umount.0 00000020:00000080:0.0:1787440319.050930:0:5843:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x85f5fa77adf3c237 00000020:00010000:0.0:1787440319.050938:0:5843:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8ee077fa7000: total 0 00000100:00080000:0.0:1787440319.050943:0:5843:0:(import.c:65:import_set_state_nolock()) ffff8ee077fa0000 : changing import state from FULL to CLOSED 00000020:00010000:1.0:1787440319.051014:0:5838:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8ee077fa7000: total 0 00010000:00010000:1.0:1787440319.051019:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787440319.051029:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee06d272c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfab787b-d66b-4cc5-abe4-b3c0f89e30e7+3:2359:x1874266681352832:12345-192.168.206.58@tcp:251:umount.0 Request processed in 142us (836us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440319.051038:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 307 00010000:00010000:1.0:1787440319.051062:0:5838:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8ee077fa7000, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1787440319.051097:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ee059184800/0x85f5fa77adf3c2ed lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6208f expref: 2 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440319.051115:0:5838:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8ee077fa7000, canceled 1 locks, left on hash table 0. 00000020:00000080:1.0:1787440319.051150:0:5838:0:(genops.c:885:class_export_put()) final put ffff8ee077fa7000/bfab787b-d66b-4cc5-abe4-b3c0f89e30e7 00010000:00010000:1.0:1787440319.051172:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787440319.051174:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787440319.051177:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787440319.051558:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8ee077fa7000/bfab787b-d66b-4cc5-abe4-b3c0f89e30e7 for MGS 00000020:00000080:0.0:1787440319.051598:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ee077fa0000 for MGS 00000001:00100000:0.0:1787440319.480156:0:6723:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 792563a7-4c22-4ac7-ac25-d49ef7fb41a8 00000020:00000080:0.0:1787440319.480164:0:6723:0:(genops.c:885:class_export_put()) final put ffff8ee077eeb800/792563a7-4c22-4ac7-ac25-d49ef7fb41a8 00000020:00000080:0.0:1787440319.480621:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8ee077eeb800/792563a7-4c22-4ac7-ac25-d49ef7fb41a8 for lustre-OST0000 00000020:00000080:0.0:1787440319.480674:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ee077eed800 for lustre-OST0000 00010000:00010000:2.0:1787440319.584036:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787440319.900981:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee050482300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:168176ea-29d1-49de-a254-317e90d54802:3309:1874266701254528:0@lo:400:kworker.0 00000100:00100000:2.0:1787440319.901011:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee08032c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1874266701254912:0@lo:400:kworker.0 00000100:00100000:0.0:1787440319.901065:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440319.901066:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440319.901387:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee077ec3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1874266701254784:0@lo:400:kworker.0 00000100:00100000:1.0:1787440319.901666:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee050483800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874266701254656:0@lo:400:kworker.0 00000100:00100000:0.0:1787440319.901953:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee08032f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1874266701255040:0@lo:400:kworker.0 00000100:00100000:2.0:1787440319.902008:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701254912 00000100:00100000:0.0:1787440319.902014:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440319.902018:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701254912 00000100:00100000:2.0:1787440319.902075:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1787440319.902086:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee08032c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1874266701254912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787440319.902153:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee08032c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1874266701254912:12345-0@lo:400:kworker.0 Request processed in 70us (1090us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440319.902160:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1787440319.902362:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440319.902402:0:6892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701255040 00000100:00100000:3.0:1787440319.902407:0:6892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701255040 00000100:00100000:2.0:1787440319.902452:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701254784 00000100:00100000:2.0:1787440319.902458:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701254784 00000100:00100000:0.0:1787440319.902557:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee08032c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1874266701254912:0@lo:400:kworker.0 00000100:00100000:2.0:1787440319.910613:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1787440319.910637:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee07f9f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1874266701255040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787440319.910754:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee07f9f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1874266701255040:12345-0@lo:400:kworker.0 Request processed in 128us (8740us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440319.910762:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1787440319.910810:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee08032f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1874266701255040:0@lo:400:kworker.0 00000100:00100000:2.0:1787440319.910845:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1787440319.910853:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee0773fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874266701254784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787440319.910895:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee0773fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874266701254784:12345-0@lo:400:kworker.0 Request processed in 43us (8534us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440319.911699:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00080000:2.0:1787440319.911763:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787440319.911804:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee077ec3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1874266701254784:0@lo:400:kworker.0 00000100:00100000:1.0:1787440319.914534:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701254528 00000100:00100000:1.0:1787440319.914548:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701254528 00000100:00100000:1.0:1787440319.914602:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:1.0:1787440319.914612:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee06d272050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:168176ea-29d1-49de-a254-317e90d54802+19:3309:x1874266701254528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440319.914696:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee06d272050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:168176ea-29d1-49de-a254-317e90d54802+19:3309:x1874266701254528:12345-0@lo:400:kworker.0 Request processed in 85us (13633us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440319.914703:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:1.0:1787440319.914780:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee050482300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:168176ea-29d1-49de-a254-317e90d54802:3309:1874266701254528:0@lo:400:kworker.0 00000100:00100000:1.0:1787440319.914830:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440319.914868:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee08032d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1874266701255168:0@lo:400:kworker.0 00000100:00100000:1.0:1787440319.914901:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440319.914937:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701255168 00000100:00100000:1.0:1787440319.914940:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701255168 00000100:00100000:1.0:1787440319.914996:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1787440319.915003:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee047a7f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1874266701255168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440319.915036:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee047a7f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1874266701255168:12345-0@lo:400:kworker.0 Request processed in 34us (134us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440319.915042:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00080000:1.0:1787440319.915062:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787440319.915083:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee08032d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1874266701255168:0@lo:400:kworker.0 00000100:00100000:2.0:1787440319.918031:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701254656 00000100:00100000:2.0:1787440319.918045:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701254656 00000100:00100000:2.0:1787440319.918106:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1787440319.918115:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee047a7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874266701254656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787440319.918203:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee047a7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874266701254656:12345-0@lo:400:kworker.0 Request processed in 90us (3373us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440319.918210:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1787440319.918248:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee050483800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874266701254656:0@lo:400:kworker.0 00000100:00100000:0.0:1787440320.416187:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787440320.416209:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee05fcdf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1874266701255296:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787440320.416279:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440320.416521:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701255296 00000100:00100000:3.0:1787440320.416528:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701255296 00000100:00100000:3.0:1787440320.416589:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1787440320.416599:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee07f9f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874266701255296:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787440320.416646:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787440320.416696:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee07f9f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874266701255296:12345-0@lo:13:osp-pre-1-0.0 Request processed in 99us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440320.416717:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1787440320.416872:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee05fcdf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1874266701255296:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787440320.604817:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1787440320.918434:0:12964:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:1.0:1787440320.930712:0:12964:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:1.0:1787440320.930757:0:12964:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.158@tcp lock: ffff8ee041665400/0x85f5fa77adf3c2bc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3c2c3 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440320.930772:0:12964:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.158@tcp lock: ffff8ee041665400/0x85f5fa77adf3c2bc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x85f5fa77adf3c2c3 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440320.930779:0:12964:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.158@tcp lock: ffff8ee041665400/0x85f5fa77adf3c2bc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x85f5fa77adf3c2c3 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440320.930786:0:12964:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.158@tcp lock: ffff8ee041665400/0x85f5fa77adf3c2bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x85f5fa77adf3c2c3 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440320.930803:0:12964:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1787440320.930808:0:12964:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1787440320.930833:0:12964:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787440320.930837:0:12964:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1787440320.930842:0:12964:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1787440320.930862:0:12964:0:(import.c:65:import_set_state_nolock()) ffff8ee0490da800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:3.0:1787440320.931122:0:5837:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787440320.931129:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.158@tcp lock: ffff8ee041665400/0x85f5fa77adf3c2bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x85f5fa77adf3c2c3 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440320.931137:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee041665400 already unused, calling callback (ffffffffc1bd2c20) 10000000:00010000:3.0:1787440320.931141:0:5837:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.158@tcp lock: ffff8ee041665400/0x85f5fa77adf3c2bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x85f5fa77adf3c2c3 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440320.931149:0:5837:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.158@tcp lock: ffff8ee041665400/0x85f5fa77adf3c2bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x85f5fa77adf3c2c3 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787440320.931156:0:5837:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.158@tcp lock: ffff8ee041665400/0x85f5fa77adf3c2bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x85f5fa77adf3c2c3 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787440320.931173:0:5837:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787440320.931176:0:5837:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1787440320.931178:0:5837:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1787440320.931204:0:5837:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.158@tcp lock: ffff8ee041665400/0x85f5fa77adf3c2bc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x85f5fa77adf3c2c3 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440320.931553:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee050483800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874266701255424:0@lo:39:umount.0 00000100:00100000:0.0:1787440320.931621:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440320.931710:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701255424 00000100:00100000:0.0:1787440320.931716:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701255424 00000100:00100000:0.0:1787440320.931755:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1787440320.931763:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee07f9f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874266701255424:12345-0@lo:39:umount.0 00000020:00000080:0.0:1787440320.931785:0:5851:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x85f5fa77adf3c046 00000100:00080000:0.0:1787440320.931792:0:5851:0:(import.c:65:import_set_state_nolock()) ffff8ee047a4f800 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1787440320.931846:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee07f9f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+1:3308:x1874266701255424:12345-0@lo:39:umount.0 Request processed in 83us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440320.931852:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000020:00000080:0.0:1787440320.931861:0:5851:0:(genops.c:885:class_export_put()) final put ffff8ee047a4a000/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:0.0:1787440320.931896:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787440320.931905:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8ee047a4a000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1787440320.931963:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ee047a4f800 for lustre-MDT0000 00000100:00080000:0.0:1787440320.931993:0:3308:0:(import.c:65:import_set_state_nolock()) ffff8ee0490da800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1787440320.932004:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee050483800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874266701255424:0@lo:39:umount.0 00010000:00010000:3.0:1787440320.933518:0:5837:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787440320.933550:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.158@tcp lock: ffff8ee041665400/0x85f5fa77adf3c2bc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x85f5fa77adf3c2c3 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440320.933561:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.158@tcp lock: ffff8ee041665400/0x85f5fa77adf3c2bc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x85f5fa77adf3c2c3 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440320.933578:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787440320.933580:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787440320.933593:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787440320.933608:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee05fcdf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:168176ea-29d1-49de-a254-317e90d54802:3312:1874266701255552:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787440320.933661:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440320.933715:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701255552 00000100:00100000:3.0:1787440320.933722:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701255552 00000100:00100000:3.0:1787440320.933764:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787440320.933771:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee079914380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:168176ea-29d1-49de-a254-317e90d54802+19:3312:x1874266701255552:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787440320.933783:0:6711:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787440320.933798:0:6711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ee059185600/0x85f5fa77adf3c2c3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x85f5fa77adf3c2bc expref: 19 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440320.933810:0:6711:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787440320.933841:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee079914380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:168176ea-29d1-49de-a254-317e90d54802+18:3312:x1874266701255552:12345-0@lo:103:ldlm_bl.0 Request processed in 71us (180us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440320.933848:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:1.0:1787440320.933854:0:12964:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787440320.933858:0:12964:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1787440320.933862:0:12964:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00100000:3.0:1787440320.933890:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee05fcdf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:168176ea-29d1-49de-a254-317e90d54802:3312:1874266701255552:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787440320.934939:0:12964:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.158@tcp lock: ffff8ee041665e00/0x85f5fa77adf3c2ca lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3c2d1 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440320.934963:0:12964:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.158@tcp lock: ffff8ee041665e00/0x85f5fa77adf3c2ca lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x85f5fa77adf3c2d1 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440320.934984:0:12964:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.158@tcp lock: ffff8ee041665e00/0x85f5fa77adf3c2ca lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x85f5fa77adf3c2d1 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440320.934990:0:12964:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.158@tcp lock: ffff8ee041665e00/0x85f5fa77adf3c2ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x85f5fa77adf3c2d1 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440320.935013:0:12964:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787440320.935019:0:12964:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.158@tcp lock: ffff8ee07f86f800/0x85f5fa77adf3c1f1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3c1f8 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440320.935025:0:12964:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.158@tcp lock: ffff8ee07f86f800/0x85f5fa77adf3c1f1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x85f5fa77adf3c1f8 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440320.935030:0:12964:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.158@tcp lock: ffff8ee07f86f800/0x85f5fa77adf3c1f1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x85f5fa77adf3c1f8 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440320.935036:0:12964:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.158@tcp lock: ffff8ee07f86f800/0x85f5fa77adf3c1f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x85f5fa77adf3c1f8 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440320.935046:0:12964:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1787440320.935051:0:12964:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.158@tcp lock: ffff8ee04cbcea00/0x85f5fa77adf3c4f3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3c4fa expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440320.935057:0:12964:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.158@tcp lock: ffff8ee04cbcea00/0x85f5fa77adf3c4f3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x85f5fa77adf3c4fa expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440320.935063:0:12964:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.158@tcp lock: ffff8ee04cbcea00/0x85f5fa77adf3c4f3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x85f5fa77adf3c4fa expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440320.935079:0:12964:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.158@tcp lock: ffff8ee04cbcea00/0x85f5fa77adf3c4f3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x85f5fa77adf3c4fa expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440320.935086:0:12964:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1787440320.935091:0:12964:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.158@tcp lock: ffff8ee082162600/0x85f5fa77adf3bfa5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3bfac expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440320.935368:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787440320.935375:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.158@tcp lock: ffff8ee041665e00/0x85f5fa77adf3c2ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x85f5fa77adf3c2d1 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440320.935383:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee041665e00 already unused, calling callback (ffffffffc1bd2c20) 10000000:00010000:2.0:1787440320.935387:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.158@tcp lock: ffff8ee041665e00/0x85f5fa77adf3c2ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x85f5fa77adf3c2d1 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440320.935434:0:12964:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.158@tcp lock: ffff8ee082162600/0x85f5fa77adf3bfa5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x85f5fa77adf3bfac expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440320.935444:0:12964:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.158@tcp lock: ffff8ee082162600/0x85f5fa77adf3bfa5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x85f5fa77adf3bfac expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440320.935450:0:12964:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.158@tcp lock: ffff8ee082162600/0x85f5fa77adf3bfa5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x85f5fa77adf3bfac expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440320.935459:0:12964:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 10000000:01000000:1.0:1787440320.935462:0:12964:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00010000:00010000:2.0:1787440320.935464:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.158@tcp lock: ffff8ee041665e00/0x85f5fa77adf3c2ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x85f5fa77adf3c2d1 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787440320.935471:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.158@tcp lock: ffff8ee041665e00/0x85f5fa77adf3c2ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x85f5fa77adf3c2d1 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787440320.935476:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787440320.935478:0:5838:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:01000000:2.0:1787440320.935480:0:5838:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00000020:01000004:1.0:1787440320.935486:0:12964:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:1.0:1787440320.935490:0:12964:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:1.0:1787440320.935522:0:12964:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00010000:00010000:2.0:1787440320.935527:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.158@tcp lock: ffff8ee041665e00/0x85f5fa77adf3c2ca lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x85f5fa77adf3c2d1 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1787440320.935527:0:12964:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/9 00010000:00010000:2.0:1787440320.935533:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000020:00080000:1.0:1787440320.935534:0:12964:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8edf411a7800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787440320.935538:0:12964:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8ee06e416800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787440320.935544:0:12964:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff8ee080782800 fde7b340-91f7-42a0-a1a3-5665ea2691c9 192.168.206.58@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787440320.935549:0:12964:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff8ee077fa6000 792563a7-4c22-4ac7-ac25-d49ef7fb41a8 192.168.206.58@tcp 4 (0 4 0) 1 0 0 0: 0000000000000000 4294967523 stale:0 00010000:00010000:2.0:1787440320.935551:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.158@tcp lock: ffff8ee041665e00/0x85f5fa77adf3c2ca lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x85f5fa77adf3c2d1 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1787440320.935555:0:12964:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff8ee050488000) has exports, disconnecting them 00010000:00010000:2.0:1787440320.935558:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.158@tcp lock: ffff8ee041665e00/0x85f5fa77adf3c2ca lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x85f5fa77adf3c2d1 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1787440320.935563:0:12964:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8edf411a7800), last request at 1787440319 00000020:00000080:1.0:1787440320.935569:0:12964:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x85f5fa77adf3c1b9 00010000:00010000:2.0:1787440320.935570:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787440320.935573:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.158@tcp lock: ffff8ee07f86f800/0x85f5fa77adf3c1f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x85f5fa77adf3c1f8 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440320.935578:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee07f86f800 already unused, calling callback (ffffffffc1bd2c20) 10000000:00010000:2.0:1787440320.935581:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.158@tcp lock: ffff8ee07f86f800/0x85f5fa77adf3c1f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x85f5fa77adf3c1f8 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1787440320.935583:0:12964:0:(import.c:65:import_set_state_nolock()) ffff8edf411a6800 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1787440320.935587:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.158@tcp lock: ffff8ee07f86f800/0x85f5fa77adf3c1f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x85f5fa77adf3c1f8 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787440320.935601:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.158@tcp lock: ffff8ee07f86f800/0x85f5fa77adf3c1f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x85f5fa77adf3c1f8 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787440320.935606:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1787440320.935608:0:5838:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:2.0:1787440320.935610:0:5838:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00000020:00080000:1.0:1787440320.935617:0:12964:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8edf411a7800): rc 0 00000020:00000080:1.0:1787440320.935620:0:12964:0:(genops.c:885:class_export_put()) final put ffff8edf411a7800/lustre-MDT0000-lwp-OST0001_UUID 00010000:00010000:2.0:1787440320.935622:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.158@tcp lock: ffff8ee07f86f800/0x85f5fa77adf3c1f1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x85f5fa77adf3c1f8 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440320.935627:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000020:00080000:1.0:1787440320.935629:0:12964:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8ee06e416800), last request at 1787440319 00000020:00000080:1.0:1787440320.935633:0:12964:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x85f5fa77adf3c0ee 00000100:00080000:1.0:1787440320.935638:0:12964:0:(import.c:65:import_set_state_nolock()) ffff8ee06e410800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1787440320.935644:0:12964:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8ee06e416800): rc 0 00000020:00000080:1.0:1787440320.935646:0:12964:0:(genops.c:885:class_export_put()) final put ffff8ee06e416800/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:1.0:1787440320.935652:0:12964:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffba960109fae0 00000100:00080000:1.0:1787440320.935669:0:12964:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1787440320.935672:0:12964:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:1.0:1787440320.935684:0:12964:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1787440320.935740:0:12964:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1787440320.935753:0:12964:0:(import.c:65:import_set_state_nolock()) ffff8ee08001f000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1787440320.935764:0:12964:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1787440320.935766:0:12964:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000004:00080000:1.0:1787440320.935774:0:12964:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1787440320.935828:0:12964:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1787440320.935837:0:12964:0:(import.c:65:import_set_state_nolock()) ffff8ee04ca43000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:1.0:1787440320.935862:0:12964:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff8ee050488000) has no exports 00010000:00010000:3.0:1787440320.936079:0:5837:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787440320.936356:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.158@tcp lock: ffff8ee07f86f800/0x85f5fa77adf3c1f1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x85f5fa77adf3c1f8 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440320.936364:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.158@tcp lock: ffff8ee07f86f800/0x85f5fa77adf3c1f1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x85f5fa77adf3c1f8 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1787440320.936365:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8edf411a7800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00010000:00010000:2.0:1787440320.936377:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787440320.936380:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.158@tcp lock: ffff8ee082162600/0x85f5fa77adf3bfa5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x85f5fa77adf3bfac expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440320.936385:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee082162600 already unused, calling callback (ffffffffc1bd2c20) 10000000:00010000:2.0:1787440320.936388:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.158@tcp lock: ffff8ee082162600/0x85f5fa77adf3bfa5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x85f5fa77adf3bfac expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1787440320.936397:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8ee06e416800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1787440320.936416:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8edf411a6800 for lustre-MDT0000 00000020:00000080:0.0:1787440320.936420:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ee06e410800 for lustre-MDT0000 00000100:00100000:0.0:1787440320.936439:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee050482300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1874266701255936:0@lo:9:umount.0 00010000:00010000:2.0:1787440320.936464:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.158@tcp lock: ffff8ee082162600/0x85f5fa77adf3bfa5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x85f5fa77adf3bfac expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787440320.936470:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.158@tcp lock: ffff8ee082162600/0x85f5fa77adf3bfa5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x85f5fa77adf3bfac expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787440320.936484:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1787440320.936486:0:5838:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:2.0:1787440320.936488:0:5838:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00000100:00100000:0.0:1787440320.936513:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787440320.936519:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.158@tcp lock: ffff8ee082162600/0x85f5fa77adf3bfa5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x85f5fa77adf3bfac expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440320.936525:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787440320.936537:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.158@tcp lock: ffff8ee082162600/0x85f5fa77adf3bfa5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x85f5fa77adf3bfac expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440320.936541:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee050483800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1874266701256064:0@lo:9:umount.0 00010000:00010000:2.0:1787440320.936544:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.158@tcp lock: ffff8ee082162600/0x85f5fa77adf3bfa5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x85f5fa77adf3bfac expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440320.936555:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787440320.936556:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787440320.936558:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787440320.936562:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440320.936569:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee08032f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:168176ea-29d1-49de-a254-317e90d54802:3309:1874266701255680:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787440320.936598:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440320.936842:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701255936 00000100:00100000:0.0:1787440320.936849:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701255936 00000100:00100000:2.0:1787440320.937000:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787440320.937012:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee08032ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:168176ea-29d1-49de-a254-317e90d54802:3309:1874266701255808:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787440320.937039:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440320.937075:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701255680 00000100:00100000:2.0:1787440320.937079:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701255680 00000100:00100000:2.0:1787440320.937112:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701255808 00000100:00100000:2.0:1787440320.937116:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701255808 00000100:00100000:2.0:1787440320.937137:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787440320.937144:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee08032d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:168176ea-29d1-49de-a254-317e90d54802+19:3309:x1874266701255680:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787440320.937156:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787440320.937288:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ee059185a00/0x85f5fa77adf3c2d1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x85f5fa77adf3c2ca expref: 19 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440320.937468:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787440320.937670:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701256064 00000100:00100000:0.0:1787440320.937674:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701256064 00000100:00100000:0.0:1787440320.937705:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787440320.937712:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee07f9f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1874266701255936:12345-0@lo:9:umount.0 00000020:00000080:0.0:1787440320.937733:0:6698:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x85f5fa77adf3c149 00000100:00080000:0.0:1787440320.937741:0:6698:0:(import.c:65:import_set_state_nolock()) ffff8ee08001c800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787440320.937768:0:6698:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:0.0:1787440320.938077:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee07f9f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3308:x1874266701255936:12345-0@lo:9:umount.0 Request processed in 365us (1563us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440320.938084:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787440320.938160:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787440320.938167:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee07f9f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1874266701256064:12345-0@lo:9:umount.0 00000020:00000080:0.0:1787440320.938180:0:6698:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x85f5fa77adf3c222 00000100:00080000:0.0:1787440320.938186:0:6698:0:(import.c:65:import_set_state_nolock()) ffff8ee077fa0800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787440320.938199:0:6698:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:0.0:1787440320.938357:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee07f9f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3308:x1874266701256064:12345-0@lo:9:umount.0 Request processed in 190us (1793us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440320.938363:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:1.0:1787440320.938561:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787440320.938563:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee08032d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:168176ea-29d1-49de-a254-317e90d54802+18:3309:x1874266701255680:12345-0@lo:103:ldlm_bl.0 Request processed in 1248us (1793us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440320.938572:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787440320.938588:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787440320.938595:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee08032c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:168176ea-29d1-49de-a254-317e90d54802+17:3309:x1874266701255808:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787440320.938605:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787440320.938618:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ee041665c00/0x85f5fa77adf3c1f8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x85f5fa77adf3c1f1 expref: 17 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440320.938747:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787440320.938775:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee08032c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:168176ea-29d1-49de-a254-317e90d54802+16:3309:x1874266701255808:12345-0@lo:103:ldlm_bl.0 Request processed in 181us (1735us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440320.938781:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787440320.938820:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee08032ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:168176ea-29d1-49de-a254-317e90d54802:3309:1874266701255808:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787440320.938830:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee08032f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:168176ea-29d1-49de-a254-317e90d54802:3309:1874266701255680:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787440320.938850:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787440320.938936:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee08032dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:168176ea-29d1-49de-a254-317e90d54802:3311:1874266701256192:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787440320.938982:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440320.939027:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701256192 00000100:00100000:3.0:1787440320.939031:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701256192 00000100:00100000:3.0:1787440320.939065:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787440320.939072:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee05fcdf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:168176ea-29d1-49de-a254-317e90d54802+16:3311:x1874266701256192:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787440320.939079:0:6711:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787440320.939087:0:6711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ee059185800/0x85f5fa77adf3bfac lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x85f5fa77adf3bfa5 expref: 16 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440320.939112:0:6711:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787440320.939140:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee05fcdf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:168176ea-29d1-49de-a254-317e90d54802+15:3311:x1874266701256192:12345-0@lo:103:ldlm_bl.0 Request processed in 68us (157us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440320.939146:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787440320.939790:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee08032dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:168176ea-29d1-49de-a254-317e90d54802:3311:1874266701256192:0@lo:103:ldlm_bl.0 00000100:00080000:0.0:1787440320.940265:0:3308:0:(import.c:65:import_set_state_nolock()) ffff8ee08001f000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1787440320.940285:0:3308:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1787440320.940288:0:3308:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787440320.940457:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee050482300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1874266701255936:0@lo:9:umount.0 00000100:00080000:0.0:1787440320.940476:0:3308:0:(import.c:65:import_set_state_nolock()) ffff8ee04ca43000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1787440320.940666:0:3308:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1787440320.940820:0:3308:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787440320.940825:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee050483800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1874266701256064:0@lo:9:umount.0 00010000:00010000:1.0:1787440320.940925:0:12965:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787440320.940929:0:12965:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787440320.940931:0:12965:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787440320.940971:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.158@tcp lock: ffff8ee04cbcea00/0x85f5fa77adf3c4f3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x85f5fa77adf3c4fa expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440320.940981:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee04cbcea00 already unused, calling callback (ffffffffc1bd2c20) 10000000:00010000:2.0:1787440320.940986:0:5837:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.158@tcp lock: ffff8ee04cbcea00/0x85f5fa77adf3c4f3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x85f5fa77adf3c4fa expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440320.940999:0:5837:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.158@tcp lock: ffff8ee04cbcea00/0x85f5fa77adf3c4f3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x85f5fa77adf3c4fa expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787440320.941018:0:5837:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.158@tcp lock: ffff8ee04cbcea00/0x85f5fa77adf3c4f3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x85f5fa77adf3c4fa expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787440320.941024:0:5837:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1787440320.941026:0:5837:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1787440320.941030:0:5837:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1787440320.941059:0:5837:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.158@tcp lock: ffff8ee04cbcea00/0x85f5fa77adf3c4f3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x85f5fa77adf3c4fa expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440320.941066:0:5837:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1787440320.941210:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee08032f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:168176ea-29d1-49de-a254-317e90d54802:3312:1874266701256320:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787440320.941331:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440320.941379:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701256320 00000100:00100000:0.0:1787440320.941385:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701256320 00010000:00010000:2.0:1787440320.941400:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.158@tcp lock: ffff8ee04cbcea00/0x85f5fa77adf3c4f3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x85f5fa77adf3c4fa expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440320.941407:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.158@tcp lock: ffff8ee04cbcea00/0x85f5fa77adf3c4f3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x85f5fa77adf3c4fa expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440320.941419:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787440320.941421:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787440320.941423:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787440320.941432:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787440320.941439:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee0776b8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:168176ea-29d1-49de-a254-317e90d54802+15:3312:x1874266701256320:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787440320.941457:0:6711:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787440320.941470:0:6711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ee07fb9fc00/0x85f5fa77adf3c4fa lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x85f5fa77adf3c4f3 expref: 15 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440320.941480:0:6711:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787440320.941535:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee0776b8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:168176ea-29d1-49de-a254-317e90d54802+14:3312:x1874266701256320:12345-0@lo:103:ldlm_bl.0 Request processed in 96us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440320.941541:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787440320.941643:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee08032f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:168176ea-29d1-49de-a254-317e90d54802:3312:1874266701256320:0@lo:103:ldlm_bl.0 00000020:00080000:1.0:1787440320.943735:0:12964:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff8ee050488000) has no exports 00000020:00000080:1.0:1787440320.991464:0:12964:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x85f5fa77adf3c000 00000020:00000080:1.0:1787440320.991480:0:12964:0:(genops.c:885:class_export_put()) final put ffff8ee04a7f5000/lustre-QMT0000_UUID 00000020:01000000:1.0:1787440320.991639:0:12964:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:2.0:1787440320.991707:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8ee04a7f5000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:0.0:1787440320.991749:0:12964:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787440320.991759:0:12964:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1787440320.991768:0:12964:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff8ee07c2c0000) has no exports 00000020:00000080:0.0:1787440320.992045:0:12964:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x85f5fa77adf3bff9 00000020:00000080:0.0:1787440320.992051:0:12964:0:(genops.c:885:class_export_put()) final put ffff8ee07c2d7800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1787440320.992114:0:12964:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787440320.992121:0:12964:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1787440320.992123:0:12964:0:(genops.c:885:class_export_put()) final put ffff8ee079ae6800/lustre-QMT0000_UUID 00000020:00000080:0.0:1787440320.992125:0:12964:0:(genops.c:844:class_export_destroy()) destroying export ffff8ee079ae6800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:0.0:1787440320.992132:0:12964:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:2.0:1787440320.992358:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8ee07c2d7800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:2.0:1787440321.631074:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1787440322.020273:0:5871:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967524 is committed 00000001:00100000:3.0:1787440322.020285:0:5871:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of fde7b340-91f7-42a0-a1a3-5665ea2691c9 00000001:00080000:3.0:1787440322.020291:0:5871:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967527 is committed 00000020:00000080:3.0:1787440322.020293:0:5871:0:(genops.c:885:class_export_put()) final put ffff8ee080782800/fde7b340-91f7-42a0-a1a3-5665ea2691c9 00000001:00100000:3.0:1787440322.020306:0:5871:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 792563a7-4c22-4ac7-ac25-d49ef7fb41a8 00000001:00080000:3.0:1787440322.020310:0:5871:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:3.0:1787440322.020313:0:5871:0:(genops.c:885:class_export_put()) final put ffff8ee077fa6000/792563a7-4c22-4ac7-ac25-d49ef7fb41a8 00000020:00000080:3.0:1787440322.020323:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8ee080782800/fde7b340-91f7-42a0-a1a3-5665ea2691c9 for lustre-MDT0000 00000020:00000080:3.0:1787440322.020365:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8ee077fa6000/792563a7-4c22-4ac7-ac25-d49ef7fb41a8 for lustre-MDT0000 00000020:00000080:3.0:1787440322.020396:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ee080787000 for lustre-MDT0000 00000020:00000080:3.0:1787440322.020400:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ee077fa2000 for lustre-MDT0000 00000001:00100000:0.0:1787440322.038923:0:7640:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787440322.038931:0:7640:0:(genops.c:885:class_export_put()) final put ffff8ee077fa3000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1787440322.038960:0:7640:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 792563a7-4c22-4ac7-ac25-d49ef7fb41a8 00000020:00000080:0.0:1787440322.038963:0:7640:0:(genops.c:885:class_export_put()) final put ffff8ee0513b6000/792563a7-4c22-4ac7-ac25-d49ef7fb41a8 00000020:00000080:3.0:1787440322.040253:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8ee077fa3000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1787440322.040300:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8ee0513b6000/792563a7-4c22-4ac7-ac25-d49ef7fb41a8 for lustre-OST0001 00000020:00000080:3.0:1787440322.040318:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ee077fa0800 for lustre-OST0001 00000020:00000080:3.0:1787440322.040322:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ee0513b5000 for lustre-OST0001 00010000:00010000:1.0:1787440322.654807:0:12965:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1787440323.037002:0:12964:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8ee077857000 - data ffff8ee06e3a1510/ffff8ee08068bc00 00000020:01000000:0.0:1787440323.037161:0:12964:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8ee045e25540 - data ffff8ee06e031bd0/ffff8ee077b76400 00000001:00000004:0.0:1787440323.043029:0:12964:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967527 00000100:00080000:1.0:1787440323.134623:0:12964:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1787440323.134631:0:12964:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:1.0:1787440323.134718:0:12964:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787440323.134721:0:12964:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1787440323.136574:0:6890:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1787440323.136580:0:6890:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 5 count 1 00000040:00080000:2.0:1787440323.136590:0:6890:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:1.0:1787440323.137489:0:12964:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1787440323.137677:0:12964:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:1.0:1787440323.137692:0:12964:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787440323.137695:0:12964:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1787440323.137919:0:8006:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1787440323.137922:0:8006:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 8 count 1 00000040:00080000:2.0:1787440323.137931:0:8006:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:2.0:1787440323.182362:0:12964:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x85f5fa77adf3bfc8 00000020:00000080:2.0:1787440323.182374:0:12964:0:(genops.c:885:class_export_put()) final put ffff8ee080c3c800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1787440323.182438:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8ee080c3c800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1787440323.190572:0:12964:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x85f5fa77adf3bfdd 00000020:00000080:2.0:1787440323.190588:0:12964:0:(genops.c:885:class_export_put()) final put ffff8ee06d8d8800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1787440323.190612:0:12964:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:2.0:1787440323.190621:0:12964:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787440323.190630:0:12964:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1787440323.190634:0:12964:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff8ee05048cd28) has no exports 00000020:00000080:3.0:1787440323.190787:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8ee06d8d8800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000004:01000000:2.0:1787440323.191608:0:12964:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1787440323.191620:0:12964:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x85f5fa77adf3c21b 00000020:00000080:2.0:1787440323.191625:0:12964:0:(genops.c:885:class_export_put()) final put ffff8ee077843800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1787440323.191644:0:12964:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:2.0:1787440323.191649:0:12964:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787440323.191709:0:12964:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1787440323.191714:0:12964:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff8ee080064d28) has no exports 00000020:00000080:2.0:1787440323.191720:0:12964:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x85f5fa77adf3c214 00000020:00000080:2.0:1787440323.191793:0:12964:0:(genops.c:885:class_export_put()) final put ffff8ee04ca45800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1787440323.192475:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8ee077843800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1787440323.192488:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8ee04ca45800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1787440323.192541:0:12964:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:2.0:1787440323.192545:0:12964:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1787440323.192549:0:12964:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:2.0:1787440323.192554:0:12964:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787440323.192557:0:12964:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787440323.192599:0:12964:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787440323.192608:0:12964:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787440323.192614:0:12964:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x85f5fa77adf3c134 00000020:00000080:2.0:1787440323.192619:0:12964:0:(genops.c:885:class_export_put()) final put ffff8ee080019800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1787440323.192623:0:12964:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:2.0:1787440323.192627:0:12964:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787440323.192630:0:12964:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1787440323.192633:0:12964:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff8ee0800619b8) has no exports 00000020:00000080:2.0:1787440323.192637:0:12964:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x85f5fa77adf3c12d 00000020:00000080:2.0:1787440323.192640:0:12964:0:(genops.c:885:class_export_put()) final put ffff8ee08001f800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1787440323.193036:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ee04ca43000 for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1787440323.193044:0:36:0:(genops.c:885:class_export_put()) final put ffff8ee04ca44800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787440323.193047:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8ee04ca44800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:3.0:1787440323.193051:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787440323.193117:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8ee080019800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1787440323.193124:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8ee08001f800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:3.0:1787440323.193595:0:12964:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:3.0:1787440323.193599:0:12964:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1787440323.193602:0:12964:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:3.0:1787440323.193607:0:12964:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787440323.193609:0:12964:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787440323.193663:0:12964:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787440323.193672:0:12964:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787440323.193701:0:12964:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787440323.193704:0:12964:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787440323.193709:0:12964:0:(genops.c:885:class_export_put()) final put ffff8ee080c39000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787440323.193711:0:12964:0:(genops.c:844:class_export_destroy()) destroying export ffff8ee080c39000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:3.0:1787440323.193716:0:12964:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787440323.193841:0:12964:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x85f5fa77adf3bfe4 00000020:00000080:3.0:1787440323.193848:0:12964:0:(genops.c:885:class_export_put()) final put ffff8ee06d8db000/lustre-MDD0000_UUID 00000020:01000000:3.0:1787440323.193852:0:12964:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:3.0:1787440323.193856:0:12964:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787440323.193859:0:12964:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1787440323.193862:0:12964:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff8ee05048b370) has no exports 00000020:00000080:3.0:1787440323.193880:0:12964:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787440323.193883:0:12964:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:3.0:1787440323.193897:0:12964:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x85f5fa77adf3bfeb 00000020:00000080:3.0:1787440323.193906:0:12964:0:(genops.c:885:class_export_put()) final put ffff8ee06d8de000/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1787440323.193917:0:12964:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8ee045f41000 from lustre-MDT0000, refs=3 00000020:01000004:3.0:1787440323.193920:0:12964:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8ee045f41000 3 00000020:01000004:3.0:1787440323.193922:0:12964:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8ee045f41000 from lustre-MDT0000 00000020:00000080:3.0:1787440323.193949:0:12964:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787440323.193953:0:12964:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:3.0:1787440323.193955:0:12964:0:(genops.c:885:class_export_put()) final put ffff8ee080c39800/lustre-MDT0000_UUID 00000020:00000080:3.0:1787440323.193957:0:12964:0:(genops.c:844:class_export_destroy()) destroying export ffff8ee080c39800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:3.0:1787440323.193963:0:12964:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:3.0:1787440323.193988:0:12964:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:3.0:1787440323.193992:0:12964:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:3.0:1787440323.193994:0:12964:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:3.0:1787440323.193997:0:12964:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787440323.193999:0:12964:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1787440323.194004:0:12964:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff8ee04a7da000 168176ea-29d1-49de-a254-317e90d54802 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787440323.194008:0:12964:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff8ee045f7cd28) has exports, disconnecting them 00000020:00080000:3.0:1787440323.194012:0:12964:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff8ee04a7da000), last request at 1787440092 00000020:00000080:3.0:1787440323.194024:0:12964:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x85f5fa77adf3bf89 00000020:00010000:3.0:1787440323.194027:0:12964:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8ee04a7da000: total 2 00000100:00080000:3.0:1787440323.194031:0:12964:0:(import.c:65:import_set_state_nolock()) ffff8ee04a7dc000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1787440323.194052:0:12964:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8ee04a7da000): rc 0 00000020:00080000:3.0:1787440323.194056:0:12964:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff8ee045f7cd28) has no exports 00000100:00100000:3.0:1787440323.194105:0:5844:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff8ee051ad0a00:5844] 2 exiting: rc = 0 00000100:00100000:3.0:1787440323.194179:0:5842:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff8ee051ad0600:5842] 0 exiting: rc = 1 00000100:00100000:1.0:1787440323.194266:0:5843:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff8ee051ad0400:5843] 1 exiting: rc = 0 00000020:00010000:2.0:1787440323.194317:0:5837:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8ee04a7da000: total 2 00010000:00010000:2.0:1787440323.194353:0:5837:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8ee04a7da000, canceled 0 locks, left on hash table 8. 00000020:00000080:1.0:1787440323.194472:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ee08001f000 for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1787440323.194477:0:36:0:(genops.c:885:class_export_put()) final put ffff8ee0490df800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787440323.194479:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8ee0490df800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:1.0:1787440323.194484:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787440323.194583:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8ee06d8db000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1787440323.194587:0:36:0:(genops.c:885:class_export_put()) final put ffff8ee080c3d800/lustre-MDD0000_UUID 00000020:00000080:1.0:1787440323.194588:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8ee080c3d800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1787440323.194591:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:1.0:1787440323.194716:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8ee06d8de000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000100:00100000:3.0:1787440323.194791:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.194799:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.194805:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.194811:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.194817:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.194822:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.194827:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.194840:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.194845:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.194851:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.194857:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.194862:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.194868:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.194874:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.194879:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.194884:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.194889:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.194895:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.194901:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.194908:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.194914:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.194920:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.194925:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.194931:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.194936:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.194953:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.194959:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.194968:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.194974:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.194979:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.194984:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.194989:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.194994:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.194999:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.195004:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.195009:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.195015:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.195020:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.195025:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.195030:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.195035:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.195040:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.195052:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.195058:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.195063:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.195068:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.195073:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.195079:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.195084:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.195089:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.195094:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.195098:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.195104:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.195110:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.195115:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.195120:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.195125:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.195130:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.195135:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.195140:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.195146:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.195152:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.195157:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.195162:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:3.0:1787440323.195544:0:12964:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1787440323.195548:0:12964:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00010000:00010000:2.0:1787440323.196472:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ee041664400/0x85f5fa77adf3c28b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x85f5fa77adf3c284 expref: 9 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440323.196530:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ee04cbcf800/0x85f5fa77adf3c299 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x85f5fa77adf3c292 expref: 8 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440323.196541:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ee041664000/0x85f5fa77adf3c2a7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x85f5fa77adf3c2a0 expref: 7 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440323.196551:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ee059184600/0x85f5fa77adf3c2b5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x85f5fa77adf3c2ae expref: 6 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440323.196562:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ee04cbce400/0x85f5fa77adf3c4de lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x85f5fa77adf3c4d7 expref: 5 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440323.196571:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ee07fb9e200/0x85f5fa77adf3c4ec lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x85f5fa77adf3c4e5 expref: 4 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440323.196584:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ee059184c00/0x85f5fa77adf3c0a1 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x85f5fa77adf3c09a expref: 3 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440323.196595:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ee041664e00/0x85f5fa77adf3c2df lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x85f5fa77adf3c2d8 expref: 2 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440323.196605:0:5837:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8ee04a7da000, canceled 8 locks, left on hash table 0. 00000020:00000080:2.0:1787440323.196641:0:5837:0:(genops.c:885:class_export_put()) final put ffff8ee04a7da000/168176ea-29d1-49de-a254-317e90d54802 00010000:00010000:2.0:1787440323.196656:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787440323.196659:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787440323.196661:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787440323.198147:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8ee04a7da000/168176ea-29d1-49de-a254-317e90d54802 for MGS 00000020:00000080:1.0:1787440323.198258:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ee04a7dc000 for MGS 00000020:01000000:3.0:1787440323.202028:0:12964:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8ee077857d20 - data ffff8ee051f24000/ffff8ee08068b400 00000020:01000000:3.0:1787440323.202217:0:12964:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8ee045f0f840 - data ffff8ee06ffed288/ffff8ee0504a3800 00000020:00000080:3.0:1787440323.202857:0:12964:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x85f5fa77adf3bf6d 00000020:00000080:3.0:1787440323.202864:0:12964:0:(genops.c:885:class_export_put()) final put ffff8ee06e40d800/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1787440323.202914:0:12964:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8ee045f41000 from MGS, refs=2 00000020:01000004:3.0:1787440323.202918:0:12964:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8ee045f41000 2 00000020:01000004:3.0:1787440323.202921:0:12964:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8ee045f41000 from MGS 00000020:00000080:3.0:1787440323.202951:0:12964:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787440323.202958:0:12964:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:3.0:1787440323.202960:0:12964:0:(genops.c:885:class_export_put()) final put ffff8ee06e40e800/MGS 00000020:00000080:3.0:1787440323.202962:0:12964:0:(genops.c:844:class_export_destroy()) destroying export ffff8ee06e40e800/MGS for MGS 00000020:01000000:3.0:1787440323.202977:0:12964:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:3.0:1787440323.203059:0:12964:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:3.0:1787440323.203064:0:12964:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787440323.203070:0:12964:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1787440323.203076:0:12964:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff8ee0490d8800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787440323.203082:0:12964:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff8ee07c2c3370) has exports, disconnecting them 00000020:00080000:3.0:1787440323.203087:0:12964:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff8ee0490d8800), last request at 1787440093 00000020:00000080:3.0:1787440323.203090:0:12964:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x85f5fa77adf3c038 00000020:00080000:3.0:1787440323.203103:0:12964:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8ee0490d8800): rc 0 00000020:00000080:3.0:1787440323.203107:0:12964:0:(genops.c:885:class_export_put()) final put ffff8ee0490d8800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1787440323.203148:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8ee06e40d800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1787440323.204345:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8ee0490d8800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:3.0:1787440323.211846:0:12964:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:3.0:1787440323.211855:0:12964:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787440323.211859:0:12964:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1787440323.211866:0:12964:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787440323.212117:0:12964:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787440323.212127:0:12964:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:3.0:1787440323.212136:0:12964:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8ee045f41000 1 00000020:00000080:3.0:1787440323.212143:0:12964:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x85f5fa77adf3bf5f 00000020:00000080:3.0:1787440323.212152:0:12964:0:(genops.c:885:class_export_put()) final put ffff8ee06e408000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1787440323.212299:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ee0490da800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1787440323.212306:0:36:0:(genops.c:885:class_export_put()) final put ffff8ee07c2d1800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1787440323.212310:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8ee07c2d1800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:1.0:1787440323.212316:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000000:3.0:1787440323.212858:0:12964:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:3.0:1787440323.212866:0:12964:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787440323.212871:0:12964:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1787440323.212875:0:12964:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff8ee045f799b8) has no exports 00000020:00000080:1.0:1787440323.212979:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8ee06e408000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1787440323.277324:0:12964:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787440323.277338:0:12964:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:3.0:1787440323.277344:0:12964:0:(genops.c:885:class_export_put()) final put ffff8ee06e40b000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1787440323.277348:0:12964:0:(genops.c:844:class_export_destroy()) destroying export ffff8ee06e40b000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:3.0:1787440323.277358:0:12964:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:3.0:1787440323.277480:0:12964:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8ee045f42800 00000020:01000000:3.0:1787440323.277526:0:12964:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:3.0:1787440323.277540:0:12964:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787440323.277546:0:12964:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1787440323.277550:0:12964:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff8ee0504899b8) has no exports 00000100:00100000:0.0:1787440323.280394:0:5849:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff8ee04cbda000:5849] 0 exiting: rc = 1 00000100:00100000:0.0:1787440323.280574:0:5851:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff8ee04cbdba00:5851] 2 exiting: rc = 0 00000100:00100000:0.0:1787440323.280645:0:5850:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff8ee04cbdbe00:5850] 1 exiting: rc = 0 00000100:00100000:3.0:1787440323.281914:0:6892:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff8edf418f4a00:6892] 3 exiting: rc = 0 00000100:00100000:1.0:1787440323.282004:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787440323.282079:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787440323.282092:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787440323.282103:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787440323.282114:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787440323.282122:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787440323.282132:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787440323.282143:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787440323.282154:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787440323.282163:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787440323.282173:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787440323.282185:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787440323.282771:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787440323.282780:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787440323.282786:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787440323.282792:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787440323.282797:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787440323.282803:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787440323.282808:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787440323.282813:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787440323.282819:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787440323.282825:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787440323.282830:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787440323.282836:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787440323.282841:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787440323.282846:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787440323.282852:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787440323.282857:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787440323.282863:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787440323.282868:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787440323.282873:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787440323.282879:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787440323.282884:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787440323.282890:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787440323.282895:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787440323.282901:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787440323.282915:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787440323.282921:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787440323.282927:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787440323.282932:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787440323.282949:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787440323.282956:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787440323.282962:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787440323.282967:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787440323.282972:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787440323.282978:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787440323.282985:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787440323.282993:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787440323.282998:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787440323.283004:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787440323.283022:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787440323.283028:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787440323.283034:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787440323.283040:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787440323.283045:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787440323.283051:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787440323.283056:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787440323.283061:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787440323.283067:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787440323.283073:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787440323.283079:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787440323.283084:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787440323.283090:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787440323.283095:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.297134:0:5852:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff8ee04cbdae00:5852] 0 exiting: rc = 1 00000100:00100000:2.0:1787440323.297832:0:5853:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff8ee04c923400:5853] 1 exiting: rc = 0 00000100:00100000:1.0:1787440323.297996:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787440323.298092:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787440323.298102:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787440323.298108:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787440323.298113:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787440323.298118:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787440323.298123:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787440323.298139:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787440323.298144:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787440323.298149:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787440323.298155:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787440323.298160:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787440323.298167:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787440323.298171:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787440323.298176:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787440323.298181:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787440323.298185:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787440323.298259:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787440323.298267:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787440323.298272:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787440323.298276:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787440323.298282:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787440323.298287:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787440323.298292:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787440323.298297:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787440323.298302:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787440323.298306:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787440323.298311:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787440323.298317:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787440323.298323:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787440323.298328:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787440323.298334:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787440323.298339:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787440323.298344:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787440323.298349:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787440323.298354:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787440323.298359:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787440323.298364:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787440323.298370:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787440323.298374:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787440323.298379:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787440323.298384:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787440323.298397:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787440323.298402:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787440323.298406:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787440323.298411:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787440323.298416:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787440323.298420:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787440323.298425:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787440323.298430:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787440323.298434:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787440323.298439:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787440323.298443:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787440323.298448:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787440323.298452:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787440323.298457:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787440323.298461:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787440323.298466:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787440323.298471:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787440323.298477:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787440323.298482:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787440323.298487:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787440323.298509:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787440323.298516:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440323.303474:0:5854:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff8ee05047f000:5854] 0 exiting: rc = 1 00000100:00100000:3.0:1787440323.306732:0:5855:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff8ee05047e200:5855] 1 exiting: rc = 0 00000100:00100000:1.0:1787440323.307145:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787440323.307157:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787440323.307162:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787440323.307168:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787440323.307173:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787440323.307179:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787440323.307184:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787440323.307702:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787440323.307712:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787440323.307718:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787440323.307723:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787440323.307743:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787440323.307750:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787440323.307764:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787440323.307770:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787440323.307779:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787440323.307784:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787440323.307791:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787440323.307797:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787440323.307803:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787440323.307809:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787440323.307815:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787440323.307821:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787440323.307838:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787440323.307844:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787440323.307849:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787440323.307854:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787440323.307859:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787440323.307864:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787440323.307869:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787440323.307874:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787440323.307880:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787440323.307886:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787440323.307890:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787440323.307896:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787440323.308105:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787440323.308112:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787440323.308118:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787440323.308127:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787440323.308133:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787440323.308138:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787440323.308143:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787440323.308148:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787440323.308153:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787440323.308159:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787440323.308164:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787440323.308169:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787440323.308186:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787440323.308288:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787440323.308293:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787440323.308298:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787440323.308304:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787440323.308309:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787440323.308313:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787440323.308319:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787440323.308325:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787440323.308330:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787440323.308335:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787440323.308340:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787440323.308359:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787440323.308365:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787440323.308371:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787440323.308376:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787440323.308383:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.326958:0:5856:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff8ee05047e600:5856] 0 exiting: rc = 1 00000100:00100000:2.0:1787440323.326958:0:5857:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff8ee05047e400:5857] 1 exiting: rc = 0 00000100:00100000:2.0:1787440323.328000:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440323.328115:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440323.328122:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440323.328126:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440323.328131:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440323.328136:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440323.328141:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440323.328145:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440323.328150:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440323.328154:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440323.328158:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440323.328163:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440323.328167:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440323.328172:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440323.328177:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440323.328181:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440323.328187:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440323.328317:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440323.328324:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440323.328329:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440323.328334:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440323.328339:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440323.328343:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440323.328348:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440323.328353:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440323.328357:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440323.328362:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440323.328367:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440323.328372:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440323.328377:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440323.328382:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440323.328388:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440323.328393:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440323.328398:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440323.328418:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440323.328423:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440323.328428:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440323.328433:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440323.328437:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440323.328442:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440323.328447:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440323.328452:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440323.328458:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440323.328463:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440323.328468:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440323.328473:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440323.328478:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440323.328483:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440323.328488:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440323.328555:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440323.328561:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440323.328566:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440323.328570:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440323.328575:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440323.328580:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440323.328584:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440323.328589:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440323.328594:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440323.328598:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440323.328603:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440323.328607:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440323.328612:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440323.328617:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440323.328622:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.329784:0:5858:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff8ee050440800:5858] 0 exiting: rc = 1 00000100:00100000:2.0:1787440323.330391:0:5859:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff8ee050440000:5859] 1 exiting: rc = 0 00000100:00100000:3.0:1787440323.330659:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.330666:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.330671:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.330676:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.330681:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.330686:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.330691:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.330696:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.330701:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.330706:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.330712:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.330717:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.330722:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.330727:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.330732:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.330737:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.330742:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.330747:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.330752:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.330756:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.330761:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.330765:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.330770:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.330775:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.330780:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.330790:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.330806:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.330814:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.330819:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.330828:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.330834:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.330839:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.330844:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.330849:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.330854:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.330860:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.330865:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.330870:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.330875:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.330880:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.330885:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.330890:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.330895:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.330901:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.330906:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.330911:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.330917:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.330922:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.330927:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.330932:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.330949:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.330955:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.330970:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.330976:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.330981:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.330986:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.330991:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.330996:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.331001:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.331015:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.331021:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.331035:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.331039:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.331044:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.331384:0:5861:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff8ee050440c00:5861] 1 exiting: rc = 0 00000100:00100000:2.0:1787440323.332127:0:5860:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff8ee050441a00:5860] 0 exiting: rc = 1 00000100:00100000:3.0:1787440323.332389:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.332395:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.332400:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.332405:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.332410:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.332416:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.332421:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.332426:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.332431:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.332436:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.332442:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.332447:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.332452:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.332457:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.332462:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.332468:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.332473:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.332478:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.332483:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.332488:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.332570:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.332576:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.332580:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.332585:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.332590:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.332595:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.332600:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.332605:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.332610:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.332615:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.332620:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.332637:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.332642:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.332647:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.332652:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.332717:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.332725:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.332730:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.332736:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.332742:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.332747:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.332752:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.332757:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.332762:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.332767:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.332772:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.332778:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.332783:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.332787:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.332792:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.332798:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.332802:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.332807:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.332813:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.332818:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.332824:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.332828:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.332834:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.332839:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.332844:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.332849:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.332853:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.332858:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.332864:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440323.333635:0:5862:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff8ee05041ce00:5862] 0 exiting: rc = 1 00000100:00100000:3.0:1787440323.334680:0:5864:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff8ee05e9d3e00:5864] 2 exiting: rc = 0 00000100:00100000:1.0:1787440323.335293:0:5863:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff8ee05e9d2000:5863] 1 exiting: rc = 0 00000100:00100000:3.0:1787440323.335907:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.335926:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.335932:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.335948:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.335954:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.335959:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.335965:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.335971:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.335994:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.336002:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.336016:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.336023:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.336028:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.336033:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.336040:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.336046:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.336052:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.336057:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.336062:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.336068:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.336073:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.336078:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.336300:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.336308:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.336317:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.336322:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.336328:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.336333:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.336338:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.336343:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.336349:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.336354:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.336375:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.336381:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.336386:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.336391:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.336402:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.336406:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.336411:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.336417:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.336423:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.336429:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.336434:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.336439:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.336445:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.336450:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.336456:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.336461:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.336466:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.336471:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.336476:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.336482:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.336486:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.336511:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.336517:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.336522:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.336540:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.336545:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.336551:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.336556:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.336562:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.336567:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.336572:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787440323.336578:0:12964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1787440323.346135:0:12964:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787440323.346147:0:12964:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:2.0:1787440323.346162:0:12964:0:(genops.c:885:class_export_put()) final put ffff8ee04a7f3000/MDS_uuid 00000020:00000080:2.0:1787440323.346166:0:12964:0:(genops.c:844:class_export_destroy()) destroying export ffff8ee04a7f3000/MDS_uuid for MDS 00000020:01000000:2.0:1787440323.346174:0:12964:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:2.0:1787440323.346664:0:12964:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:2.0:1787440323.677306:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787440324.598538:0:6723:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787440324.598555:0:6723:0:(genops.c:885:class_export_put()) final put ffff8ee08001e800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787440324.598629:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8ee08001e800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1787440324.598678:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ee08001c800 for lustre-OST0000 00010000:00010000:1.0:1787440324.703982:0:12965:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787440325.023947:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee0776b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3310:1874266701256576:0@lo:400:kworker.0 00000400:00000100:3.0:1787440325.024000:0:3310:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874266701256576 offset 0 length 224: 4 00000100:00100000:3.0:1787440325.024049:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787440325.024055:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee0776b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:168176ea-29d1-49de-a254-317e90d54802:3310:1874266701256448:0@lo:400:kworker.0 00000400:00000100:3.0:1787440325.024074:0:3310:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874266701256448 offset 0 length 224: 4 00000100:00100000:3.0:1787440325.024114:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee0776b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1874266701256704:0@lo:400:kworker.0 00000400:00000100:3.0:1787440325.024133:0:3311:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874266701256704 offset 0 length 224: 4 00010000:00010000:2.0:1787440325.724672:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1787440326.284799:0:13117:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:0.0:1787440326.304976:0:13117:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:0.0:1787440326.305018:0:13117:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.158@tcp lock: ffff8ee059184400/0x85f5fa77adf3c2a0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3c2a7 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440326.305031:0:13117:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.158@tcp lock: ffff8ee059184400/0x85f5fa77adf3c2a0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x85f5fa77adf3c2a7 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440326.305039:0:13117:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.158@tcp lock: ffff8ee059184400/0x85f5fa77adf3c2a0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x85f5fa77adf3c2a7 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440326.305047:0:13117:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.158@tcp lock: ffff8ee059184400/0x85f5fa77adf3c2a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x85f5fa77adf3c2a7 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440326.305072:0:13117:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1787440326.305077:0:13117:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1787440326.305103:0:13117:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787440326.305114:0:13117:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8ee0776b8a80 x1874266701256576/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787440341 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787440326.305134:0:13117:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1787440326.305140:0:13117:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1787440326.305162:0:13117:0:(import.c:65:import_set_state_nolock()) ffff8ee079ae7800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1787440326.305188:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee07f9f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3308:1874266701256832:0@lo:39:umount.0 00000400:00000100:0.0:1787440326.305238:0:3308:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874266701256832 offset 0 length 224: 4 00010000:00010000:1.0:1787440326.305351:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787440326.305358:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.158@tcp lock: ffff8ee059184400/0x85f5fa77adf3c2a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x85f5fa77adf3c2a7 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440326.305366:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee059184400 already unused, calling callback (ffffffffc1bd2c20) 10000000:00010000:1.0:1787440326.305370:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.158@tcp lock: ffff8ee059184400/0x85f5fa77adf3c2a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x85f5fa77adf3c2a7 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440326.305379:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.158@tcp lock: ffff8ee059184400/0x85f5fa77adf3c2a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x85f5fa77adf3c2a7 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787440326.305387:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.158@tcp lock: ffff8ee059184400/0x85f5fa77adf3c2a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x85f5fa77adf3c2a7 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787440326.305411:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787440326.305413:0:5838:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1787440326.305416:0:5838:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1787440326.305441:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.158@tcp lock: ffff8ee059184400/0x85f5fa77adf3c2a0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x85f5fa77adf3c2a7 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440326.305448:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787440326.305476:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.158@tcp lock: ffff8ee059184400/0x85f5fa77adf3c2a0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x85f5fa77adf3c2a7 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440326.305484:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.158@tcp lock: ffff8ee059184400/0x85f5fa77adf3c2a0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x85f5fa77adf3c2a7 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440326.305520:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787440326.305522:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787440326.305524:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787440326.305535:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787440326.305545:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee050480380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:168176ea-29d1-49de-a254-317e90d54802:3311:1874266701256960:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787440326.305584:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440326.305622:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701256960 00000100:00100000:1.0:1787440326.305628:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701256960 00000100:00100000:1.0:1787440326.305662:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787440326.305669:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04919f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3311:x1874266701256960:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1787440326.305675:0:5834:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787440326 with bad export cookie 9652896768265011081 00000100:00100000:3.0:1787440326.308408:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee0776b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3310:1874266701256576:0@lo:400:kworker.0 00000100:00100000:0.0:1787440326.327050:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04919f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3311:x1874266701256960:12345-0@lo:103:ldlm_bl.0 Request processed in 21371us (21456us total) trans 0 rc -107/-107 00000100:00100000:0.0:1787440326.327063:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:1.0:1787440326.327273:0:3311:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.206.158@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1787440326.327278:0:3311:0:(import.c:65:import_set_state_nolock()) ffff8ee04a7ee800 MGS: changing import state from FULL to DISCONN 00000100:02020000:1.0:1787440326.327282:0:3311:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.206.158@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:1.0:1787440326.335156:0:3311:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.206.158@tcp not replayable, auto-deactivating 00000100:00080000:1.0:1787440326.335177:0:3311:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1787440326.335186:0:3311:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8ee0776b8700 x1874266701256448/t0(0) o400->MGC192.168.206.158@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1787440341 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787440326.335261:0:3311:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8ee050480380 x1874266701256960/t0(0) o103->MGC192.168.206.158@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787440342 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1787440326.335271:0:3311:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1787440326.335274:0:3311:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1787440326.335275:0:3311:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1787440326.335279:0:3311:0:(import.c:65:import_set_state_nolock()) ffff8ee04a7ee800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787440326.335283:0:3311:0:(import.c:510:import_select_connection()) MGC192.168.206.158@tcp: connect to NID 0@lo last attempt 190 00000100:00080000:1.0:1787440326.335291:0:3311:0:(import.c:624:import_select_connection()) MGC192.168.206.158@tcp: import ffff8ee04a7ee800 using connection 192.168.206.158@tcp/0@lo 00000100:00100000:0.0:1787440326.335377:0:3311:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ee07f9f0700 x1874266701257088/t0(0) o250->MGC192.168.206.158@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787440326.335429:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee050480380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:168176ea-29d1-49de-a254-317e90d54802:3311:1874266701256960:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787440326.335614:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee07f9f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:168176ea-29d1-49de-a254-317e90d54802:3308:1874266701257088:0@lo:250:ptlrpcd_00_02.0 00000400:00000100:1.0:1787440326.335673:0:3308:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874266701257088 offset 0 length 520: 4 00000100:00100000:2.0:1787440326.336119:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee0776b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:168176ea-29d1-49de-a254-317e90d54802:3310:1874266701256448:0@lo:400:kworker.0 00010000:00010000:1.0:1787440326.749728:0:12965:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787440327.772940:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787440328.799170:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787440329.822086:0:12965:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787440330.140739:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 168176ea-29d1-49de-a254-317e90d54802->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787440330.140748:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 168176ea-29d1-49de-a254-317e90d54802->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787440330.140969:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787440330.140989:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee050481c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3310:1874266701257216:0@lo:400:kworker.0 00000400:00000100:2.0:1787440330.141041:0:3310:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874266701257216 offset 0 length 224: 4 00010000:00010000:2.0:1787440330.860922:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787440331.164771:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 168176ea-29d1-49de-a254-317e90d54802->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787440331.164780:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 168176ea-29d1-49de-a254-317e90d54802->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787440331.166755:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787440331.166790:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee050480e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1874266701257344:0@lo:400:kworker.0 00000400:00000100:0.0:1787440331.166865:0:3309:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874266701257344 offset 0 length 224: 4 00010000:00010000:1.0:1787440331.868719:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787440332.898802:0:12965:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787440333.918082:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787440334.941428:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787440335.970791:0:12965:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787440336.284763:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 168176ea-29d1-49de-a254-317e90d54802->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787440336.284781:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 168176ea-29d1-49de-a254-317e90d54802->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787440336.284939:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee050481880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1874266701257472:0@lo:400:kworker.0 00000400:00000100:3.0:1787440336.284990:0:3311:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874266701257472 offset 0 length 224: 4 00000100:00100000:0.0:1787440336.796624:0:3308:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787440326/real 1787440326] req@ffff8ee07f9f0700 x1874266701257088/t0(0) o250->MGC192.168.206.158@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787440336 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787440336.796657:0:3308:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8ee07f9f0700 x1874266701257088/t0(0) o250->MGC192.168.206.158@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787440336 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787440336.796669:0:3308:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787440326/real 1787440326] req@ffff8ee07f9f1f80 x1874266701256832/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787440336 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787440336.796684:0:3308:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8ee07f9f1f80 x1874266701256832/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787440336 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787440336.796701:0:3308:0:(import.c:65:import_set_state_nolock()) ffff8ee04a7ee800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787440336.796720:0:3308:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:0.0:1787440336.796724:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee07f9f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:168176ea-29d1-49de-a254-317e90d54802:3308:1874266701257088:0@lo:250:ptlrpcd_00_02.0 00000100:00080000:0.0:1787440336.796730:0:3308:0:(import.c:65:import_set_state_nolock()) ffff8ee079ae7800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1787440336.796743:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee07f9f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3308:1874266701256832:0@lo:39:umount.0 00000100:00080000:2.0:1787440336.796926:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 168176ea-29d1-49de-a254-317e90d54802->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787440336.796931:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1787440336.797058:0:37:0:(import.c:65:import_set_state_nolock()) ffff8ee04a7ee800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787440336.797063:0:37:0:(import.c:510:import_select_connection()) MGC192.168.206.158@tcp: connect to NID 0@lo last attempt 424 00000100:00080000:2.0:1787440336.797067:0:37:0:(import.c:589:import_select_connection()) MGC192.168.206.158@tcp: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1787440336.797074:0:37:0:(import.c:624:import_select_connection()) MGC192.168.206.158@tcp: import ffff8ee04a7ee800 using connection 192.168.206.158@tcp/0@lo 00000100:00100000:2.0:1787440336.797104:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ee08032ea00 x1874266701257600/t0(0) o250->MGC192.168.206.158@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787440336.797157:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee08032ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:168176ea-29d1-49de-a254-317e90d54802:3308:1874266701257600:0@lo:250:kworker.0 00000400:00000100:0.0:1787440336.797201:0:3308:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874266701257600 offset 0 length 520: 4 00000100:00100000:2.0:1787440336.797350:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787440336.797360:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee08032d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1874266701257728:0@lo:400:kworker.0 00000400:00000100:2.0:1787440336.797383:0:3311:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874266701257728 offset 0 length 224: 4 00000100:00080000:3.0:1787440336.797527:0:13117:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787440336.797532:0:13117:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1787440336.797536:0:13117:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1787440336.798436:0:13117:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.158@tcp lock: ffff8ee07f86e000/0x85f5fa77adf3c2ae lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3c2b5 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440336.798451:0:13117:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.158@tcp lock: ffff8ee07f86e000/0x85f5fa77adf3c2ae lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x85f5fa77adf3c2b5 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440336.798459:0:13117:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.158@tcp lock: ffff8ee07f86e000/0x85f5fa77adf3c2ae lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x85f5fa77adf3c2b5 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440336.798465:0:13117:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.158@tcp lock: ffff8ee07f86e000/0x85f5fa77adf3c2ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x85f5fa77adf3c2b5 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440336.798523:0:13117:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787440336.798531:0:13117:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.158@tcp lock: ffff8ee07f86f200/0x85f5fa77adf3c4e5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3c4ec expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440336.798538:0:13117:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.158@tcp lock: ffff8ee07f86f200/0x85f5fa77adf3c4e5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x85f5fa77adf3c4ec expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440336.798566:0:13117:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.158@tcp lock: ffff8ee07f86f200/0x85f5fa77adf3c4e5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x85f5fa77adf3c4ec expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440336.798571:0:13117:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.158@tcp lock: ffff8ee07f86f200/0x85f5fa77adf3c4e5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x85f5fa77adf3c4ec expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440336.798584:0:13117:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1787440336.798588:0:13117:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:3.0:1787440336.798610:0:13117:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:3.0:1787440336.798614:0:13117:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:3.0:1787440336.798618:0:13117:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787440336.798623:0:13117:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1787440336.798626:0:13117:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff8ee07c2c19b8) has no exports 00000020:00080000:3.0:1787440336.798647:0:13117:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff8ee07c2c19b8) has no exports 00010000:00010000:1.0:1787440336.800414:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787440336.800439:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.158@tcp lock: ffff8ee07f86e000/0x85f5fa77adf3c2ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x85f5fa77adf3c2b5 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440336.800449:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee07f86e000 already unused, calling callback (ffffffffc1bd2c20) 10000000:00010000:1.0:1787440336.800454:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.158@tcp lock: ffff8ee07f86e000/0x85f5fa77adf3c2ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x85f5fa77adf3c2b5 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440336.800463:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.158@tcp lock: ffff8ee07f86e000/0x85f5fa77adf3c2ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x85f5fa77adf3c2b5 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787440336.800469:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.158@tcp lock: ffff8ee07f86e000/0x85f5fa77adf3c2ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x85f5fa77adf3c2b5 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787440336.800474:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787440336.800477:0:5838:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:1.0:1787440336.800480:0:5838:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:1.0:1787440336.800513:0:5838:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8ee04a7ee800 00010000:00010000:1.0:1787440336.800517:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.158@tcp lock: ffff8ee07f86e000/0x85f5fa77adf3c2ae lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x85f5fa77adf3c2b5 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440336.800524:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.158@tcp lock: ffff8ee07f86e000/0x85f5fa77adf3c2ae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x85f5fa77adf3c2b5 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440336.800538:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787440336.800541:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.158@tcp lock: ffff8ee07f86f200/0x85f5fa77adf3c4e5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x85f5fa77adf3c4ec expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440336.800547:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee07f86f200 already unused, calling callback (ffffffffc1bd2c20) 10000000:00010000:1.0:1787440336.800549:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.158@tcp lock: ffff8ee07f86f200/0x85f5fa77adf3c4e5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x85f5fa77adf3c4ec expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440336.800567:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.158@tcp lock: ffff8ee07f86f200/0x85f5fa77adf3c4e5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x85f5fa77adf3c4ec expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787440336.800573:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.158@tcp lock: ffff8ee07f86f200/0x85f5fa77adf3c4e5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x85f5fa77adf3c4ec expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787440336.800578:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1787440336.800580:0:5838:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1787440336.800582:0:5838:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1787440336.800588:0:5838:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8ee04a7ee800 00010000:00010000:1.0:1787440336.800590:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.158@tcp lock: ffff8ee07f86f200/0x85f5fa77adf3c4e5 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x85f5fa77adf3c4ec expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440336.800596:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.158@tcp lock: ffff8ee07f86f200/0x85f5fa77adf3c4e5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x85f5fa77adf3c4ec expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440336.800605:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787440336.800607:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787440336.800609:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787440336.800942:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1787440336.801159:0:13117:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8ee0778573c0 - data ffff8ee07fc9a510/ffff8ee080689800 00000020:01000000:3.0:1787440336.801266:0:13117:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8ee07f9edc00 - data ffff8ee06e29da20/ffff8ee04cac7c00 00100000:10000000:3.0:1787440336.814099:0:13117:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1787440336.874350:0:13117:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x85f5fa77adf3c0bd 00000020:00000080:1.0:1787440336.874396:0:13117:0:(genops.c:885:class_export_put()) final put ffff8edf411a5000/lustre-OST0000-osd_UUID 00000020:01000004:1.0:1787440336.874419:0:13117:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8ee045e4e000 from lustre-OST0000, refs=2 00000020:01000004:1.0:1787440336.874423:0:13117:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8ee045e4e000 2 00000020:01000004:1.0:1787440336.874426:0:13117:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8ee045e4e000 from lustre-OST0000 00000020:00000080:1.0:1787440336.874451:0:13117:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787440336.874460:0:13117:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:1.0:1787440336.874464:0:13117:0:(genops.c:885:class_export_put()) final put ffff8ee07d289800/lustre-OST0000_UUID 00000020:00000080:1.0:1787440336.874467:0:13117:0:(genops.c:844:class_export_destroy()) destroying export ffff8ee07d289800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:1.0:1787440336.874475:0:13117:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:00000080:2.0:1787440336.874614:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8edf411a5000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000004:1.0:1787440336.874685:0:13117:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:1.0:1787440336.874697:0:13117:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:1.0:1787440336.874701:0:13117:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787440336.874705:0:13117:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1787440336.874711:0:13117:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff8ee07fad1800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787440336.874717:0:13117:0:(genops.c:1553:class_disconnect_exports()) OBD device 12 (ffff8ee04a7e4d28) has exports, disconnecting them 00000020:00080000:1.0:1787440336.874722:0:13117:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff8ee07fad1800), last request at 1787440109 00000020:00000080:1.0:1787440336.874725:0:13117:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x85f5fa77adf3c0e7 00000020:00080000:1.0:1787440336.874734:0:13117:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8ee07fad1800): rc 0 00000020:00000080:1.0:1787440336.874739:0:13117:0:(genops.c:885:class_export_put()) final put ffff8ee07fad1800/lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1787440336.874971:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8ee07fad1800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:0.0:1787440336.879610:0:13117:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:0.0:1787440336.879618:0:13117:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787440336.879631:0:13117:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1787440336.879638:0:13117:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787440336.879850:0:13117:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787440336.879858:0:13117:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:0.0:1787440336.879865:0:13117:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8ee045e4e000 1 00000020:00000080:0.0:1787440336.879883:0:13117:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x85f5fa77adf3c077 00000020:00000080:0.0:1787440336.879891:0:13117:0:(genops.c:885:class_export_put()) final put ffff8ee06d8dd000/lustre-OST0000-osd_UUID 00000020:01000000:0.0:1787440336.879896:0:13117:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:0.0:1787440336.879900:0:13117:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787440336.879904:0:13117:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787440336.879907:0:13117:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff8ee04a7e19b8) has no exports 00000020:00000080:2.0:1787440336.880215:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ee079ae7800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1787440336.880222:0:37:0:(genops.c:885:class_export_put()) final put ffff8ee07fad0800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:2.0:1787440336.880225:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8ee07fad0800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:2.0:1787440336.880233:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:2.0:1787440336.880279:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8ee06d8dd000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1787440336.929950:0:13117:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787440336.929965:0:13117:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:2.0:1787440336.929970:0:13117:0:(genops.c:885:class_export_put()) final put ffff8ee045e4a800/lustre-OST0000-osd_UUID 00000020:00000080:2.0:1787440336.929974:0:13117:0:(genops.c:844:class_export_destroy()) destroying export ffff8ee045e4a800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:2.0:1787440336.929985:0:13117:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:2.0:1787440336.930163:0:13117:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8ee045e4c000 00000020:02000400:2.0:1787440336.930246:0:13117:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:0.0:1787440336.988776:0:12965:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787440338.013787:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787440339.037720:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787440339.780334:0:13268:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:2.0:1787440339.808637:0:13268:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:2.0:1787440339.808716:0:13268:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.158@tcp lock: ffff8ee07f86fa00/0x85f5fa77adf3c284 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3c28b expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440339.808730:0:13268:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.158@tcp lock: ffff8ee07f86fa00/0x85f5fa77adf3c284 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x85f5fa77adf3c28b expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440339.808736:0:13268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.158@tcp lock: ffff8ee07f86fa00/0x85f5fa77adf3c284 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x85f5fa77adf3c28b expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440339.808743:0:13268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.158@tcp lock: ffff8ee07f86fa00/0x85f5fa77adf3c284 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x85f5fa77adf3c28b expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440339.808766:0:13268:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1787440339.808771:0:13268:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1787440339.808794:0:13268:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787440339.808818:0:13268:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8ee0776b9180 x1874266701256704/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787440341 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787440339.808834:0:13268:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8ee050481c00 x1874266701257216/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787440346 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787440339.808844:0:13268:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8ee050480e00 x1874266701257344/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787440347 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787440339.808872:0:13268:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8ee050481880 x1874266701257472/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787440352 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787440339.808888:0:13268:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8ee08032d880 x1874266701257728/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787440352 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787440339.808895:0:13268:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1787440339.808900:0:13268:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1787440339.808923:0:13268:0:(import.c:65:import_set_state_nolock()) ffff8edf411a0800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:1.0:1787440339.809076:0:12965:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787440339.809084:0:12965:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.158@tcp lock: ffff8ee07f86fa00/0x85f5fa77adf3c284 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x85f5fa77adf3c28b expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440339.809091:0:12965:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee07f86fa00 already unused, calling callback (ffffffffc1bd2c20) 10000000:00010000:1.0:1787440339.809095:0:12965:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.158@tcp lock: ffff8ee07f86fa00/0x85f5fa77adf3c284 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x85f5fa77adf3c28b expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440339.809103:0:12965:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.158@tcp lock: ffff8ee07f86fa00/0x85f5fa77adf3c284 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x85f5fa77adf3c28b expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787440339.809109:0:12965:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.158@tcp lock: ffff8ee07f86fa00/0x85f5fa77adf3c284 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x85f5fa77adf3c28b expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787440339.809114:0:12965:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787440339.809117:0:12965:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1787440339.809119:0:12965:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1787440339.809130:0:12965:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8ee04a7ee800 00010000:00010000:1.0:1787440339.809133:0:12965:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.158@tcp lock: ffff8ee07f86fa00/0x85f5fa77adf3c284 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x85f5fa77adf3c28b expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440339.809153:0:12965:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.158@tcp lock: ffff8ee07f86fa00/0x85f5fa77adf3c284 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x85f5fa77adf3c28b expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440339.809163:0:12965:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787440339.809165:0:12965:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787440339.809167:0:12965:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787440339.809207:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee050480e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1874266701257344:0@lo:400:kworker.0 00000100:00100000:1.0:1787440339.809255:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee08032c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3308:1874266701257856:0@lo:39:umount.0 00000400:00000100:1.0:1787440339.809300:0:3308:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874266701257856 offset 0 length 224: 4 00000100:00100000:3.0:1787440339.809507:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee08032d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1874266701257728:0@lo:400:kworker.0 00000100:00100000:3.0:1787440339.809523:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee050481880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1874266701257472:0@lo:400:kworker.0 00000100:00100000:3.0:1787440339.809529:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee0776b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1874266701256704:0@lo:400:kworker.0 00000100:00100000:3.0:1787440339.809562:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee050481c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3310:1874266701257216:0@lo:400:kworker.0 00010000:00010000:1.0:1787440340.061299:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787440341.084871:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787440341.916710:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 168176ea-29d1-49de-a254-317e90d54802->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787440341.916720:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 168176ea-29d1-49de-a254-317e90d54802->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:1.0:1787440342.109908:0:12965:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787440343.141009:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787440344.157170:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787440345.181260:0:12965:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787440346.207782:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787440347.037102:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 168176ea-29d1-49de-a254-317e90d54802->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787440347.037112:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 168176ea-29d1-49de-a254-317e90d54802->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:2.0:1787440347.231435:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787440348.252835:0:12965:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787440349.021853:0:3308:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787440339/real 1787440339] req@ffff8ee08032c000 x1874266701257856/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787440349 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787440349.021887:0:3308:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8ee08032c000 x1874266701257856/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787440349 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787440349.021907:0:3308:0:(import.c:65:import_set_state_nolock()) ffff8edf411a0800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1787440349.021928:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee08032c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3308:1874266701257856:0@lo:39:umount.0 00000100:00080000:2.0:1787440349.022017:0:13268:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787440349.022022:0:13268:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1787440349.022027:0:13268:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1787440349.026618:0:13268:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.158@tcp lock: ffff8ee059185400/0x85f5fa77adf3c292 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3c299 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440349.026638:0:13268:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.158@tcp lock: ffff8ee059185400/0x85f5fa77adf3c292 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x85f5fa77adf3c299 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440349.026645:0:13268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.158@tcp lock: ffff8ee059185400/0x85f5fa77adf3c292 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x85f5fa77adf3c299 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440349.026666:0:13268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.158@tcp lock: ffff8ee059185400/0x85f5fa77adf3c292 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x85f5fa77adf3c299 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440349.026703:0:13268:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787440349.026711:0:13268:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.158@tcp lock: ffff8ee07f86e800/0x85f5fa77adf3c4d7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3c4de expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440349.026718:0:13268:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.158@tcp lock: ffff8ee07f86e800/0x85f5fa77adf3c4d7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x85f5fa77adf3c4de expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440349.026724:0:13268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.158@tcp lock: ffff8ee07f86e800/0x85f5fa77adf3c4d7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x85f5fa77adf3c4de expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440349.026730:0:13268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.158@tcp lock: ffff8ee07f86e800/0x85f5fa77adf3c4d7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x85f5fa77adf3c4de expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440349.026750:0:13268:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1787440349.026755:0:13268:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:2.0:1787440349.026785:0:13268:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00000020:01000000:2.0:1787440349.026789:0:13268:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:2.0:1787440349.026793:0:13268:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787440349.026798:0:13268:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1787440349.026802:0:13268:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff8ee07745cd28) has no exports 00000020:00080000:2.0:1787440349.026835:0:13268:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff8ee07745cd28) has no exports 00010000:00010000:3.0:1787440349.027543:0:5837:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787440349.027552:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.158@tcp lock: ffff8ee059185400/0x85f5fa77adf3c292 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x85f5fa77adf3c299 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440349.027569:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee059185400 already unused, calling callback (ffffffffc1bd2c20) 10000000:00010000:3.0:1787440349.027572:0:5837:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.158@tcp lock: ffff8ee059185400/0x85f5fa77adf3c292 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x85f5fa77adf3c299 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440349.027581:0:5837:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.158@tcp lock: ffff8ee059185400/0x85f5fa77adf3c292 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x85f5fa77adf3c299 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787440349.027587:0:5837:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.158@tcp lock: ffff8ee059185400/0x85f5fa77adf3c292 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x85f5fa77adf3c299 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787440349.027592:0:5837:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787440349.027594:0:5837:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:3.0:1787440349.027596:0:5837:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:3.0:1787440349.027608:0:5837:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8ee04a7ee800 00010000:00010000:3.0:1787440349.027611:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.158@tcp lock: ffff8ee059185400/0x85f5fa77adf3c292 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x85f5fa77adf3c299 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440349.027618:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.158@tcp lock: ffff8ee059185400/0x85f5fa77adf3c292 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x85f5fa77adf3c299 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440349.027631:0:5837:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787440349.027633:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.158@tcp lock: ffff8ee07f86e800/0x85f5fa77adf3c4d7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x85f5fa77adf3c4de expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440349.027638:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee07f86e800 already unused, calling callback (ffffffffc1bd2c20) 10000000:00010000:3.0:1787440349.027641:0:5837:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.158@tcp lock: ffff8ee07f86e800/0x85f5fa77adf3c4d7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x85f5fa77adf3c4de expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440349.027646:0:5837:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.158@tcp lock: ffff8ee07f86e800/0x85f5fa77adf3c4d7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x85f5fa77adf3c4de expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787440349.027657:0:5837:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.158@tcp lock: ffff8ee07f86e800/0x85f5fa77adf3c4d7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x85f5fa77adf3c4de expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787440349.027662:0:5837:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1787440349.027664:0:5837:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1787440349.027666:0:5837:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1787440349.027670:0:5837:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8ee04a7ee800 00010000:00010000:3.0:1787440349.027673:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.158@tcp lock: ffff8ee07f86e800/0x85f5fa77adf3c4d7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x85f5fa77adf3c4de expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440349.027678:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.158@tcp lock: ffff8ee07f86e800/0x85f5fa77adf3c4d7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x85f5fa77adf3c4de expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440349.027689:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787440349.027691:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787440349.027693:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787440349.028643:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1787440349.041361:0:13268:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8ee0778576c0 - data ffff8ee06ff5ba20/ffff8ee07743f400 00000020:01000000:2.0:1787440349.041948:0:13268:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8ee077857cc0 - data ffff8ee07fda2bd0/ffff8ee08056d000 00100000:10000000:3.0:1787440349.072265:0:13268:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1787440349.102981:0:13268:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x85f5fa77adf3c188 00000020:00000080:0.0:1787440349.102989:0:13268:0:(genops.c:885:class_export_put()) final put ffff8ee077f78800/lustre-OST0001-osd_UUID 00000020:01000004:0.0:1787440349.103002:0:13268:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8ee06db91000 from lustre-OST0001, refs=2 00000020:01000004:0.0:1787440349.103005:0:13268:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8ee06db91000 2 00000020:01000004:0.0:1787440349.103008:0:13268:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8ee06db91000 from lustre-OST0001 00000020:00000080:0.0:1787440349.103027:0:13268:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787440349.103034:0:13268:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:0.0:1787440349.103037:0:13268:0:(genops.c:885:class_export_put()) final put ffff8ee077f7b800/lustre-OST0001_UUID 00000020:00000080:0.0:1787440349.103039:0:13268:0:(genops.c:844:class_export_destroy()) destroying export ffff8ee077f7b800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:0.0:1787440349.103045:0:13268:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:0.0:1787440349.103148:0:13268:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 168176ea-29d1-49de-a254-317e90d54802->MGS 00010000:00010000:0.0:1787440349.103161:0:13268:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.158@tcp lock: ffff8ee082163c00/0x85f5fa77adf3c09a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x85f5fa77adf3c0a1 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787440349.103173:0:13268:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.158@tcp lock: ffff8ee082163c00/0x85f5fa77adf3c09a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x85f5fa77adf3c0a1 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787440349.103180:0:13268:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:0.0:1787440349.103183:0:13268:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:0.0:1787440349.103185:0:13268:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:0.0:1787440349.103206:0:13268:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8ee04a7ee800 00010000:00010000:0.0:1787440349.103209:0:13268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.158@tcp lock: ffff8ee082163c00/0x85f5fa77adf3c09a lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x85f5fa77adf3c0a1 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440349.103223:0:13268:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.158@tcp lock: ffff8ee07f86f400/0x85f5fa77adf3c2d8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x85f5fa77adf3c2df expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787440349.103230:0:13268:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.158@tcp lock: ffff8ee07f86f400/0x85f5fa77adf3c2d8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x85f5fa77adf3c2df expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787440349.103235:0:13268:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787440349.103249:0:13268:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:0.0:1787440349.103251:0:13268:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:0.0:1787440349.103259:0:13268:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8ee04a7ee800 00010000:00010000:0.0:1787440349.103261:0:13268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.158@tcp lock: ffff8ee07f86f400/0x85f5fa77adf3c2d8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x85f5fa77adf3c2df expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787440349.103275:0:13268:0:(import.c:65:import_set_state_nolock()) ffff8ee04a7ee800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:0.0:1787440349.103278:0:13268:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1787440349.103280:0:13268:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1787440349.103282:0:13268:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1787440349.103285:0:13268:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1787440349.103294:0:13268:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8ee08032ea00 x1874266701257600/t0(0) o250->MGC192.168.206.158@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1787440351 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1787440349.103311:0:13268:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1787440349.103313:0:13268:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 2s for inflight to error out 00000100:00100000:1.0:1787440349.103423:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee08032ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:168176ea-29d1-49de-a254-317e90d54802:3308:1874266701257600:0@lo:250:kworker.0 00000020:00000080:2.0:1787440349.103522:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8ee077f78800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 10000000:01000000:0.0:1787440349.103742:0:13268:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1787440349.103749:0:13268:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x85f5fa77adf3bf7b 00000020:00000080:0.0:1787440349.103754:0:13268:0:(genops.c:885:class_export_put()) final put ffff8ee04a7f6000/168176ea-29d1-49de-a254-317e90d54802 00000020:01000000:0.0:1787440349.103767:0:13268:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.206.158@tcp (flags='') 00000020:00000080:0.0:1787440349.103771:0:13268:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787440349.103776:0:13268:0:(obd_config.c:956:class_cleanup()) MGC192.168.206.158@tcp: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1787440349.103785:0:13268:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff8ee04a7e3370) has no exports 10000000:01000000:1.0:1787440349.103842:0:5847:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 00000020:00000080:2.0:1787440349.103908:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8ee04a7f6000/168176ea-29d1-49de-a254-317e90d54802 for MGC192.168.206.158@tcp 10000000:01000000:0.0:1787440349.103946:0:13268:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.206.158@tcp: client import never connected 00000100:00080000:0.0:1787440349.103949:0:13268:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:0.0:1787440349.103951:0:13268:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1787440349.103953:0:13268:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:0.0:1787440349.103955:0:13268:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1787440349.103990:0:13268:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787440349.103994:0:13268:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.206.158@tcp (uuid 168176ea-29d1-49de-a254-317e90d54802) 00000020:01000000:0.0:1787440349.103998:0:13268:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1787440349.104001:0:13268:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787440349.104004:0:13268:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1787440349.104009:0:13268:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff8edf411a5800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787440349.104014:0:13268:0:(genops.c:1553:class_disconnect_exports()) OBD device 16 (ffff8ee045f78000) has exports, disconnecting them 00000020:00080000:0.0:1787440349.104018:0:13268:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff8edf411a5800), last request at 1787440128 00000020:00000080:0.0:1787440349.104021:0:13268:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x85f5fa77adf3c1b2 00000020:00080000:0.0:1787440349.104030:0:13268:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8edf411a5800): rc 0 00000020:00000080:0.0:1787440349.104033:0:13268:0:(genops.c:885:class_export_put()) final put ffff8edf411a5800/lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1787440349.104344:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ee04a7ee800 for MGC192.168.206.158@tcp 00000020:00000080:2.0:1787440349.104350:0:36:0:(genops.c:885:class_export_put()) final put ffff8ee04a7eb000/168176ea-29d1-49de-a254-317e90d54802 00000020:00000080:2.0:1787440349.104352:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8ee04a7eb000/168176ea-29d1-49de-a254-317e90d54802 for MGC192.168.206.158@tcp 00000020:01000000:2.0:1787440349.104356:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.206.158@tcp (168176ea-29d1-49de-a254-317e90d54802) 00000020:00000080:2.0:1787440349.104594:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8edf411a5800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:2.0:1787440349.129589:0:13268:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:2.0:1787440349.129598:0:13268:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787440349.129603:0:13268:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1787440349.129610:0:13268:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787440349.129645:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8edf411a0800 for lustre-MDT0000-lwp-OST0001 00010000:00010000:2.0:1787440349.129695:0:12965:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:2.0:1787440349.129828:0:5837:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:2.0:1787440349.129892:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:2.0:1787440349.129978:0:5832:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff8ee045e3e600:5832] 0 exiting: rc = 1 00000100:00100000:2.0:1787440349.130036:0:8448:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_002: service thread [ffff8ee05fb3b400:8448] 2 exiting: rc = 0 00000100:00100000:1.0:1787440349.132056:0:5833:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff8ee045e3ea00:5833] 1 exiting: rc = 0 00000100:00100000:2.0:1787440349.132254:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.132475:0:5835:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff8ee045e3fc00:5835] 1 exiting: rc = 0 00000100:00100000:2.0:1787440349.134074:0:5834:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff8ee045e3f000:5834] 0 exiting: rc = 1 00000100:00100000:1.0:1787440349.135334:0:5836:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff8ee045e3fa00:5836] 2 exiting: rc = 0 00000100:00100000:1.0:1787440349.135703:0:6711:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff8ee07facd800:6711] 3 exiting: rc = 0 00000100:00100000:2.0:1787440349.135988:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.135998:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.136005:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.136011:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.136017:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.136022:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.136029:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.136035:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.136040:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.136046:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.136051:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.136057:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.136084:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.136090:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.136096:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.136101:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.136107:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.136112:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.136117:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.136123:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.136129:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.136134:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.136139:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.136145:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.136151:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.136156:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.136161:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.136165:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.136170:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.136175:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.136180:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.136185:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.136190:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.136195:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.136199:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.136204:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.136209:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.136215:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.136220:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.136225:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.136230:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.136236:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.136241:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.136247:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.136253:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.136257:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.136262:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.136275:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.136280:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.136285:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.136290:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.136295:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.136300:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.136304:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.136309:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.136314:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.136319:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.136324:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.136329:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.136333:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.136337:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.136342:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.136347:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.136352:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1787440349.137427:0:13268:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787440349.137437:0:13268:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:2.0:1787440349.137443:0:13268:0:(genops.c:885:class_export_put()) final put ffff8ee077f7a800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:2.0:1787440349.137447:0:13268:0:(genops.c:844:class_export_destroy()) destroying export ffff8ee077f7a800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:2.0:1787440349.137453:0:13268:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:2.0:1787440349.137534:0:13268:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8ee06db91000 1 00000020:00000080:2.0:1787440349.137539:0:13268:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x85f5fa77adf3c157 00000020:00000080:2.0:1787440349.137545:0:13268:0:(genops.c:885:class_export_put()) final put ffff8ee06db92800/lustre-OST0001-osd_UUID 00000020:01000000:2.0:1787440349.137559:0:13268:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:2.0:1787440349.137565:0:13268:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787440349.137569:0:13268:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1787440349.137572:0:13268:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff8ee07c2c4d28) has no exports 00000020:00000080:1.0:1787440349.137915:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8ee06db92800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:2.0:1787440349.179775:0:13268:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787440349.182116:0:13268:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:2.0:1787440349.182126:0:13268:0:(genops.c:885:class_export_put()) final put ffff8ee06db94800/lustre-OST0001-osd_UUID 00000020:00000080:2.0:1787440349.182132:0:13268:0:(genops.c:844:class_export_destroy()) destroying export ffff8ee06db94800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:2.0:1787440349.182155:0:13268:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:2.0:1787440349.182340:0:13268:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8ee06db96800 00000020:01000000:2.0:1787440349.182360:0:13268:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:2.0:1787440349.182365:0:13268:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787440349.182370:0:13268:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1787440349.182374:0:13268:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff8ee080063370) has no exports 00000020:00000080:2.0:1787440349.182912:0:13268:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787440349.182921:0:13268:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:2.0:1787440349.182924:0:13268:0:(genops.c:885:class_export_put()) final put ffff8ee06d8d8000/OSS_uuid 00000020:00000080:2.0:1787440349.182926:0:13268:0:(genops.c:844:class_export_destroy()) destroying export ffff8ee06d8d8000/OSS_uuid for OSS 00000020:01000000:2.0:1787440349.182930:0:13268:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:2.0:1787440349.182965:0:5845:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:2.0:1787440349.183117:0:6695:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff8ee06db52800:6695] 0 exiting: rc = 1 00000100:00100000:1.0:1787440349.185376:0:12016:0:(service.c:3183:ptlrpc_main()) ll_ost00_004: service thread [ffff8ee045e42200:12016] 4 exiting: rc = 0 00000100:00100000:0.0:1787440349.186560:0:6698:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff8ee077576800:6698] 2 exiting: rc = 0 00000100:00100000:1.0:1787440349.187847:0:6697:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff8ee0772c4400:6697] 1 exiting: rc = 0 00000100:00100000:1.0:1787440349.191307:0:9225:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff8ee06d886c00:9225] 3 exiting: rc = 0 00000100:00100000:2.0:1787440349.199616:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.199628:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.199639:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.199646:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.199651:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.199657:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.199661:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.199666:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.199671:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.199676:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.199681:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.199686:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.199691:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.199696:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.199701:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.199706:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.199710:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.199716:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.199721:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.199726:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.199731:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.199736:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.199755:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.199759:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.199783:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.199790:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.199796:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.199802:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.199823:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.199830:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.199836:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.199844:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.199850:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.199858:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.199866:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.199874:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.199883:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.199893:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.199901:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.199907:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.199914:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.199937:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.199943:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.199949:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.199955:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.199960:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.199966:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.199972:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.199977:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.199983:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.199989:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.199994:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.199999:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.200004:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.200010:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.200016:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.200025:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.200041:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.200047:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.200052:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.200058:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.200063:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.200068:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.200074:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787440349.209049:0:6699:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff8ee077577000:6699] 0 exiting: rc = 1 00000100:00100000:1.0:1787440349.209623:0:6700:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff8ee077576200:6700] 1 exiting: rc = 0 00000100:00100000:2.0:1787440349.209732:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.209741:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.209746:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.209752:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.209756:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.209761:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.209766:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.209771:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.209776:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.209781:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.210015:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.210023:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.210028:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.210034:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.210038:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.210043:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.210048:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.210053:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.210058:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.210063:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.210069:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.210075:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.210080:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.210085:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.210090:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.210096:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.210101:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.210106:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.210127:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.210132:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.210138:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.210143:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.210148:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.210152:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.210157:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.210162:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.210166:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.210172:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.210176:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.210182:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.210187:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.210192:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.210197:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.210202:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.210207:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.210212:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.210217:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.210222:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.210227:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.210232:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.210237:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.210242:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.210247:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.210252:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.210257:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.210262:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.210267:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.210273:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.210278:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.210283:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.210287:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.210293:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.210297:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.210317:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787440349.217569:0:6703:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff8ee077576600:6703] 2 exiting: rc = 0 00000100:00100000:1.0:1787440349.217781:0:6702:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff8ee077574c00:6702] 1 exiting: rc = 0 00000100:00100000:1.0:1787440349.218184:0:6701:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff8ee077575a00:6701] 0 exiting: rc = 1 00000100:00100000:2.0:1787440349.218333:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.218342:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.218419:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.218427:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.218433:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.218439:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.218444:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.218450:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.218456:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.218461:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.218467:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.218472:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.218478:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.218483:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.218488:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.218518:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.218524:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.218530:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.218668:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.218675:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.218679:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.218684:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.218690:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.218695:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.218700:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.218706:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.218711:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.218716:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.218721:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.218726:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.218731:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.218736:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.218740:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.218746:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.218765:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.218770:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.218776:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.218781:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.218787:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.218792:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.218798:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.218803:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.218954:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.218963:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.218969:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.218974:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.218980:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.218985:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.218990:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.218995:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.219001:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.219006:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.219012:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.219148:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.219157:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.219164:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.219174:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.219179:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.219188:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.219194:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.219202:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.219212:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.219219:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.219225:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.235418:0:6705:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff8ee06db55400:6705] 1 exiting: rc = 0 00000100:00100000:1.0:1787440349.235434:0:6704:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff8ee06db55200:6704] 0 exiting: rc = 1 00000100:00100000:2.0:1787440349.241359:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.241369:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.241374:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.241379:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.241396:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.241401:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.241407:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.241412:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.241418:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.241423:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.241429:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.241434:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.241439:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.241444:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.241450:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.241456:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.241461:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.241466:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.241470:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.241475:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.241480:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.241485:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.241490:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.241512:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.241517:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.241522:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.241528:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.241532:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.241547:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.241558:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.241563:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.241568:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.241573:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.241579:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.241585:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.241590:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.241595:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.241601:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.241606:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.241621:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.241626:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.241632:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.241637:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.241642:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.241647:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.241653:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.241659:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.241664:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.241670:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.241675:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.241680:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.242443:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.242454:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.242460:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.242467:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.242477:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.242483:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.242489:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.242519:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.242541:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.242548:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.242561:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.242566:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.242571:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787440349.243737:0:6707:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff8ee0817ade00:6707] 1 exiting: rc = 0 00000100:00100000:0.0:1787440349.244028:0:6706:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff8ee06db54000:6706] 0 exiting: rc = 1 00000100:00100000:2.0:1787440349.244342:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.244350:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.244360:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.244366:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.244372:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.244377:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.244384:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.244390:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.244408:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.244416:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.244433:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.244442:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.244449:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.244460:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.244468:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.244477:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.244488:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.244516:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.244526:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.244532:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.245196:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.245204:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.245211:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.245217:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.245371:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.245380:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.245391:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.245400:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.245406:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.245412:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.245417:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.245423:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.245446:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.245452:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.245458:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.245463:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.245468:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.245474:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.245481:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.245488:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.245518:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.245525:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.245532:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.245665:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.245693:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.245711:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.245720:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.245727:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.245733:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.245739:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.245744:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.245751:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.245757:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.245762:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.245768:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.245774:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.246416:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.246427:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.246434:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.246440:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.246447:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.246453:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.246460:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787440349.246466:0:13268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:3.0:1787440349.275463:0:13268:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:3.0:1787440366.047060:0:13886:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg658-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1787440374.151527:0:14347:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1787440374.151534:0:14347:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:3.0:1787440374.152625:0:14347:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8ee0438d0800 00000020:01000004:3.0:1787440374.153334:0:14347:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:3.0:1787440374.153342:0:14347:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1787440374.153356:0:14347:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff8ee045f799b8) 00000020:00000080:3.0:1787440374.153371:0:14347:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1787440374.197081:0:14347:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1787440374.200369:0:14347:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:2.0:1787440374.200778:0:14347:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 539: rc = 0 00100000:10000000:2.0:1787440374.200877:0:14347:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 539: rc = 0 00100000:10000000:2.0:1787440374.201054:0:14347:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1787440374.201124:0:14347:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 539: rc = 0 00100000:10000000:2.0:1787440374.201222:0:14347:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 539: rc = 0 00100000:10000000:2.0:1787440374.201324:0:14347:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 539: rc = 0 00100000:10000000:2.0:1787440374.201427:0:14347:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 539: rc = 0 00100000:10000000:2.0:1787440374.201722:0:14347:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 541: rc = 0 00100000:10000000:2.0:1787440374.204269:0:14347:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 455: rc = 0 00100000:10000000:2.0:1787440374.204354:0:14347:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 455: rc = 0 00100000:10000000:2.0:1787440374.204836:0:14347:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 626: rc = 0 00100000:10000000:2.0:1787440374.207177:0:14347:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 626: rc = 0 00100000:10000000:2.0:1787440374.207454:0:14347:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 626: rc = 0 00100000:10000000:2.0:1787440374.209328:0:14347:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 626: rc = 0 00100000:10000000:3.0:1787440374.216134:0:14347:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 626: rc = 0 00100000:10000000:3.0:1787440374.216427:0:14347:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 626: rc = 0 00100000:10000000:3.0:1787440374.217413:0:14347:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 626: rc = 0 00100000:10000000:3.0:1787440374.218222:0:14347:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 626: rc = 0 00100000:10000000:3.0:1787440374.218533:0:14347:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 626: rc = 0 00100000:10000000:3.0:1787440374.218800:0:14347:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 626: rc = 0 00100000:10000000:3.0:1787440374.219051:0:14347:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 626: rc = 0 00100000:10000000:3.0:1787440374.219320:0:14347:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 626: rc = 0 00100000:10000000:3.0:1787440374.220646:0:14347:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 637: rc = 0 00100000:10000000:3.0:1787440374.223415:0:14347:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 637: rc = 0 00100000:10000000:3.0:1787440374.224004:0:14347:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 637: rc = 0 00100000:10000000:3.0:1787440374.224265:0:14347:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 637: rc = 0 00100000:10000000:3.0:1787440374.225006:0:14347:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 637: rc = 0 00100000:10000000:3.0:1787440374.225257:0:14347:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 637: rc = 0 00100000:10000000:3.0:1787440374.225538:0:14347:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 637: rc = 0 00100000:10000000:3.0:1787440374.226223:0:14347:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 637: rc = 0 00100000:10000000:3.0:1787440374.226468:0:14347:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 637: rc = 0 00100000:10000000:3.0:1787440374.226973:0:14347:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 637: rc = 0 00100000:10000000:3.0:1787440374.227201:0:14347:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 637: rc = 0 00100000:10000000:3.0:1787440374.227414:0:14347:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 637: rc = 0 00100000:10000000:3.0:1787440374.227948:0:14347:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 637: rc = 0 00100000:10000000:3.0:1787440374.228163:0:14347:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 637: rc = 0 00100000:10000000:3.0:1787440374.228374:0:14347:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 637: rc = 0 00100000:10000000:3.0:1787440374.236608:0:14347:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 637: rc = 0 00100000:10000000:3.0:1787440374.237162:0:14347:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 637: rc = 0 00100000:10000000:3.0:1787440374.237449:0:14347:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 637: rc = 0 00100000:10000000:3.0:1787440374.238098:0:14347:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 637: rc = 0 00100000:10000000:3.0:1787440374.238346:0:14347:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 637: rc = 0 00100000:10000000:3.0:1787440374.238987:0:14347:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 637: rc = 0 00100000:10000000:3.0:1787440374.239305:0:14347:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 637: rc = 0 00100000:10000000:3.0:1787440374.239835:0:14347:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 637: rc = 0 00100000:10000000:3.0:1787440374.240256:0:14347:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 637: rc = 0 00100000:10000000:3.0:1787440374.242024:0:14347:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 637: rc = 0 00100000:10000000:3.0:1787440374.242833:0:14347:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 637: rc = 0 00100000:10000000:3.0:1787440374.243880:0:14347:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 637: rc = 0 00100000:10000000:3.0:1787440374.244542:0:14347:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 637: rc = 0 00100000:10000000:3.0:1787440374.247104:0:14347:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 637: rc = 0 00100000:10000000:3.0:1787440374.247363:0:14347:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 637: rc = 0 00100000:10000000:3.0:1787440374.248397:0:14347:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 637: rc = 0 00100000:10000000:2.0:1787440374.249971:0:14347:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 637: rc = 0 00100000:10000000:2.0:1787440374.250451:0:14347:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 472: rc = 0 00100000:10000000:2.0:1787440374.251990:0:14347:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:2.0:1787440374.252172:0:14347:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 622: rc = 0 00100000:10000000:2.0:1787440374.252379:0:14347:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:2.0:1787440374.252441:0:14347:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 622: rc = 0 00100000:10000000:2.0:1787440374.252632:0:14347:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:2.0:1787440374.252707:0:14347:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 622: rc = 0 00100000:10000000:2.0:1787440374.253032:0:14347:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:2.0:1787440374.253106:0:14347:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 456: rc = 0 00100000:10000000:2.0:1787440374.253276:0:14347:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:2.0:1787440374.253585:0:14347:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 456: rc = 0 00100000:10000000:2.0:1787440374.253783:0:14347:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:2.0:1787440374.253918:0:14347:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 456: rc = 0 00000020:00000080:2.0:1787440374.254166:0:14347:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1787440374.254173:0:14347:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787440374.254184:0:14347:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x85f5fa77adf3d27c 00000020:01000004:2.0:1787440374.254192:0:14347:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1787440374.254196:0:14347:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1787440374.254201:0:14347:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8ee0438d0800 from MGS 00000020:01000004:2.0:1787440374.254205:0:14347:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1787440374.254214:0:14347:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff8ee077458000) 00000020:00000080:2.0:1787440374.254344:0:14347:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1787440374.254393:0:14347:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8ee0438d0800 from MGS, refs=2 00080000:01000000:2.0:1787440374.254397:0:14347:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:2.0:1787440374.254402:0:14347:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x85f5fa77adf3d28a 00000100:00100000:2.0:1787440374.255233:0:14347:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1787440374.255367:0:14347:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1787440374.255372:0:14347:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1787440374.259665:0:14347:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1787440374.259677:0:14347:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1787440374.260482:0:14347:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787440374.260719:0:14347:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1787440374.260725:0:14347:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1787440374.261487:0:14347:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1787440374.261521:0:14347:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1787440374.261991:0:14347:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1787440374.261999:0:14347:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1787440374.263019:0:14353:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787440374.263024:0:14353:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787440374.263026:0:14353:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787440374.263537:0:14354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787440374.263540:0:14354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787440374.263542:0:14354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787440374.264125:0:14347:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1787440374.268035:0:14353:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:2.0:1787440374.277934:0:14347:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:2.0:1787440374.277952:0:14347:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1787440374.277955:0:14347:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:2.0:1787440374.279852:0:14356:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1787440374.280001:0:14347:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1787440374.280109:0:14347:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1787440374.281047:0:14347:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1787440374.281361:0:14347:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787440374.281544:0:14347:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1787440374.281550:0:14347:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1787440374.284289:0:14347:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1787440374.284300:0:14347:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1787440374.289818:0:14347:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1787440374.289827:0:14347:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1787440374.290553:0:14347:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1787440374.290575:0:14347:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.206.158@tcp' 00000020:01000004:2.0:1787440374.290577:0:14347:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1787440374.290604:0:14347:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.206.158@tcp (typ=mgc) 00000020:00000080:2.0:1787440374.290616:0:14347:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.206.158@tcp (ffff8ee07745b370) 00000020:00000080:2.0:1787440374.290629:0:14347:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1787440374.290723:0:14347:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8ee077ee1000@MGC192.168.206.158@tcp: add connection 192.168.206.158@tcp at head 00010000:00010000:2.0:1787440374.290861:0:14347:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.206.158@tcp-0 is initialized 00000040:01000000:2.0:1787440374.290868:0:14347:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.158@tcp ctxt 1 is initialized 10000000:01000000:0.0:1787440374.301325:0:14362:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1787440374.305519:0:14347:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.206.158@tcp (uuid ad3425e2-7a90-4de2-801f-bf0de0fd7f0c) 00000020:00000080:1.0:1787440374.305552:0:14347:0:(genops.c:1385:class_connect()) connect: client ad3425e2-7a90-4de2-801f-bf0de0fd7f0c, cookie 0x85f5fa77adf3d298 00000100:00080000:1.0:1787440374.305565:0:14347:0:(import.c:510:import_select_connection()) MGC192.168.206.158@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787440374.305572:0:14347:0:(import.c:624:import_select_connection()) MGC192.168.206.158@tcp: import ffff8ee077ee1000 using connection 192.168.206.158@tcp/0@lo 00000100:00100000:1.0:1787440374.305606:0:14347:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ee050480e00 x1874266701257984/t0(0) o250->MGC192.168.206.158@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787440374.305632:0:14347:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import ad3425e2-7a90-4de2-801f-bf0de0fd7f0c->MGS 00000020:01000004:1.0:1787440374.305659:0:14347:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1787440374.305664:0:14347:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000100:00100000:2.0:1787440374.305670:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee050480e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c:3308:1874266701257984:0@lo:250:mount.lustre.0 00000020:00000080:1.0:1787440374.305677:0:14347:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff8ee04a7e0000) 00000020:00000080:1.0:1787440374.305706:0:14347:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1787440374.305793:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440374.305876:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701257984 00000100:00100000:2.0:1787440374.305888:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701257984 00000100:00100000:2.0:1787440374.305916:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787440374.305922:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04cac6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3308:x1874266701257984:12345-0@lo:250:mount.lustre.0 00010000:00080000:2.0:1787440374.305943:0:14357:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from ad3425e2-7a90-4de2-801f-bf0de0fd7f0c@0@lo t0 exp 0000000000000000 cur 472 last 0 00000020:00000080:2.0:1787440374.305963:0:14357:0:(genops.c:1385:class_connect()) connect: client ad3425e2-7a90-4de2-801f-bf0de0fd7f0c, cookie 0x85f5fa77adf3d2a6 00000100:00080000:2.0:1787440374.306128:0:14357:0:(import.c:65:import_set_state_nolock()) ffff8ee077ee1800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787440374.306178:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04cac6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+5:3308:x1874266701257984:12345-0@lo:250:mount.lustre.0 Request processed in 255us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440374.306186:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787440374.306225:0:3308:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.206.158@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1787440374.306232:0:3308:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.206.158@tcp: connect to target with instance 0 00000100:00080000:2.0:1787440374.306238:0:3308:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.206.158@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1787440374.306242:0:3308:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1787440374.306245:0:3308:0:(import.c:65:import_set_state_nolock()) ffff8ee077ee1000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1787440374.306247:0:3308:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1787440374.306254:0:3308:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1787440374.306258:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee050480e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c:3308:1874266701257984:0@lo:250:mount.lustre.0 00000100:00080000:0.0:1787440374.308274:0:14361:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000100:00100000:1.0:1787440374.315787:0:14347:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787440374.317753:0:14347:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1787440374.317760:0:14347:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1787440374.319020:0:14347:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1787440374.319030:0:14347:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1787440374.320643:0:14347:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1787440374.320654:0:14347:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1787440374.322784:0:14347:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787440374.322950:0:14347:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1787440374.322956:0:14347:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1787440374.331773:0:14347:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1787440374.331792:0:14347:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1787440374.388809:0:14347:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787440374.390205:0:14347:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1787440374.390214:0:14347:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1787440374.396110:0:14347:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1787440374.398713:0:14347:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1787440374.401597:0:14347:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787440374.401785:0:14347:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1787440374.401790:0:14347:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1787440374.402302:0:14347:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1787440374.402309:0:14347:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1787440374.402849:0:14347:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787440374.402981:0:14347:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1787440374.402986:0:14347:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1787440374.409939:0:14347:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1787440374.409953:0:14347:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1787440374.410609:0:14347:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787440374.410789:0:14347:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1787440374.410794:0:14347:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:0.0:1787440374.411379:0:14347:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:0.0:1787440374.411387:0:14347:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1787440374.439274:0:14347:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787440374.439470:0:14347:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1787440374.439477:0:14347:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1787440374.441232:0:14347:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1787440374.441243:0:14347:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1787440374.443394:0:14347:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1787440374.443407:0:14347:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1787440374.444366:0:14347:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1787440374.444388:0:14347:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:2.0:1787440374.444394:0:14347:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.158@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1787440374.444619:0:14347:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.158@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787440374.444649:0:14347:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.206.158@tcp, index=0000, flags=0x20005 00000020:01000004:2.0:1787440374.444653:0:14347:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787440374.444655:0:14347:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787440374.444656:0:14347:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787440374.444657:0:14347:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787440374.444658:0:14347:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787440374.444659:0:14347:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787440374.444660:0:14347:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787440374.444662:0:14347:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787440374.444663:0:14347:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787440374.444665:0:14347:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787440374.444667:0:14347:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:2.0:1787440374.444669:0:14347:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787440374.444670:0:14347:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787440374.444671:0:14347:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787440374.444672:0:14347:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787440374.444673:0:14347:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787440374.444675:0:14347:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787440374.444676:0:14347:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787440374.444677:0:14347:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787440374.444678:0:14347:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787440374.444693:0:14347:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787440374.444719:0:14347:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1787440374.444738:0:14347:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee08032df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c:14347:1874266701258112:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787440374.444812:0:14347:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440374.444912:0:14347:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee0438aed80 going to sleep for 11 seconds 00000100:00100000:3.0:1787440374.444987:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701258112 00000100:00100000:3.0:1787440374.444994:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701258112 00000100:00100000:3.0:1787440374.445213:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787440374.445221:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04cac5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+5:14347:x1874266701258112:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1787440374.445263:0:14360:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1787440374.445266:0:14360:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1787440374.445268:0:14360:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:0.0:1787440374.445572:0:14381:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1787440374.445905:0:14360:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:0.0:1787440374.446954:0:14382:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:0.0:1787440374.446960:0:14382:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:0.0:1787440374.446963:0:14382:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:0.0:1787440374.446992:0:14382:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:3.0:1787440374.450481:0:14360:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1787440374.450524:0:14360:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1787440374.459661:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04cac5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+5:14347:x1874266701258112:12345-0@lo:253:mount.lustre.0 Request processed in 14432us (14840us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440374.459675:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787440374.459714:0:14347:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee08032df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c:14347:1874266701258112:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787440374.459732:0:14347:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1787440374.459736:0:14347:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787440374.459738:0:14347:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787440374.459740:0:14347:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787440374.459741:0:14347:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787440374.459742:0:14347:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787440374.459743:0:14347:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787440374.459745:0:14347:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787440374.459747:0:14347:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787440374.459748:0:14347:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787440374.459750:0:14347:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787440374.459768:0:14347:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8ee0438d0800 from lustre-MDT0000 10000000:01000000:2.0:1787440374.459792:0:14347:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1787440374.459795:0:14347:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1787440374.459799:0:14347:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8ee07745b370 10000000:01000000:2.0:1787440374.459804:0:14347:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787440374.459811:0:14347:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8ee07745b370 from 1 10000000:01000000:2.0:1787440374.459813:0:14347:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787440374.459844:0:14347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.158@tcp lock: ffff8ee07f86f000/0x85f5fa77adf3d2ad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440374.459853:0:14347:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.158@tcp lock: ffff8ee07f86f000/0x85f5fa77adf3d2ad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440374.459862:0:14347:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.158@tcp lock: ffff8ee07f86f000/0x85f5fa77adf3d2ad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440374.459883:0:14347:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee08032df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c:14347:1874266701258240:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787440374.459924:0:14347:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440374.459963:0:14347:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee06d3b2cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787440374.460071:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701258240 00000100:00100000:3.0:1787440374.460077:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701258240 00000100:00100000:3.0:1787440374.460117:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787440374.460134:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04cac5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+5:14347:x1874266701258240:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787440374.460145:0:14358:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440374.460160:0:14358:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ee049e95600/0x85f5fa77adf3d2b4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x85f5fa77adf3d2ad expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440374.460180:0:14358:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ee049e95600/0x85f5fa77adf3d2b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x85f5fa77adf3d2ad expref: 6 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440374.460190:0:14358:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ee049e95600/0x85f5fa77adf3d2b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f5fa77adf3d2ad expref: 6 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440374.460199:0:14358:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee049e95600, rc 0) 00000100:00100000:3.0:1787440374.460238:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04cac5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+6:14347:x1874266701258240:12345-0@lo:101:mount.lustre.0 Request processed in 113us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440374.460243:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787440374.460401:0:14347:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee08032df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c:14347:1874266701258240:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787440374.460422:0:14347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.158@tcp lock: ffff8ee07f86f000/0x85f5fa77adf3d2ad lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3d2b4 expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440374.460430:0:14347:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.158@tcp lock: ffff8ee07f86f000/0x85f5fa77adf3d2ad lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x85f5fa77adf3d2b4 expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440374.460471:0:14347:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee07f9f1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c:14347:1874266701258368:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787440374.460538:0:14347:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440374.460565:0:14347:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee047bf1840 going to sleep for 11 seconds 00000100:00100000:3.0:1787440374.460778:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701258368 00000100:00100000:3.0:1787440374.460783:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701258368 00000100:00100000:3.0:1787440374.460814:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787440374.460821:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04cac4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+6:14347:x1874266701258368:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787440374.461077:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04cac4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+6:14347:x1874266701258368:12345-0@lo:501:mount.lustre.0 Request processed in 256us (537us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787440374.461085:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787440374.462048:0:14347:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee07f9f1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c:14347:1874266701258368:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1787440374.462082:0:14347:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.158@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1787440374.462186:0:14347:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.158@tcp lock: ffff8ee07f86f000/0x85f5fa77adf3d2ad lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3d2b4 expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440374.462197:0:14347:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.158@tcp lock: ffff8ee07f86f000/0x85f5fa77adf3d2ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3d2b4 expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787440374.462206:0:14347:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8ee0438d0800 10000000:01000000:2.0:1787440374.462212:0:14347:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1787440374.462216:0:14347:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8ee0438d0800 10000000:01000000:2.0:1787440374.462219:0:14347:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1787440374.462222:0:14347:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8ee0438d0800 from 1 10000000:01000000:2.0:1787440374.462224:0:14347:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1787440374.462252:0:14347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.158@tcp lock: ffff8ee07f86ea00/0x85f5fa77adf3d2bb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440374.462260:0:14347:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.158@tcp lock: ffff8ee07f86ea00/0x85f5fa77adf3d2bb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440374.462269:0:14347:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.158@tcp lock: ffff8ee07f86ea00/0x85f5fa77adf3d2bb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440374.462286:0:14347:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee08032ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c:14347:1874266701258496:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787440374.462330:0:14347:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440374.462372:0:14347:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee06d3b2e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787440374.462438:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701258496 00000100:00100000:3.0:1787440374.462444:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701258496 00000100:00100000:3.0:1787440374.462487:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787440374.462526:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04cac6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+6:14347:x1874266701258496:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787440374.462656:0:14357:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440374.462690:0:14357:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ee049e95400/0x85f5fa77adf3d2c2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x85f5fa77adf3d2bb expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440374.462718:0:14357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ee049e95400/0x85f5fa77adf3d2c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x85f5fa77adf3d2bb expref: 7 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440374.462728:0:14357:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ee049e95400/0x85f5fa77adf3d2c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f5fa77adf3d2bb expref: 7 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440374.462737:0:14357:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee049e95400, rc 0) 00000100:00100000:3.0:1787440374.462775:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04cac6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+7:14347:x1874266701258496:12345-0@lo:101:mount.lustre.0 Request processed in 251us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440374.462782:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787440374.462952:0:14347:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee08032ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c:14347:1874266701258496:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787440374.462971:0:14347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.158@tcp lock: ffff8ee07f86ea00/0x85f5fa77adf3d2bb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3d2c2 expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440374.462979:0:14347:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.158@tcp lock: ffff8ee07f86ea00/0x85f5fa77adf3d2bb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x85f5fa77adf3d2c2 expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787440374.462993:0:14347:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.158@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1787440374.463365:0:14347:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.158@tcp lock: ffff8ee07f86ea00/0x85f5fa77adf3d2bb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3d2c2 expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440374.463374:0:14347:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.158@tcp lock: ffff8ee07f86ea00/0x85f5fa77adf3d2bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3d2c2 expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787440374.463381:0:14347:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1787440374.463447:0:14347:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787440374.463453:0:14347:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8ee0438d0800 10000000:01000000:1.0:1787440374.463456:0:14347:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1787440374.463460:0:14347:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1787440374.463462:0:14347:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1787440374.463487:0:14347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.158@tcp lock: ffff8ee07fb9f600/0x85f5fa77adf3d2c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440374.465808:0:14347:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.158@tcp lock: ffff8ee07fb9f600/0x85f5fa77adf3d2c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440374.465821:0:14347:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.158@tcp lock: ffff8ee07fb9f600/0x85f5fa77adf3d2c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440374.465850:0:14347:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee050481f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c:14347:1874266701258624:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787440374.465915:0:14347:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440374.465961:0:14347:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee047d4c3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787440374.466639:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701258624 00000100:00100000:3.0:1787440374.466647:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701258624 00000100:00100000:3.0:1787440374.466739:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787440374.466748:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04cac6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+7:14347:x1874266701258624:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787440374.466761:0:14358:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440374.466776:0:14358:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ee049e94c00/0x85f5fa77adf3d2d0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x85f5fa77adf3d2c9 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440374.466800:0:14358:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ee049e94c00/0x85f5fa77adf3d2d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x85f5fa77adf3d2c9 expref: 8 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440374.466810:0:14358:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ee049e94c00/0x85f5fa77adf3d2d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f5fa77adf3d2c9 expref: 8 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440374.466818:0:14358:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee049e94c00, rc 0) 00000100:00100000:3.0:1787440374.466883:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04cac6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+8:14347:x1874266701258624:12345-0@lo:101:mount.lustre.0 Request processed in 136us (967us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440374.466890:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787440374.466969:0:14347:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee050481f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c:14347:1874266701258624:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787440374.466983:0:14347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.158@tcp lock: ffff8ee07fb9f600/0x85f5fa77adf3d2c9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3d2d0 expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440374.466992:0:14347:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.158@tcp lock: ffff8ee07fb9f600/0x85f5fa77adf3d2c9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x85f5fa77adf3d2d0 expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440374.467061:0:14347:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee050481f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c:14347:1874266701258752:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787440374.467087:0:14347:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440374.473942:0:14347:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee047d4c3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787440374.473991:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701258752 00000100:00100000:2.0:1787440374.474001:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701258752 00000100:00100000:2.0:1787440374.474049:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787440374.474058:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04cac7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+8:14347:x1874266701258752:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787440374.475227:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04cac7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+9:14347:x1874266701258752:12345-0@lo:501:mount.lustre.0 Request processed in 1167us (8134us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440374.475238:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787440374.475384:0:14347:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee050481f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c:14347:1874266701258752:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787440374.475650:0:14347:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee050481f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c:14347:1874266701258880:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787440374.475712:0:14347:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440374.475772:0:14347:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee047d4c3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787440374.475813:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701258880 00000100:00100000:2.0:1787440374.475818:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701258880 00000100:00100000:2.0:1787440374.475854:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787440374.475861:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04cac4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+9:14347:x1874266701258880:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787440374.476281:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04cac4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+9:14347:x1874266701258880:12345-0@lo:503:mount.lustre.0 Request processed in 419us (568us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440374.476289:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787440374.476358:0:14347:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee050481f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c:14347:1874266701258880:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787440374.477017:0:14383:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee08032ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c:14383:1874266701259008:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787440374.477064:0:14383:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440374.477202:0:14383:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee07f9a86c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787440374.477237:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701259008 00000100:00100000:0.0:1787440374.477242:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701259008 00000100:00100000:0.0:1787440374.477336:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787440374.477346:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04cac5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+9:14383:x1874266701259008:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787440374.477932:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04cac5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+9:14383:x1874266701259008:12345-0@lo:502:llog_process_th.0 Request processed in 586us (866us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440374.477940:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787440374.478115:0:14383:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee08032ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c:14383:1874266701259008:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787440374.478216:0:14383:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787440374.478228:0:14383:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787440374.478230:0:14383:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1787440374.478236:0:14383:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1787440374.478239:0:14383:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787440374.478252:0:14383:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff8ee0774599b8) 00000020:00000080:2.0:1787440374.478268:0:14383:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1787440374.478274:0:14383:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1787440374.478348:0:14383:0:(osd_handler.c:1564:osd_obd_connect()) connect #2 00000020:00000080:2.0:1787440374.478355:0:14383:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x85f5fa77adf3d2de 00000020:00000080:2.0:1787440374.478775:0:14383:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1787440374.478780:0:14383:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787440374.478784:0:14383:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787440374.478786:0:14383:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1787440374.478789:0:14383:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787440374.478792:0:14383:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787440374.478794:0:14383:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1787440374.478797:0:14383:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787440374.478805:0:14383:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff8ee07745cd28) 00000020:00000080:2.0:1787440374.478815:0:14383:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1787440374.478819:0:14383:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1787440374.478821:0:14383:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1787440374.478824:0:14383:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1787440374.478830:0:14383:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1787440374.478871:0:14383:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8ee0438d0800 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1787440374.478892:0:14383:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff8ee080454d28) 00000020:00000080:2.0:1787440374.478901:0:14383:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1787440374.478956:0:14383:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1787440374.478962:0:14383:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x85f5fa77adf3d2f3 00000020:00000080:2.0:1787440374.479045:0:14383:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1787440374.479051:0:14383:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1787440374.479055:0:14383:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x85f5fa77adf3d2fa 00080000:01000000:2.0:1787440374.479060:0:14383:0:(osd_handler.c:1564:osd_obd_connect()) connect #3 00000020:00000080:2.0:1787440374.479063:0:14383:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x85f5fa77adf3d301 00010000:00010000:2.0:1787440374.554854:0:14383:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:2.0:1787440374.555231:0:14383:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967527 00000001:00080000:2.0:1787440374.555391:0:14383:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1787440374.556114:0:14383:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff8ee080450000) 00000020:00000080:2.0:1787440374.556131:0:14383:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1787440374.556208:0:14383:0:(osd_handler.c:1564:osd_obd_connect()) connect #4 00000020:00000080:2.0:1787440374.556214:0:14383:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x85f5fa77adf3d30f 00000020:00000080:3.0:1787440374.557797:0:14383:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1787440374.571458:0:14383:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x85f5fa77adf3d316 00000020:00000080:3.0:1787440374.572283:0:14383:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1787440374.572295:0:14383:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787440374.572301:0:14383:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787440374.572303:0:14383:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1787440374.572306:0:14383:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1787440374.572310:0:14383:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:3.0:1787440374.572311:0:14383:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787440374.572312:0:14383:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787440374.572314:0:14383:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1787440374.572316:0:14383:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787440374.572317:0:14383:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:3.0:1787440374.572319:0:14383:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787440374.572323:0:14383:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787440374.572325:0:14383:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1787440374.572329:0:14383:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1787440374.572675:0:14383:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1787440374.572706:0:14383:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787440374.572711:0:14383:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787440374.572712:0:14383:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1787440374.572715:0:14383:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787440374.572719:0:14383:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1787440374.572723:0:14383:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787440374.572724:0:14383:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1787440374.572727:0:14383:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1787440374.572732:0:14383:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.158@tcp to nid 0x20000c0a8ce9e (192.168.206.158@tcp) 00000020:01000000:3.0:1787440374.572754:0:14383:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1787440374.572757:0:14383:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787440374.572777:0:14383:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8ee045f7cd28) 00000020:00000080:3.0:1787440374.572790:0:14383:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:3.0:1787440374.572796:0:14383:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1787440374.573455:0:14383:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1787440374.573461:0:14383:0:(osd_handler.c:1564:osd_obd_connect()) connect #5 00000020:00000080:3.0:1787440374.573468:0:14383:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x85f5fa77adf3d324 00010000:00080000:3.0:1787440374.573529:0:14383:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8ee04a5e9800@lustre-OST0000-osc-MDT0000: add connection 192.168.206.158@tcp at head 00010000:00010000:3.0:1787440374.574645:0:14383:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:3.0:1787440374.576334:0:14383:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1787440374.577239:0:14383:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1787440374.582024:0:14383:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787440374.582776:0:14383:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:3.0:1787440374.583238:0:14383:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:3.0:1787440374.587635:0:14387:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1787440374.587642:0:14387:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1787440374.589789:0:14383:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787440374.589804:0:14383:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1787440374.589843:0:14383:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1787440374.589860:0:14383:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x85f5fa77adf3d32b 00000100:00080000:2.0:1787440374.589870:0:14383:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787440374.589875:0:14383:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8ee04a5e9800 using connection 192.168.206.158@tcp/0@lo 00000100:00100000:2.0:1787440374.589913:0:14383:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ee08032ca80 x1874266701259136/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787440374.589946:0:14383:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1787440374.590015:0:14383:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787440374.590020:0:14383:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787440374.590021:0:14383:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1787440374.590025:0:14383:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1787440374.590027:0:14383:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #15 00000020:01000000:2.0:1787440374.590028:0:14383:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787440374.590030:0:14383:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787440374.590031:0:14383:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1787440374.590042:0:14383:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787440374.590044:0:14383:0:(obd_config.c:1563:class_process_config()) marker 15 (0x6) lustre sys.timeout 00000020:01000000:2.0:1787440374.590048:0:14383:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787440374.590051:0:14383:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1787440374.590055:0:14383:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787440374.590056:0:14383:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1787440374.590059:0:14383:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787440374.590063:0:14383:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.158@tcp to nid 0x20000c0a8ce9e (192.168.206.158@tcp) 00000020:01000000:2.0:1787440374.590083:0:14383:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1787440374.590086:0:14383:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787440374.590096:0:14383:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8ee080453370) 00000020:00000080:2.0:1787440374.590107:0:14383:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:2.0:1787440374.590111:0:14383:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1787440374.590161:0:14383:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1787440374.590166:0:14383:0:(osd_handler.c:1564:osd_obd_connect()) connect #6 00000020:00000080:2.0:1787440374.590171:0:14383:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x85f5fa77adf3d339 00010000:00080000:2.0:1787440374.590201:0:14383:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8ee06db94800@lustre-OST0001-osc-MDT0000: add connection 192.168.206.158@tcp at head 00000100:00100000:0.0:1787440374.590253:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee08032ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1874266701259136:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1787440374.590302:0:3308:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874266701259136 offset 0 length 520: 4 00010000:00010000:2.0:1787440374.590382:0:14383:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:2.0:1787440374.590594:0:14383:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1787440374.590615:0:14383:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1787440374.591274:0:14383:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787440374.591347:0:14383:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:2.0:1787440374.591429:0:14383:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:0.0:1787440374.592284:0:14389:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1787440374.592289:0:14389:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1787440374.598197:0:14383:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787440374.598212:0:14383:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1787440374.598249:0:14383:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1787440374.598266:0:14383:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x85f5fa77adf3d340 00000100:00080000:3.0:1787440374.598276:0:14383:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787440374.598281:0:14383:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8ee06db94800 using connection 192.168.206.158@tcp/0@lo 00000100:00100000:3.0:1787440374.598313:0:14383:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ee0776b9180 x1874266701259264/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787440374.598342:0:14383:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1787440374.598414:0:14383:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787440374.598418:0:14383:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787440374.598420:0:14383:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1787440374.598423:0:14383:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787440374.598427:0:14383:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787440374.598428:0:14383:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787440374.598431:0:14383:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787440374.598443:0:14383:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1787440374.598446:0:14383:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787440374.598448:0:14383:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787440374.598449:0:14383:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:3.0:1787440374.598452:0:14383:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787440374.598455:0:14383:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787440374.598456:0:14383:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1787440374.598459:0:14383:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1787440374.598525:0:14383:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee0776b8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c:14383:1874266701259392:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787440374.598871:0:14383:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440374.598909:0:14383:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee042d78480 going to sleep for 11 seconds 00000100:00100000:0.0:1787440374.599163:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee0776b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1874266701259264:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1787440374.599208:0:3308:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874266701259264 offset 0 length 520: 4 00000100:00100000:2.0:1787440374.601605:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701259392 00000100:00100000:2.0:1787440374.601619:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701259392 00000100:00100000:2.0:1787440374.601676:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787440374.601695:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04cac5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+9:14383:x1874266701259392:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787440374.601956:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04cac5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+9:14383:x1874266701259392:12345-0@lo:502:llog_process_th.0 Request processed in 262us (3085us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440374.601964:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787440374.602744:0:14383:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee0776b8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c:14383:1874266701259392:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787440374.602781:0:14383:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787440374.602789:0:14383:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787440374.602790:0:14383:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1787440374.602795:0:14383:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:1.0:1787440374.605219:0:14347:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:1.0:1787440374.605249:0:14347:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.158@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1787440374.605276:0:14347:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.158@tcp lock: ffff8ee07fb9f600/0x85f5fa77adf3d2c9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3d2d0 expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440374.605287:0:14347:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.158@tcp lock: ffff8ee07fb9f600/0x85f5fa77adf3d2c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3d2d0 expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787440374.605296:0:14347:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8ee0438d0800 from 1 10000000:01000000:1.0:1787440374.605298:0:14347:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787440374.605336:0:14347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.158@tcp lock: ffff8ee07fb9f200/0x85f5fa77adf3d347 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440374.605360:0:14347:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.158@tcp lock: ffff8ee07fb9f200/0x85f5fa77adf3d347 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440374.605371:0:14347:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.158@tcp lock: ffff8ee07fb9f200/0x85f5fa77adf3d347 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440374.605395:0:14347:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee050481f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c:14347:1874266701259520:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787440374.605458:0:14347:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440374.605533:0:14347:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee047d4c3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787440374.606021:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701259520 00000100:00100000:2.0:1787440374.606029:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701259520 00000100:00100000:2.0:1787440374.606076:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787440374.606085:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee08092b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+9:14347:x1874266701259520:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787440374.606099:0:14360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440374.606113:0:14360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ee07f86fc00/0x85f5fa77adf3d34e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x85f5fa77adf3d347 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440374.606151:0:14360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ee07f86fc00/0x85f5fa77adf3d34e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x85f5fa77adf3d347 expref: 10 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440374.606162:0:14360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ee07f86fc00/0x85f5fa77adf3d34e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f5fa77adf3d347 expref: 10 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440374.606171:0:14360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee07f86fc00, rc 0) 00000100:00100000:2.0:1787440374.606223:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee08092b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+10:14347:x1874266701259520:12345-0@lo:101:mount.lustre.0 Request processed in 139us (766us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440374.606230:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787440374.606391:0:14347:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee050481f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c:14347:1874266701259520:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787440374.606405:0:14347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.158@tcp lock: ffff8ee07fb9f200/0x85f5fa77adf3d347 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3d34e expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440374.606415:0:14347:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.158@tcp lock: ffff8ee07fb9f200/0x85f5fa77adf3d347 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x85f5fa77adf3d34e expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440374.607018:0:14347:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee050481f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c:14347:1874266701259648:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1787440374.607062:0:14347:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440374.607094:0:14347:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee047d4c3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787440374.607163:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701259648 00000100:00100000:3.0:1787440374.607169:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701259648 00000100:00100000:3.0:1787440374.607198:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787440374.607205:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee08092b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+10:14347:x1874266701259648:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1787440374.607219:0:14358:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1787440374.607225:0:14358:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1787440374.607289:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee08092b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+10:14347:x1874266701259648:12345-0@lo:256:mount.lustre.0 Request processed in 84us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440374.607296:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787440374.607321:0:14347:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee050481f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c:14347:1874266701259648:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1787440374.607925:0:14347:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.158@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787440374.608154:0:14347:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.158@tcp lock: ffff8ee07fb9f200/0x85f5fa77adf3d347 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3d34e expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440374.608165:0:14347:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.158@tcp lock: ffff8ee07fb9f200/0x85f5fa77adf3d347 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3d34e expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787440374.608206:0:14347:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8ee0438d0800 from 1 10000000:01000000:1.0:1787440374.608209:0:14347:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787440374.608235:0:14347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.158@tcp lock: ffff8ee07fb9fe00/0x85f5fa77adf3d355 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440374.608242:0:14347:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.158@tcp lock: ffff8ee07fb9fe00/0x85f5fa77adf3d355 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440374.608252:0:14347:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.158@tcp lock: ffff8ee07fb9fe00/0x85f5fa77adf3d355 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440374.608266:0:14347:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee050481f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c:14347:1874266701259776:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787440374.608298:0:14347:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440374.608327:0:14347:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee047d4c3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787440374.608444:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701259776 00000100:00100000:3.0:1787440374.608450:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701259776 00000100:00100000:3.0:1787440374.608489:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787440374.608518:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee08092a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+10:14347:x1874266701259776:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787440374.608536:0:14357:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440374.608619:0:14357:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ee049e94800/0x85f5fa77adf3d35c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x85f5fa77adf3d355 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440374.608639:0:14357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ee049e94800/0x85f5fa77adf3d35c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x85f5fa77adf3d355 expref: 11 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440374.608649:0:14357:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ee049e94800/0x85f5fa77adf3d35c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f5fa77adf3d355 expref: 11 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440374.608657:0:14357:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee049e94800, rc 0) 00000100:00100000:3.0:1787440374.608719:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee08092a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+11:14347:x1874266701259776:12345-0@lo:101:mount.lustre.0 Request processed in 204us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440374.608726:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787440374.608945:0:14347:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee050481f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c:14347:1874266701259776:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787440374.608957:0:14347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.158@tcp lock: ffff8ee07fb9fe00/0x85f5fa77adf3d355 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3d35c expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440374.608964:0:14347:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.158@tcp lock: ffff8ee07fb9fe00/0x85f5fa77adf3d355 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x85f5fa77adf3d35c expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440374.609011:0:14347:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee050481f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c:14347:1874266701259904:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787440374.609111:0:14347:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440374.609226:0:14347:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee047d4c3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787440374.618297:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701259904 00000100:00100000:3.0:1787440374.618311:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701259904 00000100:00100000:3.0:1787440374.618363:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787440374.618373:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee08092ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+11:14347:x1874266701259904:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787440374.618877:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee08092ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+11:14347:x1874266701259904:12345-0@lo:501:mount.lustre.0 Request processed in 504us (9764us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440374.618887:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787440374.618987:0:14347:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee050481f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c:14347:1874266701259904:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787440374.619033:0:14347:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee050481f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c:14347:1874266701260032:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787440374.619093:0:14347:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440374.619135:0:14347:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee047d4c3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787440374.619830:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701260032 00000100:00100000:3.0:1787440374.619838:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701260032 00000100:00100000:3.0:1787440374.619883:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787440374.619891:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee08092bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+11:14347:x1874266701260032:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787440374.620068:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee08092bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+11:14347:x1874266701260032:12345-0@lo:503:mount.lustre.0 Request processed in 178us (975us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440374.620085:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787440374.620281:0:14347:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee050481f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c:14347:1874266701260032:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787440374.645900:0:14391:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee08032c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c:14391:1874266701260160:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787440374.645986:0:14391:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440374.646045:0:14391:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee047f96c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787440374.646253:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701260160 00000100:00100000:3.0:1787440374.646260:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701260160 00000100:00100000:3.0:1787440374.646303:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787440374.646312:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee080929c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+11:14391:x1874266701260160:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787440374.646708:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee080929c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+11:14391:x1874266701260160:12345-0@lo:502:llog_process_th.0 Request processed in 389us (715us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440374.646717:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787440374.646797:0:14391:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee08032c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c:14391:1874266701260160:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787440374.646824:0:14391:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787440374.646833:0:14391:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787440374.646835:0:14391:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1787440374.646842:0:14391:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8ee0438d0800 00000020:00000080:2.0:1787440374.646845:0:14391:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787440374.646852:0:14391:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787440374.646855:0:14391:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787440374.646861:0:14391:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1787440374.646864:0:14391:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787440374.646867:0:14391:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787440374.646869:0:14391:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1787440374.646872:0:14391:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8ee0438d0800 00000020:00000080:2.0:1787440374.646874:0:14391:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787440374.646930:0:14391:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787440374.646934:0:14391:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787440374.646936:0:14391:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1787440374.646938:0:14391:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787440374.646941:0:14391:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787440374.646942:0:14391:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787440374.646946:0:14391:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8ee0438d0800 00000020:00000080:2.0:1787440374.646948:0:14391:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787440374.646983:0:14391:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee08032c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c:14391:1874266701260288:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787440374.647133:0:14391:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440374.647161:0:14391:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee047f96c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787440374.647268:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701260288 00000100:00100000:3.0:1787440374.647273:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701260288 00000100:00100000:3.0:1787440374.647344:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787440374.647352:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee080928450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+11:14391:x1874266701260288:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787440374.647518:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee080928450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+11:14391:x1874266701260288:12345-0@lo:502:llog_process_th.0 Request processed in 166us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440374.647525:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787440374.647594:0:14391:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee08032c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c:14391:1874266701260288:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787440374.647611:0:14391:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787440374.647615:0:14391:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787440374.647616:0:14391:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1787440374.647620:0:14391:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1787440374.652432:0:14347:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:1.0:1787440374.652464:0:14347:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.158@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787440374.652489:0:14347:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.158@tcp lock: ffff8ee07fb9fe00/0x85f5fa77adf3d355 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3d35c expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440374.652525:0:14347:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.158@tcp lock: ffff8ee07fb9fe00/0x85f5fa77adf3d355 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3d35c expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787440374.652640:0:14347:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1787440374.652644:0:14347:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8ee0438d0800 10000000:01000000:1.0:1787440374.652647:0:14347:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8ee0438d0800 10000000:01000000:1.0:1787440374.652651:0:14347:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787440374.652657:0:14347:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8ee0438d0800 from 1 10000000:01000000:1.0:1787440374.652659:0:14347:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787440374.653003:0:14347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.158@tcp lock: ffff8ee07fb9e400/0x85f5fa77adf3d363 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440374.653013:0:14347:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.158@tcp lock: ffff8ee07fb9e400/0x85f5fa77adf3d363 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440374.653024:0:14347:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.158@tcp lock: ffff8ee07fb9e400/0x85f5fa77adf3d363 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440374.653056:0:14347:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee050481f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c:14347:1874266701260416:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787440374.653115:0:14347:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440374.653279:0:14347:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee045ed5000 going to sleep for 11 seconds 00000100:00100000:0.0:1787440374.653360:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701260416 00000100:00100000:0.0:1787440374.653377:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701260416 00000100:00100000:0.0:1787440374.653423:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787440374.653432:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee080928850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+11:14347:x1874266701260416:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787440374.653449:0:14358:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440374.653462:0:14358:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ee04cbcf400/0x85f5fa77adf3d36a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x85f5fa77adf3d363 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440374.653483:0:14358:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ee04cbcf400/0x85f5fa77adf3d36a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x85f5fa77adf3d363 expref: 12 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440374.653516:0:14358:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ee04cbcf400/0x85f5fa77adf3d36a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f5fa77adf3d363 expref: 12 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440374.653525:0:14358:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee04cbcf400, rc 0) 00000100:00100000:0.0:1787440374.653910:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee080928850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+12:14347:x1874266701260416:12345-0@lo:101:mount.lustre.0 Request processed in 478us (793us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440374.653917:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787440374.653997:0:14347:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee050481f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c:14347:1874266701260416:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787440374.654012:0:14347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.158@tcp lock: ffff8ee07fb9e400/0x85f5fa77adf3d363 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3d36a expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440374.654022:0:14347:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.158@tcp lock: ffff8ee07fb9e400/0x85f5fa77adf3d363 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x85f5fa77adf3d36a expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440374.654206:0:14347:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee050481f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c:14347:1874266701260544:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787440374.654234:0:14347:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440374.654264:0:14347:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee045ed5000 going to sleep for 11 seconds 00000100:00100000:0.0:1787440374.654312:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701260544 00000100:00100000:0.0:1787440374.654317:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701260544 00000100:00100000:0.0:1787440374.654352:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787440374.654419:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee08092a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+12:14347:x1874266701260544:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787440374.654900:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee08092a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+12:14347:x1874266701260544:12345-0@lo:501:mount.lustre.0 Request processed in 539us (663us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440374.654908:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787440374.655002:0:14347:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee050481f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c:14347:1874266701260544:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787440374.655031:0:14347:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee050481f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c:14347:1874266701260672:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787440374.655215:0:14347:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440374.655232:0:14347:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee045ed5000 going to sleep for 11 seconds 00000100:00100000:0.0:1787440374.655285:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701260672 00000100:00100000:0.0:1787440374.655290:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701260672 00000100:00100000:0.0:1787440374.655323:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787440374.655330:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee08092b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+12:14347:x1874266701260672:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787440374.655825:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee08092b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+12:14347:x1874266701260672:12345-0@lo:503:mount.lustre.0 Request processed in 493us (607us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440374.655841:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787440374.659542:0:14347:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee050481f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c:14347:1874266701260672:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787440374.661228:0:14395:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee08032c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c:14395:1874266701260800:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787440374.661302:0:14395:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440374.661383:0:14395:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee047f96cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787440374.669711:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701260800 00000100:00100000:3.0:1787440374.669726:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701260800 00000100:00100000:3.0:1787440374.669780:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787440374.669789:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee080929850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+12:14395:x1874266701260800:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787440374.670348:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee080929850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+12:14395:x1874266701260800:12345-0@lo:502:llog_process_th.0 Request processed in 558us (9044us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440374.670358:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787440374.670888:0:14395:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee08032c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c:14395:1874266701260800:0@lo:502:llog_process_th.0 00000020:01000004:3.0:1787440374.670956:0:14395:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1787440374.670971:0:14395:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff8ee045f7b370) 00000020:00000080:3.0:1787440374.670996:0:14395:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:3.0:1787440374.671178:0:14395:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8ee0438d0800 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1787440374.671183:0:14395:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8ee0438d0800 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1787440374.671185:0:14395:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8ee0438d0800 4 00010000:00080000:3.0:1787440374.671216:0:14395:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8ee04a5ed000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.206.158@tcp at head 00010000:00010000:3.0:1787440374.678026:0:14395:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:3.0:1787440374.678219:0:14395:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1787440374.678253:0:14395:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787440374.678266:0:14395:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x85f5fa77adf3d378 00000100:00080000:3.0:1787440374.678275:0:14395:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787440374.678281:0:14395:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8ee04a5ed000 using connection 192.168.206.158@tcp/0@lo 00000100:00100000:3.0:1787440374.678314:0:14395:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ee0776b8a80 x1874266701260928/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787440374.678343:0:14395:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1787440374.678378:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787440374.678382:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787440374.678385:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787440374.678387:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787440374.678463:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee0776b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874266701260928:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787440374.678620:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440374.680858:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701260928 00000100:00100000:0.0:1787440374.680869:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701260928 00000100:00100000:0.0:1787440374.680924:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787440374.680932:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee07f9f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3308:x1874266701260928:12345-0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787440374.681017:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee07f9f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3308:x1874266701260928:12345-0@lo:38:llog_process_th.0 Request processed in 84us (2397us total) trans 0 rc -11/-11 00000100:00100000:0.0:1787440374.681024:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787440374.681076:0:3308:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787440374.681084:0:3308:0:(import.c:65:import_set_state_nolock()) ffff8ee04a5ed000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787440374.681088:0:3308:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1787440374.681091:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee0776b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874266701260928:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787440374.681123:0:14395:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee08032d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c:14395:1874266701261056:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787440374.681174:0:14395:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440374.681209:0:14395:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee047f96d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787440374.681266:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701261056 00000100:00100000:0.0:1787440374.681270:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701261056 00000100:00100000:0.0:1787440374.681306:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787440374.681313:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee08092a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+12:14395:x1874266701261056:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787440374.682805:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee08092a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+12:14395:x1874266701261056:12345-0@lo:502:llog_process_th.0 Request processed in 1486us (1625us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440374.683028:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787440374.683846:0:14395:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee08032d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c:14395:1874266701261056:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1787440374.683887:0:14395:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1787440374.684292:0:14347:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1787440374.684314:0:14347:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.158@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787440374.684329:0:14347:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.158@tcp lock: ffff8ee07fb9e400/0x85f5fa77adf3d363 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3d36a expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440374.684339:0:14347:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.158@tcp lock: ffff8ee07fb9e400/0x85f5fa77adf3d363 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3d36a expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1787440374.684380:0:14347:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1787440374.684382:0:14347:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787440374.684383:0:14347:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787440374.684384:0:14347:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787440374.684389:0:14347:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787440374.684390:0:14347:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787440374.684391:0:14347:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787440374.684392:0:14347:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787440374.684394:0:14347:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787440374.684395:0:14347:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787440374.684398:0:14347:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:1.0:1787440374.684400:0:14347:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787440374.684402:0:14347:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787440374.684403:0:14347:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787440374.684403:0:14347:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787440374.684405:0:14347:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787440374.684415:0:14347:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787440374.684416:0:14347:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787440374.684417:0:14347:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787440374.684417:0:14347:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787440374.684418:0:14347:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787440374.684438:0:14347:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1787440374.684457:0:14347:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee050481f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c:14347:1874266701261184:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1787440374.690245:0:14347:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440374.690291:0:14347:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee045ed53c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787440374.690973:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701261184 00000100:00100000:3.0:1787440374.690981:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701261184 00000100:00100000:3.0:1787440374.691033:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787440374.691043:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee080928c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+12:14347:x1874266701261184:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1787440374.691083:0:14360:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1787440374.691096:0:14360:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1787440374.772160:0:14360:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1787440374.772171:0:14360:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1787440374.772179:0:14381:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787440374.772184:0:14381:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787440374.772204:0:14381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8ee04cbcfc00/0x85f5fa77adf3d37f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440374.772243:0:14381:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ee07f86fc00/0x85f5fa77adf3d34e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f5fa77adf3d347 expref: 12 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440374.772252:0:14381:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8ee04cbcfc00/0x85f5fa77adf3d37f lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440374.772288:0:14381:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ee07f86fc00/0x85f5fa77adf3d34e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x85f5fa77adf3d347 expref: 12 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440374.772303:0:14381:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ee07f86fc00/0x85f5fa77adf3d34e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x85f5fa77adf3d347 expref: 12 pid: 14360 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440374.772318:0:14381:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee07f9f1500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14381:1874266701261312:0@lo:104: 00000100:00100000:0.0:1787440374.772380:0:14381:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440374.772420:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701261312 00000100:00100000:1.0:1787440374.772427:0:14348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701261312 00000100:00100000:0.0:1787440374.772427:0:14381:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee0460eb300 going to sleep for 11 seconds 00000100:00100000:1.0:1787440374.772478:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787440374.772488:0:14348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee07f9f0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+3:14381:x1874266701261312:12345-0@lo:104: 00010000:00010000:1.0:1787440374.772523:0:14348:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.158@tcp lock: ffff8ee07fb9f200/0x85f5fa77adf3d347 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x85f5fa77adf3d34e expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440374.772574:0:14348:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787440374.772581:0:14348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee07f9f0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+3:14381:x1874266701261312:12345-0@lo:104: Request processed in 96us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440374.772587:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1787440374.772608:0:14354:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787440374.772613:0:14354:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.158@tcp lock: ffff8ee07fb9f200/0x85f5fa77adf3d347 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x85f5fa77adf3d34e expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440374.772626:0:14354:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee07fb9f200 already unused, calling callback (ffffffffc1bd2c20) 10000000:00010000:1.0:1787440374.772630:0:14354:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.158@tcp lock: ffff8ee07fb9f200/0x85f5fa77adf3d347 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x85f5fa77adf3d34e expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440374.772638:0:14354:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.158@tcp lock: ffff8ee07fb9f200/0x85f5fa77adf3d347 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x85f5fa77adf3d34e expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787440374.772646:0:14354:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.158@tcp lock: ffff8ee07fb9f200/0x85f5fa77adf3d347 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x85f5fa77adf3d34e expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787440374.772651:0:14354:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787440374.772692:0:14354:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.158@tcp lock: ffff8ee07fb9f200/0x85f5fa77adf3d347 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x85f5fa77adf3d34e expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440374.772705:0:14354:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787440374.772723:0:14354:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.158@tcp lock: ffff8ee07fb9f200/0x85f5fa77adf3d347 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x85f5fa77adf3d34e expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440374.772730:0:14354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.158@tcp lock: ffff8ee07fb9f200/0x85f5fa77adf3d347 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x85f5fa77adf3d34e expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440374.772743:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee050483480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c:3309:1874266701261440:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787440374.772744:0:14354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787440374.772746:0:14354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787440374.772747:0:14354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787440374.772770:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440374.772780:0:14381:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee07f9f1500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14381:1874266701261312:0@lo:104: 00010000:00010000:1.0:1787440374.772796:0:14381:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8ee04cbcfc00/0x85f5fa77adf3d37f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440374.772823:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701261440 00000100:00100000:1.0:1787440374.772832:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701261440 00010000:00010000:1.0:1787440374.772848:0:14350:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ee07f86fc00/0x85f5fa77adf3d34e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x85f5fa77adf3d347 expref: 13 pid: 14360 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440374.772877:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787440374.772883:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee07f9f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+13:3309:x1874266701261440:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787440374.772893:0:14350:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787440374.772897:0:14350:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ee07f86fc00/0x85f5fa77adf3d34e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x85f5fa77adf3d347 expref: 13 pid: 14360 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440374.772907:0:14350:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ee07f86fc00/0x85f5fa77adf3d34e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x85f5fa77adf3d347 expref: 13 pid: 14360 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440374.772919:0:14350:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ee07f86fc00/0x85f5fa77adf3d34e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x85f5fa77adf3d347 expref: 13 pid: 14360 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440374.772932:0:14350:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8ee04cbcfc00/0x85f5fa77adf3d37f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440374.772939:0:14350:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ee04cbcfc00/0x85f5fa77adf3d37f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787440374.772949:0:14350:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000766297s 00010000:00010000:1.0:1787440374.772953:0:14350:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ee04cbcfc00/0x85f5fa77adf3d37f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440374.772959:0:14350:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ee04cbcfc00/0x85f5fa77adf3d37f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440374.772965:0:14350:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8ee04cbcfc00/0x85f5fa77adf3d37f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440374.772980:0:14350:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8ee04cbcfc00/0x85f5fa77adf3d37f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440374.772986:0:14350:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee04cbcfc00 already unused, calling callback (ffffffffc15b52a0) 00010000:00010000:1.0:1787440374.772990:0:14350:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8ee04cbcfc00/0x85f5fa77adf3d37f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440374.772997:0:14350:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8ee04cbcfc00/0x85f5fa77adf3d37f lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440374.773007:0:14350:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8ee04cbcfc00/0x85f5fa77adf3d37f lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440374.773016:0:14350:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787440374.773045:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee07f9f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+12:3309:x1874266701261440:12345-0@lo:103:ldlm_bl.0 Request processed in 162us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440374.773052:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787440374.773076:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee050483480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c:3309:1874266701261440:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787440374.773640:0:14381:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8ee04cbcfc00/0x85f5fa77adf3d37f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440374.773649:0:14381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8ee04cbcfc00/0x85f5fa77adf3d37f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440374.773656:0:14381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ee04cbcfc00/0x85f5fa77adf3d37f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440374.793212:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee080928c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+11:14347:x1874266701261184:12345-0@lo:253:mount.lustre.0 Request processed in 102164us (102965us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440374.793228:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787440374.794943:0:14347:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee050481f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c:14347:1874266701261184:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787440374.794959:0:14347:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1787440374.794962:0:14347:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787440374.794964:0:14347:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787440374.794965:0:14347:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787440374.794966:0:14347:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787440374.794967:0:14347:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787440374.794969:0:14347:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787440374.794970:0:14347:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787440374.794971:0:14347:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787440374.794973:0:14347:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787440374.794974:0:14347:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1787440374.794988:0:14347:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1787440374.816777:0:14347:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:3.0:1787440374.816928:0:14347:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1787440374.817164:0:14347:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:3.0:1787440374.817317:0:14347:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1787440374.817995:0:14347:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:3.0:1787440374.818131:0:14347:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:3.0:1787440374.823425:0:14347:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:3.0:1787440374.823788:0:14347:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:3.0:1787440374.825415:0:14347:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:0.0:1787440374.831370:0:14347:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:0.0:1787440374.834029:0:14347:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:0.0:1787440374.834220:0:14347:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:1.0:1787440374.880026:0:14347:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:0.0:1787440374.880586:0:14347:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:1.0:1787440374.880743:0:14403:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:1.0:1787440374.880747:0:14403:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:2.0:1787440374.881208:0:14404:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:2.0:1787440374.881281:0:14404:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787440374.890385:0:14404:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1787440374.890456:0:14404:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1787440374.890460:0:14404:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:01000000:0.0:1787440374.892268:0:14347:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1787440374.892570:0:14347:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1787440374.893244:0:14347:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1787440374.893254:0:14347:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1787440374.894448:0:14347:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787440374.896874:0:14347:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1787440374.902464:0:14347:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1787440374.906318:0:14347:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:1.0:1787440374.910760:0:14347:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:1.0:1787440374.925878:0:14347:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:0.0:1787440374.973617:0:14347:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1787440374.973669:0:14347:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffba9600c8f988 00100000:10000000:0.0:1787440374.973688:0:14347:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1787440374.977388:0:14347:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1787440374.977554:0:14347:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.158@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1787440374.977816:0:14347:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:1.0:1787440374.977834:0:14347:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:1.0:1787440375.325043:0:14353:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787440375.709447:0:14399:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:0.0:1787440375.964606:0:14362:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787440375.964614:0:14362:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8ee0438d0800 from 6 10000000:01000000:0.0:1787440375.964620:0:14362:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787440375.964681:0:14362:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.158@tcp lock: ffff8ee04cbcea00/0x85f5fa77adf3d386 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440375.964704:0:14362:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.158@tcp lock: ffff8ee04cbcea00/0x85f5fa77adf3d386 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440375.964716:0:14362:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.158@tcp lock: ffff8ee04cbcea00/0x85f5fa77adf3d386 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440375.964742:0:14362:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee07f9f0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c:14362:1874266701261568:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787440375.964805:0:14362:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440375.964859:0:14362:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee0460eb300 going to sleep for 11 seconds 00000100:00100000:2.0:1787440375.964925:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701261568 00000100:00100000:2.0:1787440375.964932:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701261568 00000100:00100000:2.0:1787440375.964982:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787440375.964991:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee05fb9b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+11:14362:x1874266701261568:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787440375.965015:0:14358:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440375.965028:0:14358:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ee07f86f800/0x85f5fa77adf3d38d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x85f5fa77adf3d386 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440375.965049:0:14358:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ee07f86f800/0x85f5fa77adf3d38d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x85f5fa77adf3d386 expref: 12 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440375.965059:0:14358:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ee07f86f800/0x85f5fa77adf3d38d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f5fa77adf3d386 expref: 12 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440375.965068:0:14358:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee07f86f800, rc 0) 00000100:00100000:2.0:1787440375.965113:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee05fb9b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+12:14362:x1874266701261568:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 123us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440375.965120:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787440375.965397:0:14362:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee07f9f0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c:14362:1874266701261568:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787440375.965411:0:14362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.158@tcp lock: ffff8ee04cbcea00/0x85f5fa77adf3d386 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3d38d expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440375.965421:0:14362:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.158@tcp lock: ffff8ee04cbcea00/0x85f5fa77adf3d386 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x85f5fa77adf3d38d expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440375.965481:0:14362:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee0776ba300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c:14362:1874266701261696:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1787440375.965611:0:14362:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440375.965730:0:14362:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee049e0ae40 going to sleep for 11 seconds 00000100:00100000:0.0:1787440375.965821:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701261696 00000100:00100000:0.0:1787440375.965826:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701261696 00000100:00100000:0.0:1787440375.965860:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787440375.965867:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee05fb9b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+12:14362:x1874266701261696:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1787440375.965880:0:14360:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787440375.965895:0:14360:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787440375.965898:0:14360:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:0.0:1787440375.966092:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee05fb9b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+12:14362:x1874266701261696:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 224us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440375.966099:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787440375.966174:0:14362:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee0776ba300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c:14362:1874266701261696:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1787440375.966217:0:14362:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.158@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787440375.966224:0:14362:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.158@tcp lock: ffff8ee04cbcea00/0x85f5fa77adf3d386 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3d38d expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440375.966232:0:14362:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.158@tcp lock: ffff8ee04cbcea00/0x85f5fa77adf3d386 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3d38d expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440376.349339:0:14354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787440376.735049:0:14399:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787440377.378857:0:14353:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787440378.397925:0:14354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787440379.175591:0:14646:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg658-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1787440379.425786:0:14353:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787440379.806173:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787440379.806201:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787440379.806204:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787440379.806207:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787440379.806209:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1787440379.806212:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787440379.806216:0:8:0:(import.c:65:import_set_state_nolock()) ffff8ee04a5ed000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787440379.806227:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8ee04a5ed000 using connection 192.168.206.158@tcp/0@lo 00000100:00100000:0.0:1787440379.806251:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ee07f9f1880 x1874266701261952/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787440379.806340:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee07f9f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c:3310:1874266701261824:0@lo:400:kworker.0 00000100:00100000:3.0:1787440379.806413:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440379.806797:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701261824 00000100:00100000:0.0:1787440379.806805:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701261824 00000100:00100000:0.0:1787440379.806854:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787440379.806863:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee05fb99450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+12:3310:x1874266701261824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787440379.806932:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee05fb99450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+12:3310:x1874266701261824:12345-0@lo:400:kworker.0 Request processed in 69us (518us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440379.806939:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787440379.808718:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee07f9f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874266701261952:0@lo:38:kworker.0 00000100:00100000:2.0:1787440379.808779:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440379.808982:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee07f9f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c:3310:1874266701261824:0@lo:400:kworker.0 00000100:00100000:0.0:1787440379.809117:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701261952 00000100:00100000:0.0:1787440379.809123:0:14367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701261952 00000100:00100000:0.0:1787440379.809160:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787440379.809166:0:14367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee08032d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3308:x1874266701261952:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1787440379.809190:0:14367:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 478 last 0 00000020:00000080:0.0:1787440379.809224:0:14367:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x85f5fa77adf3d394 00000004:00100000:0.0:1787440379.809238:0:14367:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787440379.809361:0:14367:0:(import.c:65:import_set_state_nolock()) ffff8ee06d8d9000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787440379.809478:0:14367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee08032d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874266701261952:12345-0@lo:38:kworker.0 Request processed in 310us (698us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440379.809485:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1787440379.811675:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8ee07f9f1880 x1874266701261952/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787440389 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787440379.811696:0:3308:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1787440379.811704:0:3308:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1787440379.811709:0:3308:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1787440379.811712:0:3308:0:(import.c:65:import_set_state_nolock()) ffff8ee04a5ed000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787440379.811719:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee07f9f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874266701261952:0@lo:38:kworker.0 00010000:00010000:1.0:1787440380.445068:0:14354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787440381.469600:0:14353:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787440382.114971:0:14798:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffef479b250 20000000:00000080:0.0:1787440382.114987:0:14798:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8ee07cb8f000 uarg=0000000000000000 20000000:01000000:0.0:1787440382.115017:0:14798:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1787440382.115024:0:14798:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1787440382.115028:0:14798:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1787440382.115782:0:14799:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:0.0:1787440382.115918:0:14798:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:0.0:1787440382.126899:0:14798:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1787440382.126929:0:14798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8ee04cbcee00/0x85f5fa77adf3d39b lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440382.126948:0:14798:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ee049e94800/0x85f5fa77adf3d35c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f5fa77adf3d355 expref: 11 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440382.126957:0:14798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8ee04cbcee00/0x85f5fa77adf3d39b lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440382.126999:0:14798:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ee049e94800/0x85f5fa77adf3d35c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x85f5fa77adf3d355 expref: 11 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440382.127013:0:14798:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ee049e94800/0x85f5fa77adf3d35c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x85f5fa77adf3d355 expref: 11 pid: 14357 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440382.127027:0:14798:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee07f9f3b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14798:1874266701262080:0@lo:104: 00000100:00100000:0.0:1787440382.127091:0:14798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440382.127151:0:14798:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee079953a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787440382.127548:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701262080 00000100:00100000:1.0:1787440382.127563:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701262080 00000100:00100000:1.0:1787440382.127619:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787440382.127629:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee07f9f3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+3:14798:x1874266701262080:12345-0@lo:104: 00010000:00010000:1.0:1787440382.127657:0:14349:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.158@tcp lock: ffff8ee07fb9fe00/0x85f5fa77adf3d355 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x85f5fa77adf3d35c expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440382.127723:0:14349:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787440382.127729:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee07f9f3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+3:14798:x1874266701262080:12345-0@lo:104: Request processed in 102us (638us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440382.127737:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:2.0:1787440382.127901:0:14354:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787440382.127908:0:14354:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.158@tcp lock: ffff8ee07fb9fe00/0x85f5fa77adf3d355 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x85f5fa77adf3d35c expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440382.127931:0:14354:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee07fb9fe00 already unused, calling callback (ffffffffc1bd2c20) 10000000:00010000:2.0:1787440382.127935:0:14354:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.158@tcp lock: ffff8ee07fb9fe00/0x85f5fa77adf3d355 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x85f5fa77adf3d35c expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440382.127945:0:14354:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.158@tcp lock: ffff8ee07fb9fe00/0x85f5fa77adf3d355 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x85f5fa77adf3d35c expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787440382.127952:0:14354:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.158@tcp lock: ffff8ee07fb9fe00/0x85f5fa77adf3d355 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x85f5fa77adf3d35c expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787440382.127958:0:14354:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787440382.127986:0:14354:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.158@tcp lock: ffff8ee07fb9fe00/0x85f5fa77adf3d355 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x85f5fa77adf3d35c expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440382.127992:0:14354:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787440382.128019:0:14354:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.158@tcp lock: ffff8ee07fb9fe00/0x85f5fa77adf3d355 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x85f5fa77adf3d35c expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440382.128027:0:14354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.158@tcp lock: ffff8ee07fb9fe00/0x85f5fa77adf3d355 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x85f5fa77adf3d35c expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440382.128043:0:14354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787440382.128045:0:14354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787440382.128047:0:14354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787440382.128087:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee08032fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c:3311:1874266701262208:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787440382.128121:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440382.129220:0:14798:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee07f9f3b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14798:1874266701262080:0@lo:104: 00010000:00010000:0.0:1787440382.129243:0:14798:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8ee04cbcee00/0x85f5fa77adf3d39b lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440382.129561:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701262208 00000100:00100000:2.0:1787440382.129569:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701262208 00010000:00010000:2.0:1787440382.129725:0:14351:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ee049e94800/0x85f5fa77adf3d35c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x85f5fa77adf3d355 expref: 12 pid: 14357 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440382.129763:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787440382.129777:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee050483480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+12:3311:x1874266701262208:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787440382.129790:0:14351:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787440382.129796:0:14351:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ee049e94800/0x85f5fa77adf3d35c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x85f5fa77adf3d355 expref: 12 pid: 14357 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440382.129807:0:14351:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ee049e94800/0x85f5fa77adf3d35c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x85f5fa77adf3d355 expref: 12 pid: 14357 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440382.129824:0:14351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ee049e94800/0x85f5fa77adf3d35c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x85f5fa77adf3d355 expref: 12 pid: 14357 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440382.129838:0:14351:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8ee04cbcee00/0x85f5fa77adf3d39b lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440382.129845:0:14351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ee04cbcee00/0x85f5fa77adf3d39b lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440382.129859:0:14351:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ee04cbcee00/0x85f5fa77adf3d39b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440382.129866:0:14351:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ee04cbcee00/0x85f5fa77adf3d39b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440382.129872:0:14351:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8ee04cbcee00/0x85f5fa77adf3d39b lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440382.129877:0:14351:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8ee04cbcee00/0x85f5fa77adf3d39b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440382.129883:0:14351:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee04cbcee00 already unused, calling callback (ffffffffc15b52a0) 00010000:00010000:2.0:1787440382.129886:0:14351:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8ee04cbcee00/0x85f5fa77adf3d39b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440382.129900:0:14351:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8ee04cbcee00/0x85f5fa77adf3d39b lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440382.133567:0:14798:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8ee04cbcee00/0x85f5fa77adf3d39b lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440382.133567:0:14351:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8ee04cbcee00/0x85f5fa77adf3d39b lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440382.133593:0:14798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8ee04cbcee00/0x85f5fa77adf3d39b lrc: 2/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440382.133601:0:14798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ee04cbcee00/0x85f5fa77adf3d39b lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440382.133601:0:14351:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787440382.133824:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee050483480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+11:3311:x1874266701262208:12345-0@lo:103:ldlm_bl.0 Request processed in 4045us (5699us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440382.133835:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787440382.137306:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee08032fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c:3311:1874266701262208:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787440382.492731:0:14353:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787440383.520735:0:14354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787440383.644775:0:14362:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787440383.644782:0:14362:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8ee0438d0800 from 10 10000000:01000000:3.0:1787440383.644786:0:14362:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787440383.644828:0:14362:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.158@tcp lock: ffff8ee049e95200/0x85f5fa77adf3d3a2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440383.644839:0:14362:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.158@tcp lock: ffff8ee049e95200/0x85f5fa77adf3d3a2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440383.644851:0:14362:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.158@tcp lock: ffff8ee049e95200/0x85f5fa77adf3d3a2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440383.644874:0:14362:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee0776ba300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c:14362:1874266701262336:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787440383.644949:0:14362:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440383.644995:0:14362:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee049e0ad80 going to sleep for 11 seconds 00000100:00100000:0.0:1787440383.645108:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701262336 00000100:00100000:0.0:1787440383.645115:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701262336 00000100:00100000:0.0:1787440383.645165:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787440383.645175:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee05fb99050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+11:14362:x1874266701262336:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787440383.645187:0:14360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440383.645201:0:14360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ee04cbcf200/0x85f5fa77adf3d3a9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x85f5fa77adf3d3a2 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440383.645220:0:14360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ee04cbcf200/0x85f5fa77adf3d3a9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x85f5fa77adf3d3a2 expref: 12 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440383.645230:0:14360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ee04cbcf200/0x85f5fa77adf3d3a9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f5fa77adf3d3a2 expref: 12 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440383.645238:0:14360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee04cbcf200, rc 0) 00000100:00100000:0.0:1787440383.645286:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee05fb99050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+12:14362:x1874266701262336:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 112us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440383.645293:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787440383.645401:0:14362:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee0776ba300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c:14362:1874266701262336:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787440383.645413:0:14362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.158@tcp lock: ffff8ee049e95200/0x85f5fa77adf3d3a2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3d3a9 expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440383.645422:0:14362:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.158@tcp lock: ffff8ee049e95200/0x85f5fa77adf3d3a2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x85f5fa77adf3d3a9 expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440383.645517:0:14362:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee0776ba300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c:14362:1874266701262464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787440383.645544:0:14362:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440383.645562:0:14362:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee049e0ad80 going to sleep for 11 seconds 00000100:00100000:0.0:1787440383.645646:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701262464 00000100:00100000:0.0:1787440383.645650:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701262464 00000100:00100000:0.0:1787440383.645679:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787440383.645686:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee05fb98c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+12:14362:x1874266701262464:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787440383.645916:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee05fb98c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+12:14362:x1874266701262464:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 230us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440383.645922:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787440383.646054:0:14362:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee0776ba300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c:14362:1874266701262464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787440383.646083:0:14362:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee0776ba300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c:14362:1874266701262592:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787440383.646130:0:14362:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440383.646156:0:14362:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee049e0ad80 going to sleep for 11 seconds 00000100:00100000:1.0:1787440383.646199:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701262592 00000100:00100000:1.0:1787440383.646203:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701262592 00000100:00100000:1.0:1787440383.646232:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787440383.646239:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee05fb98050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+12:14362:x1874266701262592:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787440383.646380:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee05fb98050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+12:14362:x1874266701262592:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 141us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440383.646386:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787440383.646460:0:14362:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee0776ba300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c:14362:1874266701262592:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787440383.647335:0:14866:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1787440383.650991:0:14362:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1787440383.651020:0:14362:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.158@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787440383.651030:0:14362:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.158@tcp lock: ffff8ee049e95200/0x85f5fa77adf3d3a2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3d3a9 expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440383.651040:0:14362:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.158@tcp lock: ffff8ee049e95200/0x85f5fa77adf3d3a2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3d3a9 expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440384.549037:0:14353:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787440384.924772:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787440384.924779:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787440384.924781:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787440384.924784:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787440384.924961:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee0776ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c:3312:1874266701262720:0@lo:400:kworker.0 00000100:00100000:1.0:1787440384.925037:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440384.925105:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee0776b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874266701262848:0@lo:400:kworker.0 00000100:00100000:1.0:1787440384.925137:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440384.925186:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701262848 00000100:00100000:1.0:1787440384.925193:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701262848 00000100:00100000:1.0:1787440384.925234:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787440384.925243:0:14366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee050482d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874266701262848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440384.925289:0:14366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee050482d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874266701262848:12345-0@lo:400:kworker.0 Request processed in 47us (151us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440384.925297:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1787440384.925336:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8ee0776b9c00 x1874266701262848/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787440400 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787440384.925360:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee0776b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874266701262848:0@lo:400:kworker.0 00000100:00100000:3.0:1787440384.926486:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701262720 00000100:00100000:3.0:1787440384.926519:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701262720 00000100:00100000:3.0:1787440384.926557:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787440384.926564:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee05fb9a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+12:3312:x1874266701262720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440384.926621:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee05fb9a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+12:3312:x1874266701262720:12345-0@lo:400:kworker.0 Request processed in 58us (1584us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440384.926639:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787440384.928032:0:3308:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787440374/real 1787440374] req@ffff8ee0776b9180 x1874266701259264/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787440384 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787440384.928055:0:3308:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8ee0776b9180 x1874266701259264/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787440384 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787440384.928065:0:3308:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787440374/real 1787440374] req@ffff8ee08032ca80 x1874266701259136/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787440384 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787440384.928075:0:3308:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8ee08032ca80 x1874266701259136/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787440384 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787440384.928090:0:3308:0:(import.c:65:import_set_state_nolock()) ffff8ee06db94800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787440384.928110:0:3308:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787440384.928114:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee0776b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1874266701259264:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1787440384.928120:0:3308:0:(import.c:65:import_set_state_nolock()) ffff8ee04a5e9800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787440384.928125:0:3308:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787440384.928128:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee08032ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1874266701259136:0@lo:8:llog_process_th.0 00000100:00100000:1.0:1787440384.928185:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee0776ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c:3312:1874266701262720:0@lo:400:kworker.0 00000100:00080000:3.0:1787440384.929059:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787440384.929065:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1787440384.929079:0:8:0:(import.c:65:import_set_state_nolock()) ffff8ee04a5e9800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787440384.929085:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 472 00000100:00080000:3.0:1787440384.929089:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787440384.929095:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8ee04a5e9800 using connection 192.168.206.158@tcp/0@lo 00000100:00100000:3.0:1787440384.929126:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ee0776ba300 x1874266701262976/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787440384.929150:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787440384.929154:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1787440384.929156:0:8:0:(import.c:65:import_set_state_nolock()) ffff8ee06db94800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787440384.929159:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 472 00000100:00080000:3.0:1787440384.929161:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787440384.929164:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8ee06db94800 using connection 192.168.206.158@tcp/0@lo 00000100:00100000:3.0:1787440384.929175:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ee0776b9180 x1874266701263104/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787440384.929684:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee0776ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1874266701262976:0@lo:8:kworker.0 00000400:00000100:2.0:1787440384.929735:0:3308:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874266701262976 offset 0 length 520: 4 00000100:00100000:2.0:1787440384.929782:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee0776b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1874266701263104:0@lo:8:kworker.0 00000400:00000100:2.0:1787440384.929802:0:3308:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874266701263104 offset 0 length 520: 4 00010000:00010000:0.0:1787440385.565609:0:14354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787440386.588611:0:14353:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787440386.973145:0:14399:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:01000004:1.0:1787440386.986988:0:15047:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1787440386.986991:0:15047:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:1.0:1787440386.987089:0:15047:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8ee07c2d3800 00000020:01000004:1.0:1787440386.987102:0:15047:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1787440386.987113:0:15047:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1787440386.987123:0:15047:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8ee04a7e3370) 00000020:00000080:1.0:1787440386.987137:0:15047:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1787440387.002449:0:15047:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1787440387.002886:0:15047:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1787440387.003805:0:15047:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1787440387.004017:0:15047:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:3.0:1787440387.004196:0:15047:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1787440387.004724:0:15047:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 533: rc = 0 00100000:10000000:3.0:1787440387.004813:0:15047:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 533: rc = 0 00100000:10000000:3.0:1787440387.004898:0:15047:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 533: rc = 0 00100000:10000000:3.0:1787440387.005382:0:15047:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 407: rc = 0 00100000:10000000:3.0:1787440387.005759:0:15047:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 407: rc = 0 00100000:10000000:3.0:1787440387.006031:0:15047:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 407: rc = 0 00100000:10000000:3.0:1787440387.006276:0:15047:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 407: rc = 0 00100000:10000000:3.0:1787440387.006759:0:15047:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 407: rc = 0 00100000:10000000:3.0:1787440387.007900:0:15047:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 407: rc = 0 00000020:00000080:3.0:1787440387.008677:0:15047:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1787440387.008688:0:15047:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787440387.008697:0:15047:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x85f5fa77adf3d3b7 00000020:01000004:3.0:1787440387.008705:0:15047:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:3.0:1787440387.008725:0:15047:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.158@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1787440387.008729:0:15047:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.158@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1787440387.008735:0:15047:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1787440387.008739:0:15047:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1787440387.008750:0:15047:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8ee045f78000) 00000020:00000080:3.0:1787440387.008759:0:15047:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:3.0:1787440387.009838:0:15047:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787440387.010016:0:15047:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1787440387.010024:0:15047:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1787440387.012870:0:15047:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1787440387.012880:0:15047:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:1.0:1787440387.013260:0:15047:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:1.0:1787440387.013266:0:15047:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1787440387.015044:0:15047:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787440387.015251:0:15047:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1787440387.015256:0:15047:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1787440387.017661:0:15047:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1787440387.017674:0:15047:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1787440387.035136:0:15047:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787440387.035368:0:15047:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1787440387.035374:0:15047:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1787440387.037160:0:15047:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1787440387.037173:0:15047:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1787440387.038014:0:15047:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1787440387.038022:0:15047:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1787440387.039819:0:15047:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787440387.039985:0:15047:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1787440387.039990:0:15047:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1787440387.041063:0:15047:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1787440387.041072:0:15047:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:1.0:1787440387.081044:0:15047:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787440387.081263:0:15047:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:1.0:1787440387.081271:0:15047:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:1.0:1787440387.082365:0:15047:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:1.0:1787440387.082376:0:15047:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:1.0:1787440387.082907:0:15047:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:1.0:1787440387.082931:0:15047:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:1.0:1787440387.082938:0:15047:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.158@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:1.0:1787440387.101250:0:15047:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.158@tcp ctxt 0 is initialized 00000020:01000004:1.0:1787440387.101309:0:15047:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.206.158@tcp, index=0000, flags=0x20002 00000020:01000004:1.0:1787440387.101314:0:15047:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1787440387.101316:0:15047:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787440387.101317:0:15047:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787440387.101318:0:15047:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787440387.101319:0:15047:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787440387.101321:0:15047:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787440387.101323:0:15047:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787440387.101325:0:15047:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787440387.101326:0:15047:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787440387.101335:0:15047:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:1.0:1787440387.101337:0:15047:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787440387.101338:0:15047:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787440387.101339:0:15047:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787440387.101339:0:15047:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787440387.101341:0:15047:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787440387.101341:0:15047:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787440387.101342:0:15047:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787440387.101343:0:15047:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787440387.101344:0:15047:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787440387.101371:0:15047:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1787440387.101401:0:15047:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee050482680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c:15047:1874266701263232:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1787440387.101470:0:15047:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440387.101826:0:15047:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee080443cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787440387.101978:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701263232 00000100:00100000:2.0:1787440387.101986:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701263232 00000100:00100000:2.0:1787440387.102070:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787440387.102080:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee05fb9ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+12:15047:x1874266701263232:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1787440387.102113:0:14358:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1787440387.102117:0:14358:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:2.0:1787440387.102121:0:14358:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1787440387.115939:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee05fb9ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+12:15047:x1874266701263232:12345-0@lo:253:mount.lustre.0 Request processed in 13851us (14459us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440387.115954:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787440387.116049:0:15047:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee050482680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c:15047:1874266701263232:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1787440387.116064:0:15047:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1787440387.116067:0:15047:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787440387.116069:0:15047:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787440387.116070:0:15047:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787440387.116072:0:15047:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787440387.116073:0:15047:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787440387.116074:0:15047:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787440387.116076:0:15047:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787440387.116078:0:15047:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787440387.116079:0:15047:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1787440387.116100:0:15047:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8ee07c2d3800 from lustre-OST0000 10000000:01000000:1.0:1787440387.116212:0:15047:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1787440387.116215:0:15047:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1787440387.116221:0:15047:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8ee07745b370 local copy 00010000:00010000:1.0:1787440387.116231:0:15047:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.158@tcp lock: ffff8ee07f86f000/0x85f5fa77adf3d2ad lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3d2b4 expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440387.116440:0:15047:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee050482680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c:15047:1874266701263360:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787440387.116476:0:15047:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440387.117109:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701263360 00000100:00100000:2.0:1787440387.117116:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701263360 00000100:00100000:2.0:1787440387.117202:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787440387.117211:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee05fb9bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+12:15047:x1874266701263360:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787440387.119032:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee05fb9bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+12:15047:x1874266701263360:12345-0@lo:501:mount.lustre.0 Request processed in 1816us (2549us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787440387.119054:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787440387.119154:0:15047:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee080443900 going to sleep for 11 seconds 00000100:00100000:1.0:1787440387.119177:0:15047:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee050482680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c:15047:1874266701263360:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1787440387.119196:0:15047:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.158@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1787440387.119944:0:15047:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.158@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1787440387.119955:0:15047:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.158@tcp lock: ffff8ee07f86f000/0x85f5fa77adf3d2ad lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3d2b4 expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440387.119967:0:15047:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.158@tcp lock: ffff8ee07f86f000/0x85f5fa77adf3d2ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3d2b4 expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787440387.119995:0:15047:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8ee07c2d3800 10000000:01000000:1.0:1787440387.120000:0:15047:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1787440387.120005:0:15047:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8ee07745b370 10000000:01000000:1.0:1787440387.120007:0:15047:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1787440387.120010:0:15047:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8ee07745b370 from 1 10000000:01000000:1.0:1787440387.120013:0:15047:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1787440387.120045:0:15047:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.158@tcp lock: ffff8ee07fb9f200/0x85f5fa77adf3d3c5 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440387.120054:0:15047:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.158@tcp lock: ffff8ee07fb9f200/0x85f5fa77adf3d3c5 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440387.120065:0:15047:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.158@tcp lock: ffff8ee07fb9f200/0x85f5fa77adf3d3c5 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440387.120086:0:15047:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee050482680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c:15047:1874266701263488:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787440387.120132:0:15047:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440387.120226:0:15047:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee080443900 going to sleep for 11 seconds 00000100:00100000:0.0:1787440387.120742:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701263488 00000100:00100000:0.0:1787440387.120749:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701263488 00000100:00100000:2.0:1787440387.120906:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787440387.120916:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee05fb99c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+12:15047:x1874266701263488:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787440387.120929:0:14358:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440387.120942:0:14358:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ee07f86fc00/0x85f5fa77adf3d3cc lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x85f5fa77adf3d3c5 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440387.120964:0:14358:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ee07f86fc00/0x85f5fa77adf3d3cc lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x85f5fa77adf3d3c5 expref: 13 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440387.120974:0:14358:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ee07f86fc00/0x85f5fa77adf3d3cc lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f5fa77adf3d3c5 expref: 13 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440387.120981:0:14358:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee07f86fc00, rc 0) 00000100:00100000:2.0:1787440387.121033:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee05fb99c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+13:15047:x1874266701263488:12345-0@lo:101:mount.lustre.0 Request processed in 119us (900us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440387.121040:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787440387.121111:0:15047:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee050482680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c:15047:1874266701263488:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787440387.121134:0:15047:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.158@tcp lock: ffff8ee07fb9f200/0x85f5fa77adf3d3c5 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3d3cc expref: -99 pid: 15047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440387.121144:0:15047:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.158@tcp lock: ffff8ee07fb9f200/0x85f5fa77adf3d3c5 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x85f5fa77adf3d3cc expref: -99 pid: 15047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787440387.121162:0:15047:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.158@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1787440387.121179:0:15047:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.158@tcp lock: ffff8ee07fb9f200/0x85f5fa77adf3d3c5 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3d3cc expref: -99 pid: 15047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440387.121185:0:15047:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.158@tcp lock: ffff8ee07fb9f200/0x85f5fa77adf3d3c5 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3d3cc expref: -99 pid: 15047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787440387.121192:0:15047:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1787440387.121196:0:15047:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787440387.121200:0:15047:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1787440387.121202:0:15047:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1787440387.121219:0:15047:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.158@tcp lock: ffff8ee07fb9e000/0x85f5fa77adf3d3d3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440387.121231:0:15047:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.158@tcp lock: ffff8ee07fb9e000/0x85f5fa77adf3d3d3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440387.121238:0:15047:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.158@tcp lock: ffff8ee07fb9e000/0x85f5fa77adf3d3d3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440387.121252:0:15047:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee050482680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c:15047:1874266701263616:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787440387.121292:0:15047:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440387.121723:0:15047:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee080443900 going to sleep for 11 seconds 00000100:00100000:3.0:1787440387.121819:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701263616 00000100:00100000:3.0:1787440387.121825:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701263616 00000100:00100000:3.0:1787440387.121853:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787440387.121861:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee05fb98450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+13:15047:x1874266701263616:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787440387.121870:0:14360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440387.121881:0:14360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ee049e94600/0x85f5fa77adf3d3da lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x85f5fa77adf3d3d3 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440387.121897:0:14360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ee049e94600/0x85f5fa77adf3d3da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x85f5fa77adf3d3d3 expref: 14 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440387.121906:0:14360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ee049e94600/0x85f5fa77adf3d3da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f5fa77adf3d3d3 expref: 14 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440387.121924:0:14360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee049e94600, rc 0) 00000100:00100000:3.0:1787440387.121964:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee05fb98450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+14:15047:x1874266701263616:12345-0@lo:101:mount.lustre.0 Request processed in 104us (672us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440387.121971:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787440387.122058:0:15047:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee050482680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c:15047:1874266701263616:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787440387.122070:0:15047:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.158@tcp lock: ffff8ee07fb9e000/0x85f5fa77adf3d3d3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3d3da expref: -99 pid: 15047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440387.122078:0:15047:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.158@tcp lock: ffff8ee07fb9e000/0x85f5fa77adf3d3d3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x85f5fa77adf3d3da expref: -99 pid: 15047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787440387.123164:0:15047:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:0.0:1787440387.129931:0:15047:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787440387.130216:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:0.0:1787440387.130263:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:0.0:1787440387.130817:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:0.0:1787440387.130874:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:0.0:1787440387.130910:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:0.0:1787440387.130941:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:0.0:1787440387.131009:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:0.0:1787440387.131017:0:15047:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:0.0:1787440387.131108:0:15047:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee07f9f3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c:15047:1874266701263744:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787440387.131174:0:15047:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440387.131221:0:15047:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee07fb23b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787440387.131720:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701263744 00000100:00100000:3.0:1787440387.131728:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701263744 00000100:00100000:3.0:1787440387.131825:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787440387.131835:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee05fb98850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+14:15047:x1874266701263744:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787440387.132186:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee05fb98850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+14:15047:x1874266701263744:12345-0@lo:501:mount.lustre.0 Request processed in 352us (1011us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440387.132195:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787440387.132289:0:15047:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee07f9f3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c:15047:1874266701263744:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787440387.132338:0:15047:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee07f9f3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c:15047:1874266701263872:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787440387.132379:0:15047:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440387.132826:0:15047:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee07fb23b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787440387.132926:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701263872 00000100:00100000:2.0:1787440387.132932:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701263872 00000100:00100000:2.0:1787440387.132961:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787440387.132967:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee05fb9a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+14:15047:x1874266701263872:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787440387.133563:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee05fb9a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+14:15047:x1874266701263872:12345-0@lo:503:mount.lustre.0 Request processed in 593us (1181us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440387.133571:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787440387.133761:0:15047:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee07f9f3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c:15047:1874266701263872:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1787440387.134258:0:15047:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787440387.134833:0:15047:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee07f9f3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c:15047:1874266701264000:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787440387.134896:0:15047:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440387.134974:0:15047:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee07fb23b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787440387.135014:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701264000 00000100:00100000:2.0:1787440387.135020:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701264000 00000100:00100000:2.0:1787440387.135111:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787440387.135127:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee05fb9b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+14:15047:x1874266701264000:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787440387.135789:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee05fb9b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+14:15047:x1874266701264000:12345-0@lo:502:mount.lustre.0 Request processed in 661us (890us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440387.135799:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787440387.135889:0:15047:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee07f9f3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c:15047:1874266701264000:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787440387.136165:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:0.0:1787440387.136229:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:0.0:1787440387.136267:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:0.0:1787440387.136337:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:0.0:1787440387.136377:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:0.0:1787440387.136423:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:0.0:1787440387.136470:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:0.0:1787440387.136527:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:0.0:1787440387.136560:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:0.0:1787440387.136630:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:0.0:1787440387.136668:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:0.0:1787440387.136715:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:0.0:1787440387.136755:0:15047:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee07f9f3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c:15047:1874266701264128:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787440387.136809:0:15047:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440387.137513:0:15047:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee07fb23b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787440387.137691:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701264128 00000100:00100000:3.0:1787440387.137700:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701264128 00000100:00100000:3.0:1787440387.137741:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787440387.137750:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee05fb99850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+14:15047:x1874266701264128:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787440387.137940:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee05fb99850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+14:15047:x1874266701264128:12345-0@lo:502:mount.lustre.0 Request processed in 191us (1131us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440387.137947:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787440387.138047:0:15047:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee07f9f3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c:15047:1874266701264128:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787440387.138137:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:0.0:1787440387.138150:0:15047:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:0.0:1787440387.139260:0:15061:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787440387.139280:0:15061:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:0.0:1787440387.139287:0:15061:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787440387.139289:0:15061:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1787440387.139294:0:15061:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787440387.139324:0:15061:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8ee080060000) 00000020:00000080:0.0:1787440387.139346:0:15061:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:0.0:1787440387.139352:0:15061:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1787440387.139751:0:15061:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8ee07c2d3800 from lustre-OST0000, refs=2 00080000:01000000:3.0:1787440387.139760:0:15061:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787440387.139768:0:15061:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x85f5fa77adf3d3e8 00010000:00010000:3.0:1787440387.147160:0:15061:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:3.0:1787440387.147879:0:15061:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:3.0:1787440387.152309:0:15061:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:3.0:1787440387.156379:0:15061:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1787440387.156403:0:15061:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787440387.156415:0:15061:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787440387.156417:0:15061:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1787440387.156421:0:15061:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1787440387.156424:0:15061:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #16 00000020:01000000:3.0:1787440387.156425:0:15061:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787440387.156426:0:15061:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787440387.156428:0:15061:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1787440387.156430:0:15061:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787440387.156431:0:15061:0:(obd_config.c:1563:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:3.0:1787440387.156433:0:15061:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787440387.156436:0:15061:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787440387.156438:0:15061:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787440387.156441:0:15061:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787440387.156442:0:15061:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1787440387.156445:0:15061:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787440387.156447:0:15061:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787440387.156448:0:15061:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:3.0:1787440387.156450:0:15061:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787440387.156452:0:15061:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787440387.156453:0:15061:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1787440387.156456:0:15061:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1787440387.156560:0:15061:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787440387.156564:0:15061:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787440387.156566:0:15061:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1787440387.156569:0:15061:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:1.0:1787440387.158039:0:15047:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:1.0:1787440387.158080:0:15047:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.158@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1787440387.158099:0:15047:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.158@tcp lock: ffff8ee07fb9e000/0x85f5fa77adf3d3d3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3d3da expref: -99 pid: 15047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440387.158112:0:15047:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.158@tcp lock: ffff8ee07fb9e000/0x85f5fa77adf3d3d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3d3da expref: -99 pid: 15047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787440387.158121:0:15047:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8ee07c2d3800 from 1 10000000:01000000:1.0:1787440387.158124:0:15047:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787440387.158162:0:15047:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.158@tcp lock: ffff8ee07fb9f400/0x85f5fa77adf3d3ef lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440387.158170:0:15047:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.158@tcp lock: ffff8ee07fb9f400/0x85f5fa77adf3d3ef lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440387.158183:0:15047:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.158@tcp lock: ffff8ee07fb9f400/0x85f5fa77adf3d3ef lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440387.158209:0:15047:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee050482680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c:15047:1874266701264256:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787440387.158277:0:15047:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440387.158343:0:15047:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee080443780 going to sleep for 11 seconds 00000100:00100000:3.0:1787440387.158585:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701264256 00000100:00100000:3.0:1787440387.158592:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701264256 00000100:00100000:3.0:1787440387.158697:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787440387.158722:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee07b940c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+14:15047:x1874266701264256:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787440387.158736:0:14360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440387.158749:0:14360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ee049e95800/0x85f5fa77adf3d3f6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x85f5fa77adf3d3ef expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440387.158772:0:14360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ee049e95800/0x85f5fa77adf3d3f6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x85f5fa77adf3d3ef expref: 15 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440387.158792:0:14360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ee049e95800/0x85f5fa77adf3d3f6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f5fa77adf3d3ef expref: 15 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440387.158800:0:14360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee049e95800, rc 0) 00000100:00100000:3.0:1787440387.158844:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee07b940c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+15:15047:x1874266701264256:12345-0@lo:101:mount.lustre.0 Request processed in 124us (566us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440387.158851:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787440387.160480:0:15047:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee050482680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c:15047:1874266701264256:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787440387.161538:0:15047:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.158@tcp lock: ffff8ee07fb9f400/0x85f5fa77adf3d3ef lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3d3f6 expref: -99 pid: 15047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440387.161553:0:15047:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.158@tcp lock: ffff8ee07fb9f400/0x85f5fa77adf3d3ef lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x85f5fa77adf3d3f6 expref: -99 pid: 15047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787440387.162977:0:15047:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1787440387.163653:0:15047:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787440387.163905:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1787440387.163947:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1787440387.164007:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1787440387.164016:0:15047:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1787440387.164106:0:15047:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee050482680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c:15047:1874266701264384:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787440387.164172:0:15047:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440387.165114:0:15047:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee080443780 going to sleep for 11 seconds 00000100:00100000:2.0:1787440387.180192:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701264384 00000100:00100000:2.0:1787440387.180208:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701264384 00000100:00100000:2.0:1787440387.180255:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787440387.180264:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee07b943450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+15:15047:x1874266701264384:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787440387.180575:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee07b943450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+15:15047:x1874266701264384:12345-0@lo:501:mount.lustre.0 Request processed in 311us (16402us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440387.180582:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787440387.180853:0:15047:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee050482680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c:15047:1874266701264384:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787440387.180903:0:15047:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee050482680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c:15047:1874266701264512:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787440387.180950:0:15047:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440387.180986:0:15047:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee080443780 going to sleep for 11 seconds 00000100:00100000:2.0:1787440387.181048:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701264512 00000100:00100000:2.0:1787440387.181053:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701264512 00000100:00100000:2.0:1787440387.181086:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787440387.181093:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee07b943850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+15:15047:x1874266701264512:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787440387.181238:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee07b943850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+15:15047:x1874266701264512:12345-0@lo:503:mount.lustre.0 Request processed in 144us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440387.181245:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787440387.184434:0:15047:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee050482680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c:15047:1874266701264512:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787440387.185118:0:15047:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787440387.185195:0:15047:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee050482680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c:15047:1874266701264640:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787440387.185263:0:15047:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440387.185719:0:15047:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee080443780 going to sleep for 11 seconds 00000100:00100000:3.0:1787440387.187973:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701264640 00000100:00100000:3.0:1787440387.187985:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701264640 00000100:00100000:3.0:1787440387.188032:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787440387.188041:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee07b941450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+15:15047:x1874266701264640:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787440387.188544:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee07b941450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+15:15047:x1874266701264640:12345-0@lo:502:mount.lustre.0 Request processed in 503us (3280us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440387.188553:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787440387.188798:0:15047:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee050482680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c:15047:1874266701264640:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787440387.189069:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1787440387.189124:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1787440387.189172:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1787440387.189208:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1787440387.189237:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1787440387.189949:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1787440387.189996:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1787440387.190022:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:1.0:1787440387.190060:0:15047:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee050482680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c:15047:1874266701264768:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787440387.190116:0:15047:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440387.190189:0:15047:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee080443780 going to sleep for 11 seconds 00000100:00100000:0.0:1787440387.191455:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701264768 00000100:00100000:0.0:1787440387.191466:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701264768 00000100:00100000:0.0:1787440387.192410:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787440387.192424:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee07b941050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+15:15047:x1874266701264768:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787440387.192905:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee07b941050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+15:15047:x1874266701264768:12345-0@lo:502:mount.lustre.0 Request processed in 484us (2786us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440387.192913:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787440387.193011:0:15047:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee050482680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c:15047:1874266701264768:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787440387.193158:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:1.0:1787440387.193175:0:15047:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:1.0:1787440387.194176:0:15065:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787440387.194186:0:15065:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787440387.194188:0:15065:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1787440387.194195:0:15065:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8ee07c2d3800 00000020:00000080:1.0:1787440387.194198:0:15065:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787440387.194205:0:15065:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787440387.194207:0:15065:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787440387.194209:0:15065:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1787440387.194211:0:15065:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787440387.194214:0:15065:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787440387.194215:0:15065:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1787440387.194219:0:15065:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8ee07c2d3800 00000020:00000080:1.0:1787440387.194221:0:15065:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787440387.194358:0:15065:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787440387.194363:0:15065:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787440387.194364:0:15065:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1787440387.194367:0:15065:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787440387.194375:0:15065:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787440387.194377:0:15065:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787440387.194381:0:15065:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8ee07c2d3800 00000020:00000080:1.0:1787440387.194383:0:15065:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787440387.209722:0:15065:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787440387.209736:0:15065:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787440387.209739:0:15065:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1787440387.209746:0:15065:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:2.0:1787440387.209819:0:15047:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1787440387.209839:0:15047:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.158@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787440387.209856:0:15047:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.158@tcp lock: ffff8ee07fb9f400/0x85f5fa77adf3d3ef lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3d3f6 expref: -99 pid: 15047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440387.209887:0:15047:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.158@tcp lock: ffff8ee07fb9f400/0x85f5fa77adf3d3ef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3d3f6 expref: -99 pid: 15047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787440387.209943:0:15047:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787440387.209947:0:15047:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8ee07c2d3800 10000000:01000000:2.0:1787440387.209950:0:15047:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8ee07c2d3800 10000000:01000000:2.0:1787440387.209954:0:15047:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787440387.209960:0:15047:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8ee07c2d3800 from 1 10000000:01000000:2.0:1787440387.209962:0:15047:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787440387.209998:0:15047:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.158@tcp lock: ffff8ee07f86fe00/0x85f5fa77adf3d3fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440387.210006:0:15047:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.158@tcp lock: ffff8ee07f86fe00/0x85f5fa77adf3d3fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440387.210017:0:15047:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.158@tcp lock: ffff8ee07f86fe00/0x85f5fa77adf3d3fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440387.210042:0:15047:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee08032c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c:15047:1874266701264896:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787440387.210105:0:15047:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440387.210149:0:15047:0:(client.c:2715:ptlrpc_set_wait()) set ffff8edf41152b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787440387.211424:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701264896 00000100:00100000:2.0:1787440387.211435:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701264896 00000100:00100000:2.0:1787440387.211484:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787440387.211507:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee07b940050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+15:15047:x1874266701264896:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787440387.211522:0:14360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440387.211537:0:14360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ee07f86f400/0x85f5fa77adf3d404 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x85f5fa77adf3d3fd expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440387.211574:0:14360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ee07f86f400/0x85f5fa77adf3d404 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x85f5fa77adf3d3fd expref: 16 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440387.211586:0:14360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ee07f86f400/0x85f5fa77adf3d404 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f5fa77adf3d3fd expref: 16 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440387.211594:0:14360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee07f86f400, rc 0) 00000100:00100000:2.0:1787440387.211669:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee07b940050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+16:15047:x1874266701264896:12345-0@lo:101:mount.lustre.0 Request processed in 177us (1564us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440387.211677:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787440387.211730:0:15047:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee08032c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c:15047:1874266701264896:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787440387.211744:0:15047:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.158@tcp lock: ffff8ee07f86fe00/0x85f5fa77adf3d3fd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3d404 expref: -99 pid: 15047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440387.211753:0:15047:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.158@tcp lock: ffff8ee07f86fe00/0x85f5fa77adf3d3fd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x85f5fa77adf3d404 expref: -99 pid: 15047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787440387.214416:0:15047:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:2.0:1787440387.214920:0:15047:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787440387.215189:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1787440387.215228:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:2.0:1787440387.215258:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:2.0:1787440387.232776:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:2.0:1787440387.232831:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:2.0:1787440387.232881:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:2.0:1787440387.232916:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:2.0:1787440387.232947:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:2.0:1787440387.232991:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:2.0:1787440387.233040:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:2.0:1787440387.233071:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:2.0:1787440387.233136:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:2.0:1787440387.233175:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:2.0:1787440387.233210:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:2.0:1787440387.234442:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:2.0:1787440387.234834:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:2.0:1787440387.234877:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:2.0:1787440387.234933:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:2.0:1787440387.234971:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:2.0:1787440387.235008:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:2.0:1787440387.235060:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:2.0:1787440387.235098:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:2.0:1787440387.235135:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:2.0:1787440387.235185:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:2.0:1787440387.235224:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:2.0:1787440387.235260:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:2.0:1787440387.237029:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:2.0:1787440387.237067:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:2.0:1787440387.237148:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:2.0:1787440387.237155:0:15047:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:2.0:1787440387.237257:0:15047:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee08032c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c:15047:1874266701265024:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787440387.238256:0:15047:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440387.238333:0:15047:0:(client.c:2715:ptlrpc_set_wait()) set ffff8edf41152b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787440387.240804:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701265024 00000100:00100000:0.0:1787440387.240816:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701265024 00000100:00100000:0.0:1787440387.240866:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787440387.240875:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee07b942450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+16:15047:x1874266701265024:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787440387.241187:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee07b942450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+16:15047:x1874266701265024:12345-0@lo:501:mount.lustre.0 Request processed in 312us (2933us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440387.241195:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787440387.241912:0:15047:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee08032c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c:15047:1874266701265024:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787440387.241962:0:15047:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee07f9f3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c:15047:1874266701265152:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787440387.242011:0:15047:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440387.242046:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701265152 00000100:00100000:0.0:1787440387.242048:0:15047:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee07fb23b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787440387.242052:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701265152 00000100:00100000:2.0:1787440387.242088:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787440387.242096:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee07b942c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+16:15047:x1874266701265152:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787440387.242317:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee07b942c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+16:15047:x1874266701265152:12345-0@lo:503:mount.lustre.0 Request processed in 222us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440387.242334:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787440387.242413:0:15047:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee07f9f3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c:15047:1874266701265152:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787440387.243251:0:15047:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787440387.243315:0:15047:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee050482680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c:15047:1874266701265280:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787440387.243451:0:15047:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440387.243490:0:15047:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee080443780 going to sleep for 11 seconds 00000100:00100000:0.0:1787440387.243677:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701265280 00000100:00100000:0.0:1787440387.243683:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701265280 00000100:00100000:0.0:1787440387.243727:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787440387.243735:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee07b943c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+16:15047:x1874266701265280:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787440387.243937:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee07b943c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+16:15047:x1874266701265280:12345-0@lo:502:mount.lustre.0 Request processed in 202us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440387.243947:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787440387.243965:0:15047:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee050482680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c:15047:1874266701265280:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787440387.244186:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1787440387.244237:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:1.0:1787440387.244274:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:1.0:1787440387.244321:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1787440387.245338:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1787440387.245417:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1787440387.245469:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:0.0:1787440387.245538:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:0.0:1787440387.245593:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1787440387.245641:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1787440387.245675:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1787440387.245720:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:0.0:1787440387.245754:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:0.0:1787440387.245788:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:0.0:1787440387.245834:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:0.0:1787440387.245865:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:0.0:1787440387.245912:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:0.0:1787440387.245959:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:0.0:1787440387.245993:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:0.0:1787440387.246026:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:0.0:1787440387.246073:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:0.0:1787440387.246110:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:0.0:1787440387.246140:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:0.0:1787440387.246183:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:0.0:1787440387.246218:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:0.0:1787440387.246251:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:0.0:1787440387.246297:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:0.0:1787440387.246333:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:0.0:1787440387.246366:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:0.0:1787440387.246414:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:0.0:1787440387.246450:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:0.0:1787440387.246482:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:0.0:1787440387.246550:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:0.0:1787440387.246602:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:0.0:1787440387.246659:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:0.0:1787440387.246699:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:0.0:1787440387.246733:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:0.0:1787440387.246759:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:0.0:1787440387.246799:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:0.0:1787440387.246841:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:0.0:1787440387.246884:0:15047:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee07f9f2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c:15047:1874266701265408:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787440387.246951:0:15047:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440387.246993:0:15047:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee07fb23540 going to sleep for 11 seconds 00000100:00100000:3.0:1787440387.247177:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701265408 00000100:00100000:3.0:1787440387.247185:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701265408 00000100:00100000:3.0:1787440387.247232:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787440387.247239:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee07b941c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+16:15047:x1874266701265408:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787440387.248134:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee07b941c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+16:15047:x1874266701265408:12345-0@lo:502:mount.lustre.0 Request processed in 892us (1180us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440387.248145:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787440387.248161:0:15047:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee07f9f2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c:15047:1874266701265408:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787440387.248259:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:0.0:1787440387.248371:0:15047:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:0.0:1787440387.250089:0:15070:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1787440387.250176:0:15070:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8ee080063370) 00000020:00000080:0.0:1787440387.250197:0:15070:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:0.0:1787440387.250671:0:15070:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8ee07c2d3800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1787440387.250676:0:15070:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8ee07c2d3800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1787440387.250679:0:15070:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8ee07c2d3800 3 00010000:00080000:0.0:1787440387.250716:0:15070:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8ee045302800@lustre-MDT0000-lwp-OST0000: add connection 192.168.206.158@tcp at head 00010000:00010000:0.0:1787440387.253060:0:15070:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:0.0:1787440387.253246:0:15070:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1787440387.253291:0:15070:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787440387.253302:0:15070:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x85f5fa77adf3d412 00000100:00080000:0.0:1787440387.253312:0:15070:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787440387.253317:0:15070:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8ee045302800 using connection 192.168.206.158@tcp/0@lo 00000100:00100000:0.0:1787440387.253350:0:15070:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ee07f9f2300 x1874266701265536/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787440387.253373:0:15070:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1787440387.253429:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee07f9f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3308:1874266701265536:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787440387.253524:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787440387.253533:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787440387.253539:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787440387.253542:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787440387.253545:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787440387.253589:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee050482680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874266701265664:0@lo:400:kworker.0 00000100:00100000:1.0:1787440387.253631:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440387.254172:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701265536 00000100:00100000:2.0:1787440387.254179:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701265536 00000100:00100000:2.0:1787440387.254205:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701265664 00000100:00100000:2.0:1787440387.254208:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701265664 00000100:00100000:2.0:1787440387.254236:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787440387.254245:0:14366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee050481500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874266701265664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787440387.254304:0:14366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee050481500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874266701265664:12345-0@lo:400:kworker.0 Request processed in 60us (672us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440387.254311:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787440387.254327:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787440387.254331:0:14366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee08032e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3308:x1874266701265536:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1787440387.254363:0:14366:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 485 last 0 00000020:00000080:2.0:1787440387.254405:0:14366:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x85f5fa77adf3d419 00000004:00100000:2.0:1787440387.254419:0:14366:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787440387.254450:0:14366:0:(import.c:65:import_set_state_nolock()) ffff8ee04acee800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787440387.254514:0:14366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee08032e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1874266701265536:12345-0@lo:38:llog_process_th.0 Request processed in 181us (991us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440387.254521:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1787440387.254556:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8ee07f9f2300 x1874266701265536/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787440397 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787440387.254566:0:3308:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787440387.254573:0:3308:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:2.0:1787440387.254587:0:3308:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1787440387.254592:0:3308:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1787440387.254594:0:3308:0:(import.c:65:import_set_state_nolock()) ffff8ee045302800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787440387.254600:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee07f9f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3308:1874266701265536:0@lo:38:llog_process_th.0 00000040:00080000:0.0:1787440387.254980:0:15070:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00010000:00080000:1.0:1787440387.255178:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8ee050482680 x1874266701265664/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787440403 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787440387.255189:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee050482680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874266701265664:0@lo:400:kworker.0 00000020:01000000:2.0:1787440387.255438:0:15047:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1787440387.255465:0:15047:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.158@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787440387.255481:0:15047:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.158@tcp lock: ffff8ee07f86fe00/0x85f5fa77adf3d3fd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3d404 expref: -99 pid: 15047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440387.255507:0:15047:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.158@tcp lock: ffff8ee07f86fe00/0x85f5fa77adf3d3fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3d404 expref: -99 pid: 15047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1787440387.255561:0:15047:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1787440387.255564:0:15047:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787440387.255565:0:15047:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787440387.255566:0:15047:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787440387.255567:0:15047:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787440387.255569:0:15047:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787440387.255570:0:15047:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787440387.255572:0:15047:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787440387.255574:0:15047:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787440387.255577:0:15047:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:2.0:1787440387.255580:0:15047:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787440387.255581:0:15047:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787440387.255583:0:15047:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787440387.255584:0:15047:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787440387.255585:0:15047:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787440387.255586:0:15047:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787440387.255587:0:15047:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787440387.255588:0:15047:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787440387.255589:0:15047:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787440387.255608:0:15047:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1787440387.255635:0:15047:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee08032f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c:15047:1874266701265792:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787440387.255695:0:15047:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440387.255741:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701265792 00000100:00100000:2.0:1787440387.255747:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701265792 00000100:00100000:2.0:1787440387.255786:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787440387.255795:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee07b940450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+16:15047:x1874266701265792:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1787440387.255828:0:14358:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1787440387.255842:0:14358:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1787440387.256249:0:15047:0:(client.c:2715:ptlrpc_set_wait()) set ffff8edf41152f00 going to sleep for 11 seconds 20000000:01000000:0.0:1787440387.299867:0:14358:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787440387.299882:0:14358:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1787440387.301101:0:14381:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1787440387.301109:0:14381:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1787440387.301130:0:14381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8ee07f86e800/0x85f5fa77adf3d420 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440387.301147:0:14381:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ee07f86f800/0x85f5fa77adf3d38d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f5fa77adf3d386 expref: 16 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440387.301155:0:14381:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8ee07f86e800/0x85f5fa77adf3d420 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440387.301192:0:14381:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ee07f86f800/0x85f5fa77adf3d38d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x85f5fa77adf3d386 expref: 16 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440387.301204:0:14381:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ee07f86f800/0x85f5fa77adf3d38d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x85f5fa77adf3d386 expref: 16 pid: 14358 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440387.301217:0:14381:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee08032f480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14381:1874266701265920:0@lo:104: 00000100:00100000:2.0:1787440387.301274:0:14381:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440387.301335:0:14381:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee049e0a480 going to sleep for 11 seconds 00000100:00100000:1.0:1787440387.301778:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701265920 00000100:00100000:1.0:1787440387.301786:0:14348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701265920 00000100:00100000:1.0:1787440387.301849:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787440387.301858:0:14348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee08032ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+3:14381:x1874266701265920:12345-0@lo:104: 00010000:00010000:1.0:1787440387.301871:0:14348:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.158@tcp lock: ffff8ee04cbcea00/0x85f5fa77adf3d386 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x85f5fa77adf3d38d expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440387.301939:0:14348:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787440387.301945:0:14348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee08032ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+3:14381:x1874266701265920:12345-0@lo:104: Request processed in 89us (671us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440387.301957:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787440387.302038:0:14381:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee08032f480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14381:1874266701265920:0@lo:104: 00010000:00010000:3.0:1787440387.302067:0:14381:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8ee07f86e800/0x85f5fa77adf3d420 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440387.302131:0:14354:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787440387.302137:0:14354:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.158@tcp lock: ffff8ee04cbcea00/0x85f5fa77adf3d386 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x85f5fa77adf3d38d expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440387.302150:0:14354:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee04cbcea00 already unused, calling callback (ffffffffc1bd2c20) 10000000:00010000:0.0:1787440387.302155:0:14354:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.158@tcp lock: ffff8ee04cbcea00/0x85f5fa77adf3d386 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x85f5fa77adf3d38d expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440387.302163:0:14354:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.158@tcp lock: ffff8ee04cbcea00/0x85f5fa77adf3d386 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x85f5fa77adf3d38d expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787440387.302170:0:14354:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.158@tcp lock: ffff8ee04cbcea00/0x85f5fa77adf3d386 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x85f5fa77adf3d38d expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787440387.302175:0:14354:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787440387.302212:0:14354:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.158@tcp lock: ffff8ee04cbcea00/0x85f5fa77adf3d386 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x85f5fa77adf3d38d expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440387.302218:0:14354:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787440387.302245:0:14354:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.158@tcp lock: ffff8ee04cbcea00/0x85f5fa77adf3d386 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x85f5fa77adf3d38d expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440387.302252:0:14354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.158@tcp lock: ffff8ee04cbcea00/0x85f5fa77adf3d386 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x85f5fa77adf3d38d expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440387.302273:0:14354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787440387.302274:0:14354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787440387.302276:0:14354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787440387.302290:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787440387.302301:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee07f9f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c:3312:1874266701266048:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787440387.302342:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440387.302427:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701266048 00000100:00100000:3.0:1787440387.302432:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701266048 00010000:00010000:3.0:1787440387.302449:0:14352:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ee07f86f800/0x85f5fa77adf3d38d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x85f5fa77adf3d386 expref: 17 pid: 14358 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440387.302480:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787440387.302487:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee07f9f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+17:3312:x1874266701266048:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787440387.302524:0:14352:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787440387.302530:0:14352:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ee07f86f800/0x85f5fa77adf3d38d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x85f5fa77adf3d386 expref: 17 pid: 14358 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440387.302541:0:14352:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ee07f86f800/0x85f5fa77adf3d38d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x85f5fa77adf3d386 expref: 17 pid: 14358 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440387.302554:0:14352:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ee07f86f800/0x85f5fa77adf3d38d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x85f5fa77adf3d386 expref: 17 pid: 14358 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440387.302573:0:14352:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8ee07f86e800/0x85f5fa77adf3d420 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440387.302581:0:14352:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ee07f86e800/0x85f5fa77adf3d420 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787440387.302596:0:14352:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001488879s 00010000:00010000:3.0:1787440387.302604:0:14352:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ee07f86e800/0x85f5fa77adf3d420 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440387.302611:0:14352:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ee07f86e800/0x85f5fa77adf3d420 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440387.302635:0:14352:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8ee07f86e800/0x85f5fa77adf3d420 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440387.302782:0:14352:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8ee07f86e800/0x85f5fa77adf3d420 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440387.302788:0:14352:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee07f86e800 already unused, calling callback (ffffffffc15b52a0) 00010000:00010000:3.0:1787440387.302791:0:14352:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8ee07f86e800/0x85f5fa77adf3d420 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440387.302798:0:14352:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8ee07f86e800/0x85f5fa77adf3d420 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440387.302813:0:14352:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8ee07f86e800/0x85f5fa77adf3d420 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440387.302823:0:14352:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787440387.302857:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee07f9f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+16:3312:x1874266701266048:12345-0@lo:103:ldlm_bl.0 Request processed in 371us (514us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440387.302864:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787440387.302895:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee07f9f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c:3312:1874266701266048:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787440387.302917:0:14381:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8ee07f86e800/0x85f5fa77adf3d420 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440387.302925:0:14381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8ee07f86e800/0x85f5fa77adf3d420 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440387.302932:0:14381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ee07f86e800/0x85f5fa77adf3d420 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440387.318489:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee07b940450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+15:15047:x1874266701265792:12345-0@lo:253:mount.lustre.0 Request processed in 62685us (62783us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440387.318560:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787440387.318671:0:15047:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee08032f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c:15047:1874266701265792:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1787440387.318694:0:15047:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1787440387.318697:0:15047:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787440387.318699:0:15047:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787440387.318700:0:15047:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787440387.318702:0:15047:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787440387.318703:0:15047:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787440387.318704:0:15047:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787440387.318706:0:15047:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787440387.318708:0:15047:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787440387.318709:0:15047:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1787440387.318722:0:15047:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1787440387.323603:0:15047:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1787440387.323782:0:15047:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1787440387.324285:0:15047:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1787440387.324440:0:15047:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1787440387.324635:0:15047:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1787440387.325133:0:15047:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1787440387.326190:0:15047:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:0.0:1787440387.385412:0:15047:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1787440387.385420:0:15047:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1787440387.385456:0:15047:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1787440387.385534:0:15047:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.158@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1787440387.385548:0:15047:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1787440387.385574:0:15047:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:3.0:1787440387.627909:0:14353:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787440388.637828:0:14354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787440388.764633:0:14362:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787440388.764640:0:14362:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8ee0438d0800 from 7 10000000:01000000:3.0:1787440388.764645:0:14362:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787440388.764693:0:14362:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.158@tcp lock: ffff8ee049e94800/0x85f5fa77adf3d427 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440388.764929:0:14362:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.158@tcp lock: ffff8ee049e94800/0x85f5fa77adf3d427 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440388.764941:0:14362:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.158@tcp lock: ffff8ee049e94800/0x85f5fa77adf3d427 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440388.764967:0:14362:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee0776b9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c:14362:1874266701266176:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787440388.765041:0:14362:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440388.765153:0:14362:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee0506cc6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787440388.765379:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701266176 00000100:00100000:0.0:1787440388.765388:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701266176 00000100:00100000:0.0:1787440388.765457:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787440388.765466:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee07b940850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+15:14362:x1874266701266176:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787440388.768468:0:14357:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440388.769619:0:14357:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ee07fb9e800/0x85f5fa77adf3d42e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x85f5fa77adf3d427 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440388.769658:0:14357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ee07fb9e800/0x85f5fa77adf3d42e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x85f5fa77adf3d427 expref: 16 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440388.769672:0:14357:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ee07fb9e800/0x85f5fa77adf3d42e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f5fa77adf3d427 expref: 16 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440388.769682:0:14357:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee07fb9e800, rc 0) 00000100:00100000:1.0:1787440388.769759:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee07b940850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+16:14362:x1874266701266176:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 4293us (4723us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440388.769768:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787440388.770132:0:14362:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee0776b9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c:14362:1874266701266176:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787440388.770152:0:14362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.158@tcp lock: ffff8ee049e94800/0x85f5fa77adf3d427 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3d42e expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440388.770162:0:14362:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.158@tcp lock: ffff8ee049e94800/0x85f5fa77adf3d427 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x85f5fa77adf3d42e expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440388.770229:0:14362:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee0776b9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c:14362:1874266701266304:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1787440388.770269:0:14362:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440388.770317:0:14362:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee0506cc6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787440388.770704:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701266304 00000100:00100000:2.0:1787440388.770712:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701266304 00000100:00100000:2.0:1787440388.770762:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787440388.770772:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee07b942050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+16:14362:x1874266701266304:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1787440388.770802:0:14358:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787440388.770819:0:14358:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787440388.770822:0:14358:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:2.0:1787440388.770909:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee07b942050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+16:14362:x1874266701266304:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 138us (639us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440388.770916:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787440388.771123:0:14362:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee0776b9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c:14362:1874266701266304:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1787440388.771180:0:14362:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.158@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787440388.771187:0:14362:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.158@tcp lock: ffff8ee049e94800/0x85f5fa77adf3d427 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3d42e expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440388.771196:0:14362:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.158@tcp lock: ffff8ee049e94800/0x85f5fa77adf3d427 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3d42e expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440389.661704:0:14353:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787440390.684724:0:14354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787440391.711033:0:14353:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787440392.607341:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787440392.607348:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787440392.607352:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787440392.607355:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787440392.607402:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee07f9f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c:3312:1874266701266432:0@lo:400:kworker.0 00000100:00100000:0.0:1787440392.607479:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440392.607973:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee07f9f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874266701266560:0@lo:400:kworker.0 00000100:00100000:1.0:1787440392.608009:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440392.608153:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787440392.608160:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee07f9f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1874266701266688:0@lo:400:kworker.0 00000100:00100000:1.0:1787440392.608190:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440392.608858:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701266432 00000100:00100000:2.0:1787440392.608866:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701266432 00000100:00100000:2.0:1787440392.608924:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787440392.608933:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee07b943050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+16:3312:x1874266701266432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787440392.608993:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee07b943050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+16:3312:x1874266701266432:12345-0@lo:400:kworker.0 Request processed in 62us (1514us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440392.609001:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787440392.609547:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee07f9f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c:3312:1874266701266432:0@lo:400:kworker.0 00000100:00100000:0.0:1787440392.610657:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701266560 00000100:00100000:0.0:1787440392.610677:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701266560 00000100:00100000:0.0:1787440392.610718:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701266688 00000100:00100000:0.0:1787440392.610721:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701266688 00000100:00100000:0.0:1787440392.610760:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787440392.610768:0:14366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee050482680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874266701266560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787440392.610852:0:14366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee050482680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874266701266560:12345-0@lo:400:kworker.0 Request processed in 84us (2842us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440392.610859:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787440392.610877:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787440392.610884:0:14366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee050483b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1874266701266688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787440392.610916:0:14366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee050483b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1874266701266688:12345-0@lo:400:kworker.0 Request processed in 33us (2725us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440392.610922:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:0.0:1787440392.610950:0:14361:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787440392.610979:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ee07f9f3b80 x1874266701266688/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787440408 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787440392.610992:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee07f9f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1874266701266688:0@lo:400:kworker.0 00010000:00080000:0.0:1787440392.611005:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ee07f9f2300 x1874266701266560/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787440408 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787440392.611013:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee07f9f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874266701266560:0@lo:400:kworker.0 00010000:00010000:3.0:1787440392.732628:0:14354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787440393.146344:0:15414:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg658-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1787440393.757442:0:14353:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787440394.780636:0:14354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787440395.804694:0:14353:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787440396.192017:0:14399:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787440396.829028:0:14354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787440397.728212:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787440397.728218:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787440397.728221:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787440397.728224:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787440397.728277:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee07f9f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c:3311:1874266701266816:0@lo:400:kworker.0 00000100:00100000:0.0:1787440397.728341:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440397.728386:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787440397.728392:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee07f9f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874266701266944:0@lo:400:kworker.0 00000100:00100000:0.0:1787440397.728415:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440397.728451:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee07f9f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1874266701267072:0@lo:400:kworker.0 00000100:00100000:0.0:1787440397.728472:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440397.728529:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701266816 00000100:00100000:0.0:1787440397.728536:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701266816 00000100:00100000:0.0:1787440397.728585:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787440397.728594:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee07b941850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+16:3311:x1874266701266816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787440397.728642:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee07b941850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+16:3311:x1874266701266816:12345-0@lo:400:kworker.0 Request processed in 49us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440397.728649:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787440397.728679:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701266944 00000100:00100000:0.0:1787440397.728683:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701266944 00000100:00100000:0.0:1787440397.728704:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701267072 00000100:00100000:0.0:1787440397.728707:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701267072 00000100:00100000:0.0:1787440397.728729:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787440397.728736:0:14366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee07f9f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874266701266944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787440397.728766:0:14366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee07f9f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874266701266944:12345-0@lo:400:kworker.0 Request processed in 31us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440397.728772:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787440397.728783:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787440397.728789:0:14366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee07f9f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1874266701267072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787440397.728820:0:14366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee07f9f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1874266701267072:12345-0@lo:400:kworker.0 Request processed in 31us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440397.728832:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:0.0:1787440397.728852:0:14361:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787440397.728890:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ee07f9f1880 x1874266701267072/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787440413 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787440397.728903:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee07f9f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1874266701267072:0@lo:400:kworker.0 00010000:00080000:0.0:1787440397.728930:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ee07f9f3b80 x1874266701266944/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787440413 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787440397.728938:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee07f9f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874266701266944:0@lo:400:kworker.0 00000100:00100000:0.0:1787440397.728946:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee07f9f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c:3311:1874266701266816:0@lo:400:kworker.0 00010000:00010000:0.0:1787440397.853544:0:14353:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787440398.876628:0:14354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787440399.525819:0:3308:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787440384/real 1787440384] req@ffff8ee0776ba300 x1874266701262976/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787440399 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787440399.525849:0:3308:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8ee0776ba300 x1874266701262976/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787440399 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787440399.525861:0:3308:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787440384/real 1787440384] req@ffff8ee0776b9180 x1874266701263104/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787440399 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787440399.525872:0:3308:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8ee0776b9180 x1874266701263104/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787440399 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787440399.525891:0:3308:0:(import.c:65:import_set_state_nolock()) ffff8ee04a5e9800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787440399.525916:0:3308:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1787440399.525920:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee0776ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1874266701262976:0@lo:8:kworker.0 00000100:00080000:2.0:1787440399.525926:0:3308:0:(import.c:65:import_set_state_nolock()) ffff8ee06db94800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787440399.525931:0:3308:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1787440399.525934:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee0776b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1874266701263104:0@lo:8:kworker.0 00000100:00080000:1.0:1787440399.526022:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787440399.526027:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1787440399.526030:0:36:0:(import.c:65:import_set_state_nolock()) ffff8ee04a5e9800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787440399.526035:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 483 00000100:00080000:1.0:1787440399.526040:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1787440399.526045:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8ee04a5e9800 using connection 192.168.206.158@tcp/0@lo 00000100:00100000:1.0:1787440399.526066:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ee050482a00 x1874266701267328/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787440399.526080:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787440399.526083:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1787440399.526085:0:36:0:(import.c:65:import_set_state_nolock()) ffff8ee06db94800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787440399.526089:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 483 00000100:00080000:1.0:1787440399.526092:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1787440399.526095:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8ee06db94800 using connection 192.168.206.158@tcp/0@lo 00000100:00100000:1.0:1787440399.526106:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ee050480700 x1874266701267456/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787440399.526356:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee050481180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c:3310:1874266701267200:0@lo:400:kworker.0 00000100:00100000:2.0:1787440399.526418:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440399.526485:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701267200 00000100:00100000:0.0:1787440399.526543:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee050483100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874266701267584:0@lo:400:kworker.0 00000100:00100000:0.0:1787440399.526590:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440399.526612:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787440399.526618:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee050480a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1874266701267712:0@lo:400:kworker.0 00000100:00100000:0.0:1787440399.526639:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440399.526667:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701267584 00000100:00100000:0.0:1787440399.526671:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701267584 00000100:00100000:0.0:1787440399.526709:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701267712 00000100:00100000:0.0:1787440399.526712:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701267712 00000100:00100000:0.0:1787440399.526741:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787440399.526750:0:14366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee07f9f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874266701267584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787440399.526801:0:14366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee07f9f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874266701267584:12345-0@lo:400:kworker.0 Request processed in 51us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440399.526808:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787440399.526833:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787440399.526840:0:14366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee07f9f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874266701267712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787440399.526888:0:14366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee07f9f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874266701267712:12345-0@lo:400:kworker.0 Request processed in 48us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440399.526895:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:0.0:1787440399.526919:0:14361:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787440399.526945:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ee050480a80 x1874266701267712/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787440415 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787440399.526958:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee050480a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1874266701267712:0@lo:400:kworker.0 00010000:00080000:0.0:1787440399.526972:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ee050483100 x1874266701267584/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787440415 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787440399.526981:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee050483100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874266701267584:0@lo:400:kworker.0 00000100:00100000:0.0:1787440399.527002:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee050482a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1874266701267328:0@lo:8:kworker.0 00000100:00100000:0.0:1787440399.527030:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440399.527076:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee050480700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1874266701267456:0@lo:8:kworker.0 00000100:00100000:0.0:1787440399.527100:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440399.527406:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701267200 00000100:00100000:2.0:1787440399.527448:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787440399.527456:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee07b122050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+16:3310:x1874266701267200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787440399.528234:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee07b122050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+16:3310:x1874266701267200:12345-0@lo:400:kworker.0 Request processed in 776us (1813us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440399.528242:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787440399.528323:0:15049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701267328 00000100:00100000:1.0:1787440399.528329:0:15049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701267328 00000100:00100000:1.0:1787440399.528352:0:15049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701267456 00000100:00100000:1.0:1787440399.528355:0:15049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701267456 00000100:00100000:1.0:1787440399.528371:0:15049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787440399.528376:0:15049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee07f9f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3308:x1874266701267328:12345-0@lo:8:kworker.0 00000100:00100000:2.0:1787440399.528400:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee050481180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c:3310:1874266701267200:0@lo:400:kworker.0 00010000:00080000:1.0:1787440399.528401:0:15049:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 497 last 0 00000020:00000080:1.0:1787440399.528436:0:15049:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x85f5fa77adf3d435 00002000:00100000:1.0:1787440399.528449:0:15049:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8ee07be1f000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113940 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1787440399.528452:0:15049:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1787440399.528455:0:15049:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1787440399.528868:0:15049:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1787440399.528891:0:15049:0:(import.c:65:import_set_state_nolock()) ffff8ee07be1b800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787440399.528955:0:15049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee07f9f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3308:x1874266701267328:12345-0@lo:8:kworker.0 Request processed in 577us (1924us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440399.528962:0:15049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787440399.528977:0:15049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787440399.528981:0:15049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee07f9f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3308:x1874266701267456:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1787440399.528992:0:15049:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787440399.529017:0:15049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee07f9f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3308:x1874266701267456:12345-0@lo:8:kworker.0 Request processed in 34us (1918us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787440399.529023:0:15049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1787440399.529381:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ee050482a00 x1874266701267328/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787440419 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787440399.529392:0:3308:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787440399.529400:0:3308:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1787440399.529409:0:3308:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1787440399.529415:0:3308:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1787440399.529418:0:3308:0:(import.c:65:import_set_state_nolock()) ffff8ee04a5e9800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1787440399.529447:0:3308:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1787440399.529453:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee050482a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1874266701267328:0@lo:8:kworker.0 00000100:00080000:2.0:1787440399.529468:0:3308:0:(import.c:65:import_set_state_nolock()) ffff8ee06db94800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787440399.529473:0:3308:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787440399.529479:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee050480700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1874266701267456:0@lo:8:kworker.0 00000004:00080000:0.0:1787440399.529516:0:14388:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x5:0x0] 00000100:00100000:0.0:1787440399.529539:0:14388:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee07f9f0000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14388:1874266701267968:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1787440399.529588:0:14388:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440399.529608:0:14388:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee04c935840 going to sleep for 11 seconds 00000100:00100000:0.0:1787440399.529621:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee07f9f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874266701267840:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787440399.529643:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440399.529702:0:15050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701267968 00000100:00100000:2.0:1787440399.529708:0:15050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701267968 00000004:00080000:1.0:1787440399.529726:0:14387:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:2.0:1787440399.529757:0:15050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787440399.529765:0:15050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee07f9f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14388:x1874266701267968:12345-0@lo:5:osp-pre-0-0.0 00000100:00080000:0.0:1787440399.529814:0:14361:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:1.0:1787440399.530100:0:14387:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 497900606438ns, next at 0ns, rc = 0 00000100:00100000:1.0:1787440399.530145:0:15052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701267840 00000100:00100000:1.0:1787440399.530149:0:15052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701267840 00000100:00100000:1.0:1787440399.530177:0:15052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787440399.530185:0:15052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee07f9f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3309:x1874266701267840:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787440399.530209:0:15052:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787440399.531171:0:15052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee07f9f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3309:x1874266701267840:12345-0@lo:13:osp-pre-0-0.0 Request processed in 984us (1524us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440399.531181:0:15052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1787440399.531239:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ee07f9f1f80 x1874266701267840/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787440415 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787440399.531266:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee07f9f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874266701267840:0@lo:13:osp-pre-0-0.0 00002000:00080000:2.0:1787440399.533876:0:15050:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:2.0:1787440399.533886:0:15050:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:2.0:1787440399.533891:0:15050:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:6 to 0x240000400:33) 00002000:00010000:2.0:1787440399.555583:0:15050:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787440399.555602:0:15050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bc5709cc/0x85f5fa77adf3d43c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440399.555618:0:15050:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=497s v=(0 0) 00010000:00010000:2.0:1787440399.555622:0:15050:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787440399.555635:0:15050:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bc5709cc/0x85f5fa77adf3d43c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440399.555652:0:15050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bc5709cc/0x85f5fa77adf3d43c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440399.555662:0:15050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bc5709cc/0x85f5fa77adf3d43c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440399.555670:0:15050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bc5709cc/0x85f5fa77adf3d43c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440399.555687:0:15050:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787440399.555700:0:14353:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787440399.555705:0:14353:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bc5709cc/0x85f5fa77adf3d43c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440399.555711:0:14353:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee07f86e600 already unused, calling callback (ffffffffc15b52a0) 00010000:00010000:2.0:1787440399.555715:0:14353:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bc5709cc/0x85f5fa77adf3d43c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440399.555724:0:14353:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bc5709cc/0x85f5fa77adf3d43c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440399.555739:0:14353:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bc5709cc/0x85f5fa77adf3d43c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440399.555758:0:14353:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bc5709cc/0x85f5fa77adf3d43c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440399.555778:0:14353:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787440399.555780:0:14353:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787440399.555781:0:14353:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787440399.556261:0:15050:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787440399.556267:0:15050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000218ff76f/0x85f5fa77adf3d443 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440399.556276:0:15050:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=497s v=(0 0) 00010000:00010000:2.0:1787440399.556280:0:15050:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787440399.556284:0:15050:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000218ff76f/0x85f5fa77adf3d443 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440399.556293:0:15050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000218ff76f/0x85f5fa77adf3d443 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440399.556301:0:15050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000218ff76f/0x85f5fa77adf3d443 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440399.556308:0:15050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000218ff76f/0x85f5fa77adf3d443 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440399.556325:0:15050:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787440399.556335:0:14354:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787440399.556345:0:14354:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000218ff76f/0x85f5fa77adf3d443 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440399.556353:0:14354:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee07f86f600 already unused, calling callback (ffffffffc15b52a0) 00010000:00010000:2.0:1787440399.556358:0:14354:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000218ff76f/0x85f5fa77adf3d443 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440399.556367:0:14354:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000218ff76f/0x85f5fa77adf3d443 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440399.556379:0:14354:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000218ff76f/0x85f5fa77adf3d443 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440399.556386:0:14354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000218ff76f/0x85f5fa77adf3d443 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440399.556399:0:14354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787440399.556401:0:14354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787440399.556402:0:14354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787440399.558346:0:15050:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787440399.558357:0:15050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e1e0d9b4/0x85f5fa77adf3d44a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440399.558458:0:15050:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=497s v=(0 0) 00010000:00010000:2.0:1787440399.558464:0:15050:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787440399.558471:0:15050:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e1e0d9b4/0x85f5fa77adf3d44a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440399.558524:0:15050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e1e0d9b4/0x85f5fa77adf3d44a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440399.558535:0:15050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e1e0d9b4/0x85f5fa77adf3d44a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440399.558543:0:15050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e1e0d9b4/0x85f5fa77adf3d44a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440399.558571:0:15050:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787440399.558608:0:14353:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787440399.558616:0:14353:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e1e0d9b4/0x85f5fa77adf3d44a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440399.558627:0:14353:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee07f86ee00 already unused, calling callback (ffffffffc15b52a0) 00010000:00010000:1.0:1787440399.558632:0:14353:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1e0d9b4/0x85f5fa77adf3d44a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440399.558642:0:14353:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1e0d9b4/0x85f5fa77adf3d44a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440399.558662:0:14353:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e1e0d9b4/0x85f5fa77adf3d44a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440399.558670:0:14353:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e1e0d9b4/0x85f5fa77adf3d44a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440399.558696:0:14353:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787440399.558699:0:14353:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787440399.558701:0:14353:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787440399.559252:0:15050:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787440399.559260:0:15050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000072c0513f/0x85f5fa77adf3d451 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440399.559271:0:15050:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=497s v=(0 0) 00010000:00010000:2.0:1787440399.559274:0:15050:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787440399.559279:0:15050:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000072c0513f/0x85f5fa77adf3d451 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440399.559290:0:15050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000072c0513f/0x85f5fa77adf3d451 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440399.559298:0:15050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000072c0513f/0x85f5fa77adf3d451 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440399.559317:0:15050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000072c0513f/0x85f5fa77adf3d451 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440399.559334:0:15050:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787440399.559345:0:14354:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787440399.559349:0:14354:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000072c0513f/0x85f5fa77adf3d451 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440399.559357:0:14354:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee07f86e000 already unused, calling callback (ffffffffc15b52a0) 00010000:00010000:2.0:1787440399.559361:0:14354:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000072c0513f/0x85f5fa77adf3d451 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440399.559370:0:14354:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000072c0513f/0x85f5fa77adf3d451 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440399.559469:0:14354:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000072c0513f/0x85f5fa77adf3d451 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440399.559477:0:14354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000072c0513f/0x85f5fa77adf3d451 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440399.559529:0:14354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787440399.559533:0:14354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787440399.559535:0:14354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787440399.560574:0:15050:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787440399.560591:0:15050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000218ff76f/0x85f5fa77adf3d458 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440399.560603:0:15050:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=497s v=(0 0) 00010000:00010000:2.0:1787440399.560608:0:15050:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787440399.560680:0:15050:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000218ff76f/0x85f5fa77adf3d458 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440399.560694:0:15050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000218ff76f/0x85f5fa77adf3d458 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440399.560704:0:15050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000218ff76f/0x85f5fa77adf3d458 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440399.560711:0:15050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000218ff76f/0x85f5fa77adf3d458 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440399.560800:0:15050:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787440399.560923:0:14353:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787440399.560936:0:14353:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000218ff76f/0x85f5fa77adf3d458 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440399.560947:0:14353:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee07f86f600 already unused, calling callback (ffffffffc15b52a0) 00010000:00010000:0.0:1787440399.560953:0:14353:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000218ff76f/0x85f5fa77adf3d458 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440399.560962:0:14353:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000218ff76f/0x85f5fa77adf3d458 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440399.560993:0:14353:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000218ff76f/0x85f5fa77adf3d458 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440399.561001:0:14353:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000218ff76f/0x85f5fa77adf3d458 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440399.561029:0:14353:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787440399.561032:0:14353:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787440399.561036:0:14353:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787440399.561283:0:15050:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787440399.561289:0:15050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bc5709cc/0x85f5fa77adf3d45f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440399.561298:0:15050:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=497s v=(0 0) 00010000:00010000:2.0:1787440399.561301:0:15050:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787440399.561306:0:15050:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bc5709cc/0x85f5fa77adf3d45f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440399.561316:0:15050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bc5709cc/0x85f5fa77adf3d45f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440399.561331:0:15050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bc5709cc/0x85f5fa77adf3d45f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440399.561339:0:15050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bc5709cc/0x85f5fa77adf3d45f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440399.561356:0:15050:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787440399.561367:0:14354:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787440399.561371:0:14354:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bc5709cc/0x85f5fa77adf3d45f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440399.561451:0:14354:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee07f86e600 already unused, calling callback (ffffffffc15b52a0) 00010000:00010000:2.0:1787440399.561455:0:14354:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bc5709cc/0x85f5fa77adf3d45f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440399.561463:0:14354:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bc5709cc/0x85f5fa77adf3d45f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440399.561474:0:14354:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bc5709cc/0x85f5fa77adf3d45f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440399.561481:0:14354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bc5709cc/0x85f5fa77adf3d45f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440399.561521:0:14354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787440399.561527:0:14354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787440399.561529:0:14354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787440399.562167:0:15050:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787440399.562175:0:15050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e5acaa5e/0x85f5fa77adf3d466 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440399.562184:0:15050:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=497s v=(0 0) 00010000:00010000:2.0:1787440399.562187:0:15050:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787440399.562193:0:15050:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e5acaa5e/0x85f5fa77adf3d466 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440399.562203:0:15050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e5acaa5e/0x85f5fa77adf3d466 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440399.562211:0:15050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e5acaa5e/0x85f5fa77adf3d466 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440399.562219:0:15050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e5acaa5e/0x85f5fa77adf3d466 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440399.562234:0:15050:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787440399.562243:0:14353:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787440399.562247:0:14353:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e5acaa5e/0x85f5fa77adf3d466 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440399.562254:0:14353:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee07f86e400 already unused, calling callback (ffffffffc15b52a0) 00010000:00010000:2.0:1787440399.562258:0:14353:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e5acaa5e/0x85f5fa77adf3d466 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440399.562277:0:14353:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e5acaa5e/0x85f5fa77adf3d466 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440399.562289:0:14353:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e5acaa5e/0x85f5fa77adf3d466 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440399.562297:0:14353:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e5acaa5e/0x85f5fa77adf3d466 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440399.562318:0:14353:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787440399.562321:0:14353:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787440399.562325:0:14353:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787440399.563043:0:15050:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787440399.563051:0:15050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004390d788/0x85f5fa77adf3d46d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440399.563061:0:15050:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=497s v=(0 0) 00010000:00010000:2.0:1787440399.563066:0:15050:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787440399.563071:0:15050:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004390d788/0x85f5fa77adf3d46d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440399.563082:0:15050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004390d788/0x85f5fa77adf3d46d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440399.563091:0:15050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004390d788/0x85f5fa77adf3d46d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440399.563104:0:15050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004390d788/0x85f5fa77adf3d46d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440399.563126:0:15050:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787440399.563541:0:14354:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787440399.563548:0:14354:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004390d788/0x85f5fa77adf3d46d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440399.563569:0:14354:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee07f86f200 already unused, calling callback (ffffffffc15b52a0) 00010000:00010000:3.0:1787440399.563574:0:14354:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004390d788/0x85f5fa77adf3d46d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440399.563584:0:14354:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004390d788/0x85f5fa77adf3d46d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440399.563602:0:14354:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004390d788/0x85f5fa77adf3d46d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440399.563623:0:14354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004390d788/0x85f5fa77adf3d46d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440399.563642:0:14354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787440399.563644:0:14354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787440399.563647:0:14354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787440399.563658:0:15050:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787440399.563665:0:15050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000155b1b68/0x85f5fa77adf3d474 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440399.563673:0:15050:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=497s v=(0 0) 00010000:00010000:2.0:1787440399.563676:0:15050:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787440399.563680:0:15050:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000155b1b68/0x85f5fa77adf3d474 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440399.563691:0:15050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000155b1b68/0x85f5fa77adf3d474 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440399.563698:0:15050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000155b1b68/0x85f5fa77adf3d474 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440399.563705:0:15050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000155b1b68/0x85f5fa77adf3d474 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440399.563889:0:15050:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787440399.564042:0:14353:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787440399.564048:0:14353:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000155b1b68/0x85f5fa77adf3d474 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440399.564057:0:14353:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee07f86ec00 already unused, calling callback (ffffffffc15b52a0) 00010000:00010000:3.0:1787440399.564061:0:14353:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000155b1b68/0x85f5fa77adf3d474 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440399.564070:0:14353:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000155b1b68/0x85f5fa77adf3d474 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440399.564082:0:14353:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000155b1b68/0x85f5fa77adf3d474 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440399.564090:0:14353:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000155b1b68/0x85f5fa77adf3d474 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440399.564111:0:14353:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787440399.564114:0:14353:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787440399.564116:0:14353:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787440399.564339:0:15050:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787440399.564346:0:15050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003728351c/0x85f5fa77adf3d47b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440399.564362:0:15050:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=497s v=(0 0) 00010000:00010000:2.0:1787440399.564366:0:15050:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787440399.564371:0:15050:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003728351c/0x85f5fa77adf3d47b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440399.564456:0:15050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003728351c/0x85f5fa77adf3d47b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440399.564464:0:15050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003728351c/0x85f5fa77adf3d47b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440399.564471:0:15050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003728351c/0x85f5fa77adf3d47b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440399.564514:0:15050:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787440399.564533:0:14354:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787440399.564540:0:14354:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003728351c/0x85f5fa77adf3d47b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440399.564548:0:14354:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee07f86e200 already unused, calling callback (ffffffffc15b52a0) 00010000:00010000:3.0:1787440399.564552:0:14354:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003728351c/0x85f5fa77adf3d47b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440399.564571:0:14354:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003728351c/0x85f5fa77adf3d47b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440399.564582:0:14354:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003728351c/0x85f5fa77adf3d47b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440399.564589:0:14354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003728351c/0x85f5fa77adf3d47b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440399.564608:0:14354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787440399.564611:0:14354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787440399.564614:0:14354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787440399.565042:0:15050:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787440399.565050:0:15050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000026916e4f/0x85f5fa77adf3d482 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440399.565060:0:15050:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=497s v=(0 0) 00010000:00010000:2.0:1787440399.565064:0:15050:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787440399.565068:0:15050:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000026916e4f/0x85f5fa77adf3d482 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440399.565078:0:15050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000026916e4f/0x85f5fa77adf3d482 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440399.565099:0:15050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000026916e4f/0x85f5fa77adf3d482 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440399.565106:0:15050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000026916e4f/0x85f5fa77adf3d482 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440399.565129:0:15050:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787440399.565314:0:14353:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787440399.565321:0:14353:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000026916e4f/0x85f5fa77adf3d482 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440399.565330:0:14353:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee07f86fa00 already unused, calling callback (ffffffffc15b52a0) 00010000:00010000:3.0:1787440399.565335:0:14353:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000026916e4f/0x85f5fa77adf3d482 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440399.565356:0:14353:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000026916e4f/0x85f5fa77adf3d482 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440399.565370:0:14353:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000026916e4f/0x85f5fa77adf3d482 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440399.565378:0:14353:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000026916e4f/0x85f5fa77adf3d482 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440399.565393:0:14353:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787440399.565395:0:14353:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787440399.565397:0:14353:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787440399.565777:0:15050:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787440399.565784:0:15050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000072c0513f/0x85f5fa77adf3d489 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440399.565794:0:15050:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=497s v=(0 0) 00010000:00010000:2.0:1787440399.565797:0:15050:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787440399.565802:0:15050:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000072c0513f/0x85f5fa77adf3d489 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440399.565813:0:15050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000072c0513f/0x85f5fa77adf3d489 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440399.565821:0:15050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000072c0513f/0x85f5fa77adf3d489 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440399.565828:0:15050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000072c0513f/0x85f5fa77adf3d489 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440399.565855:0:15050:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787440399.565865:0:14354:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787440399.565870:0:14354:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000072c0513f/0x85f5fa77adf3d489 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440399.565877:0:14354:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee07f86e000 already unused, calling callback (ffffffffc15b52a0) 00010000:00010000:2.0:1787440399.565880:0:14354:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000072c0513f/0x85f5fa77adf3d489 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440399.565888:0:14354:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000072c0513f/0x85f5fa77adf3d489 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440399.565901:0:14354:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000072c0513f/0x85f5fa77adf3d489 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440399.565909:0:14354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000072c0513f/0x85f5fa77adf3d489 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440399.565926:0:14354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787440399.565928:0:14354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787440399.565930:0:14354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787440399.566615:0:15050:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787440399.566624:0:15050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a4267042/0x85f5fa77adf3d490 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440399.566634:0:15050:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=497s v=(0 0) 00010000:00010000:2.0:1787440399.566644:0:15050:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787440399.566649:0:15050:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a4267042/0x85f5fa77adf3d490 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440399.566660:0:15050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a4267042/0x85f5fa77adf3d490 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440399.566669:0:15050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a4267042/0x85f5fa77adf3d490 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440399.566677:0:15050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a4267042/0x85f5fa77adf3d490 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440399.566695:0:15050:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787440399.566705:0:14353:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787440399.566710:0:14353:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a4267042/0x85f5fa77adf3d490 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440399.566717:0:14353:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee07f86e800 already unused, calling callback (ffffffffc15b52a0) 00010000:00010000:2.0:1787440399.566720:0:14353:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a4267042/0x85f5fa77adf3d490 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440399.566728:0:14353:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a4267042/0x85f5fa77adf3d490 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440399.566740:0:14353:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a4267042/0x85f5fa77adf3d490 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440399.566760:0:14353:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a4267042/0x85f5fa77adf3d490 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440399.566776:0:14353:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787440399.566779:0:14353:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787440399.566781:0:14353:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787440399.567296:0:15050:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787440399.567303:0:15050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000040bdaead/0x85f5fa77adf3d497 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440399.567312:0:15050:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=497s v=(0 0) 00010000:00010000:2.0:1787440399.567316:0:15050:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787440399.567320:0:15050:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000040bdaead/0x85f5fa77adf3d497 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440399.567330:0:15050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000040bdaead/0x85f5fa77adf3d497 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440399.567338:0:15050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000040bdaead/0x85f5fa77adf3d497 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440399.567345:0:15050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000040bdaead/0x85f5fa77adf3d497 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440399.567360:0:15050:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787440399.567368:0:14354:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787440399.567459:0:14354:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000040bdaead/0x85f5fa77adf3d497 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440399.567466:0:14354:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee07f86f800 already unused, calling callback (ffffffffc15b52a0) 00010000:00010000:2.0:1787440399.567470:0:14354:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000040bdaead/0x85f5fa77adf3d497 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440399.567477:0:14354:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000040bdaead/0x85f5fa77adf3d497 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440399.567488:0:14354:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000040bdaead/0x85f5fa77adf3d497 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440399.569096:0:14354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000040bdaead/0x85f5fa77adf3d497 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440399.569120:0:14354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787440399.569121:0:14354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787440399.569124:0:14354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787440399.571365:0:15050:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787440399.571790:0:15050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000072c0513f/0x85f5fa77adf3d49e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440399.571807:0:15050:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=497s v=(0 0) 00010000:00010000:2.0:1787440399.571811:0:15050:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787440399.571817:0:15050:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000072c0513f/0x85f5fa77adf3d49e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440399.571841:0:15050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000072c0513f/0x85f5fa77adf3d49e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440399.571852:0:15050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000072c0513f/0x85f5fa77adf3d49e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440399.571860:0:15050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000072c0513f/0x85f5fa77adf3d49e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440399.571921:0:15050:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787440399.572564:0:15050:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787440399.572573:0:15050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e5acaa5e/0x85f5fa77adf3d4a5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440399.572584:0:15050:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=497s v=(0 0) 00010000:00010000:2.0:1787440399.572588:0:15050:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787440399.572593:0:15050:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e5acaa5e/0x85f5fa77adf3d4a5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440399.572603:0:15050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e5acaa5e/0x85f5fa77adf3d4a5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440399.572612:0:15050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e5acaa5e/0x85f5fa77adf3d4a5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440399.572629:0:15050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e5acaa5e/0x85f5fa77adf3d4a5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440399.577192:0:14353:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787440399.577205:0:14353:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000072c0513f/0x85f5fa77adf3d49e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440399.577223:0:14353:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee07f86e000 already unused, calling callback (ffffffffc15b52a0) 00010000:00010000:0.0:1787440399.577228:0:14353:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000072c0513f/0x85f5fa77adf3d49e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440399.577253:0:14353:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000072c0513f/0x85f5fa77adf3d49e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440399.577273:0:14353:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000072c0513f/0x85f5fa77adf3d49e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440399.577281:0:14353:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000072c0513f/0x85f5fa77adf3d49e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440399.577586:0:15050:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787440399.577604:0:14354:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787440399.577611:0:14354:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e5acaa5e/0x85f5fa77adf3d4a5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440399.577621:0:14354:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee07f86e400 already unused, calling callback (ffffffffc15b52a0) 00010000:00010000:2.0:1787440399.577626:0:14354:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e5acaa5e/0x85f5fa77adf3d4a5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440399.577636:0:14354:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e5acaa5e/0x85f5fa77adf3d4a5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440399.577651:0:14354:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e5acaa5e/0x85f5fa77adf3d4a5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440399.577659:0:14354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e5acaa5e/0x85f5fa77adf3d4a5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440399.577685:0:14354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787440399.577689:0:14354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787440399.577693:0:14354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787440399.577863:0:14353:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787440399.577867:0:14353:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787440399.577870:0:14353:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787440399.578844:0:15050:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787440399.578861:0:15050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bc5709cc/0x85f5fa77adf3d4ac lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440399.578875:0:15050:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=497s v=(0 0) 00010000:00010000:2.0:1787440399.578879:0:15050:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787440399.578886:0:15050:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bc5709cc/0x85f5fa77adf3d4ac lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440399.578899:0:15050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bc5709cc/0x85f5fa77adf3d4ac lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440399.578984:0:15050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bc5709cc/0x85f5fa77adf3d4ac lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440399.578994:0:15050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bc5709cc/0x85f5fa77adf3d4ac lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440399.579015:0:15050:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787440399.579280:0:14354:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787440399.579288:0:14354:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bc5709cc/0x85f5fa77adf3d4ac lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440399.579297:0:14354:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee07f86e600 already unused, calling callback (ffffffffc15b52a0) 00010000:00010000:3.0:1787440399.579301:0:14354:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bc5709cc/0x85f5fa77adf3d4ac lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440399.579310:0:14354:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bc5709cc/0x85f5fa77adf3d4ac lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440399.579326:0:14354:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bc5709cc/0x85f5fa77adf3d4ac lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440399.579346:0:14354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bc5709cc/0x85f5fa77adf3d4ac lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440399.579364:0:14354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787440399.579367:0:14354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787440399.579369:0:14354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787440399.582959:0:15050:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787440399.582973:0:15050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001105f4f2/0x85f5fa77adf3d4b3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440399.582990:0:15050:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=497s v=(0 0) 00010000:00010000:3.0:1787440399.582994:0:15050:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787440399.583001:0:15050:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001105f4f2/0x85f5fa77adf3d4b3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440399.583015:0:15050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001105f4f2/0x85f5fa77adf3d4b3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440399.583025:0:15050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001105f4f2/0x85f5fa77adf3d4b3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440399.583033:0:15050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001105f4f2/0x85f5fa77adf3d4b3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440399.583054:0:15050:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787440399.583584:0:15050:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787440399.583599:0:15050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009c6d96ea/0x85f5fa77adf3d4ba lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440399.583610:0:15050:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=497s v=(0 0) 00010000:00010000:3.0:1787440399.583614:0:15050:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787440399.583619:0:15050:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009c6d96ea/0x85f5fa77adf3d4ba lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440399.583631:0:15050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009c6d96ea/0x85f5fa77adf3d4ba lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440399.583639:0:15050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009c6d96ea/0x85f5fa77adf3d4ba lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440399.583645:0:15050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009c6d96ea/0x85f5fa77adf3d4ba lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440399.583659:0:15050:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1787440399.584057:0:15050:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787440399.584064:0:15050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000092ba5a6/0x85f5fa77adf3d4c1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440399.584074:0:15050:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=497s v=(0 0) 00010000:00010000:3.0:1787440399.584077:0:15050:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787440399.584081:0:15050:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000092ba5a6/0x85f5fa77adf3d4c1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440399.584092:0:15050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000092ba5a6/0x85f5fa77adf3d4c1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440399.584107:0:15050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000092ba5a6/0x85f5fa77adf3d4c1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440399.584114:0:15050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000092ba5a6/0x85f5fa77adf3d4c1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440399.584123:0:15050:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1787440399.584708:0:14353:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787440399.584715:0:14353:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001105f4f2/0x85f5fa77adf3d4b3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440399.584724:0:14353:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee049e95000 already unused, calling callback (ffffffffc15b52a0) 00010000:00010000:3.0:1787440399.584729:0:14353:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001105f4f2/0x85f5fa77adf3d4b3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440399.584737:0:14353:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001105f4f2/0x85f5fa77adf3d4b3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440399.584754:0:14353:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001105f4f2/0x85f5fa77adf3d4b3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440399.584761:0:14353:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001105f4f2/0x85f5fa77adf3d4b3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440399.584779:0:14353:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787440399.584789:0:14353:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009c6d96ea/0x85f5fa77adf3d4ba lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440399.584795:0:14353:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee049e95a00 already unused, calling callback (ffffffffc15b52a0) 00010000:00010000:3.0:1787440399.584798:0:14353:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009c6d96ea/0x85f5fa77adf3d4ba lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440399.584805:0:14353:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009c6d96ea/0x85f5fa77adf3d4ba lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440399.584816:0:14353:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009c6d96ea/0x85f5fa77adf3d4ba lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440399.584822:0:14353:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009c6d96ea/0x85f5fa77adf3d4ba lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440399.584835:0:14353:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787440399.584838:0:14353:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000092ba5a6/0x85f5fa77adf3d4c1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440399.584844:0:14353:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee049e95e00 already unused, calling callback (ffffffffc15b52a0) 00010000:00010000:3.0:1787440399.584847:0:14353:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000092ba5a6/0x85f5fa77adf3d4c1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440399.584854:0:14353:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000092ba5a6/0x85f5fa77adf3d4c1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440399.584878:0:14353:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000092ba5a6/0x85f5fa77adf3d4c1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440399.584886:0:14353:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000092ba5a6/0x85f5fa77adf3d4c1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440399.584899:0:14353:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787440399.584901:0:14353:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787440399.584903:0:14353:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787440399.584911:0:14354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787440399.585882:0:15050:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787440399.585891:0:15050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000000874a1b/0x85f5fa77adf3d4c8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440399.585903:0:15050:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=497s v=(0 0) 00010000:00010000:3.0:1787440399.585907:0:15050:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787440399.585912:0:15050:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000000874a1b/0x85f5fa77adf3d4c8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440399.585923:0:15050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000000874a1b/0x85f5fa77adf3d4c8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440399.585932:0:15050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000000874a1b/0x85f5fa77adf3d4c8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440399.585940:0:15050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000000874a1b/0x85f5fa77adf3d4c8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440399.585968:0:15050:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787440399.586826:0:15050:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787440399.586834:0:15050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f400cc9f/0x85f5fa77adf3d4cf lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440399.586846:0:15050:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=497s v=(0 0) 00010000:00010000:3.0:1787440399.586850:0:15050:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787440399.586855:0:15050:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f400cc9f/0x85f5fa77adf3d4cf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440399.586866:0:15050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f400cc9f/0x85f5fa77adf3d4cf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440399.586875:0:15050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f400cc9f/0x85f5fa77adf3d4cf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440399.586882:0:15050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f400cc9f/0x85f5fa77adf3d4cf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440399.586897:0:15050:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1787440399.587369:0:15050:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787440399.587375:0:15050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007bfce80a/0x85f5fa77adf3d4d6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440399.587384:0:15050:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=497s v=(0 0) 00010000:00010000:3.0:1787440399.587393:0:15050:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787440399.587397:0:15050:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007bfce80a/0x85f5fa77adf3d4d6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440399.587406:0:15050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007bfce80a/0x85f5fa77adf3d4d6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440399.587413:0:15050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007bfce80a/0x85f5fa77adf3d4d6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440399.587420:0:15050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007bfce80a/0x85f5fa77adf3d4d6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440399.587428:0:15050:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1787440399.587849:0:15050:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787440399.587855:0:15050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000971c6fa/0x85f5fa77adf3d4dd lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440399.587863:0:15050:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=497s v=(0 0) 00010000:00010000:3.0:1787440399.587867:0:15050:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787440399.587871:0:15050:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000971c6fa/0x85f5fa77adf3d4dd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440399.587880:0:15050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000971c6fa/0x85f5fa77adf3d4dd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440399.587887:0:15050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000971c6fa/0x85f5fa77adf3d4dd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440399.587901:0:15050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000971c6fa/0x85f5fa77adf3d4dd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440399.587908:0:15050:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:3.0:1787440399.588407:0:15050:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787440399.588413:0:15050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009fbd0205/0x85f5fa77adf3d4e4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440399.588422:0:15050:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=497s v=(0 0) 00010000:00010000:3.0:1787440399.588425:0:15050:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787440399.588429:0:15050:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009fbd0205/0x85f5fa77adf3d4e4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440399.588438:0:15050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009fbd0205/0x85f5fa77adf3d4e4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440399.588446:0:15050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009fbd0205/0x85f5fa77adf3d4e4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440399.588453:0:15050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009fbd0205/0x85f5fa77adf3d4e4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440399.588461:0:15050:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00010000:00010000:3.0:1787440399.588813:0:14354:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1787440399.588821:0:14354:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000000874a1b/0x85f5fa77adf3d4c8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440399.588838:0:14354:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee049e94e00 already unused, calling callback (ffffffffc15b52a0) 00010000:00010000:3.0:1787440399.588844:0:14354:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000000874a1b/0x85f5fa77adf3d4c8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440399.588854:0:14354:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000000874a1b/0x85f5fa77adf3d4c8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440399.588872:0:14354:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000000874a1b/0x85f5fa77adf3d4c8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440399.588880:0:14354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000000874a1b/0x85f5fa77adf3d4c8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440399.588900:0:14354:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1787440399.588904:0:14354:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f400cc9f/0x85f5fa77adf3d4cf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440399.588911:0:14354:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee049e94a00 already unused, calling callback (ffffffffc15b52a0) 00010000:00010000:3.0:1787440399.588914:0:14354:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f400cc9f/0x85f5fa77adf3d4cf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440399.588922:0:14354:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f400cc9f/0x85f5fa77adf3d4cf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440399.588932:0:14354:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f400cc9f/0x85f5fa77adf3d4cf lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440399.588947:0:14354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f400cc9f/0x85f5fa77adf3d4cf lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440399.588963:0:14354:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787440399.588967:0:14354:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007bfce80a/0x85f5fa77adf3d4d6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440399.588974:0:14354:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee049e94400 already unused, calling callback (ffffffffc15b52a0) 00010000:00010000:3.0:1787440399.588978:0:14354:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007bfce80a/0x85f5fa77adf3d4d6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440399.588985:0:14354:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007bfce80a/0x85f5fa77adf3d4d6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440399.588996:0:14354:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007bfce80a/0x85f5fa77adf3d4d6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440399.589003:0:14354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007bfce80a/0x85f5fa77adf3d4d6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440399.589016:0:14354:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787440399.589019:0:14354:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000971c6fa/0x85f5fa77adf3d4dd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440399.589026:0:14354:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee049e94200 already unused, calling callback (ffffffffc15b52a0) 00010000:00010000:3.0:1787440399.589038:0:14354:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000971c6fa/0x85f5fa77adf3d4dd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440399.589046:0:14354:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000971c6fa/0x85f5fa77adf3d4dd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440399.589060:0:14354:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000971c6fa/0x85f5fa77adf3d4dd lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440399.589069:0:14354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000971c6fa/0x85f5fa77adf3d4dd lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787440399.590085:0:5871:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00010000:00010000:0.0:1787440399.590587:0:14353:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787440399.590596:0:14353:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009fbd0205/0x85f5fa77adf3d4e4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440399.590607:0:14353:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee049e95c00 already unused, calling callback (ffffffffc15b52a0) 00010000:00010000:0.0:1787440399.590761:0:14353:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009fbd0205/0x85f5fa77adf3d4e4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440399.590773:0:14353:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009fbd0205/0x85f5fa77adf3d4e4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440399.590790:0:14353:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009fbd0205/0x85f5fa77adf3d4e4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440399.590811:0:14353:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009fbd0205/0x85f5fa77adf3d4e4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440399.590831:0:14353:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787440399.590833:0:14353:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787440399.590835:0:14353:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787440399.591538:0:14354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787440399.591543:0:14354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787440399.591546:0:14354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787440399.591835:0:15050:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787440399.591843:0:15050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000074ff8dce/0x85f5fa77adf3d4eb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440399.591855:0:15050:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=497s v=(0 0) 00010000:00010000:0.0:1787440399.591859:0:15050:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787440399.591866:0:15050:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000074ff8dce/0x85f5fa77adf3d4eb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440399.591878:0:15050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000074ff8dce/0x85f5fa77adf3d4eb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440399.591888:0:15050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000074ff8dce/0x85f5fa77adf3d4eb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440399.591896:0:15050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000074ff8dce/0x85f5fa77adf3d4eb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440399.592480:0:15050:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787440399.592739:0:14353:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787440399.592747:0:14353:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000074ff8dce/0x85f5fa77adf3d4eb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440399.592757:0:14353:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee04cbce400 already unused, calling callback (ffffffffc15b52a0) 00010000:00010000:3.0:1787440399.592762:0:14353:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000074ff8dce/0x85f5fa77adf3d4eb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440399.592771:0:14353:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000074ff8dce/0x85f5fa77adf3d4eb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440399.592803:0:14353:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000074ff8dce/0x85f5fa77adf3d4eb lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440399.592822:0:14353:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000074ff8dce/0x85f5fa77adf3d4eb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440399.592838:0:14353:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787440399.592841:0:14353:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787440399.592842:0:14353:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787440399.594354:0:15050:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787440399.594388:0:15050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050f798a5/0x85f5fa77adf3d4f2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440399.595466:0:15050:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=497s v=(0 0) 00010000:00010000:0.0:1787440399.595474:0:15050:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787440399.595482:0:15050:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000050f798a5/0x85f5fa77adf3d4f2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440399.595520:0:15050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000050f798a5/0x85f5fa77adf3d4f2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440399.595532:0:15050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050f798a5/0x85f5fa77adf3d4f2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440399.595540:0:15050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000050f798a5/0x85f5fa77adf3d4f2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440399.595570:0:15050:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787440399.596564:0:14354:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787440399.596573:0:14354:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000050f798a5/0x85f5fa77adf3d4f2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440399.596584:0:14354:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee04cbcf800 already unused, calling callback (ffffffffc15b52a0) 00010000:00010000:2.0:1787440399.596589:0:14354:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000050f798a5/0x85f5fa77adf3d4f2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440399.596598:0:14354:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000050f798a5/0x85f5fa77adf3d4f2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440399.596694:0:14354:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000050f798a5/0x85f5fa77adf3d4f2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440399.596756:0:14354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000050f798a5/0x85f5fa77adf3d4f2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440399.596779:0:14354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787440399.596781:0:14354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787440399.596783:0:14354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787440399.597238:0:15050:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787440399.597247:0:15050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004638d737/0x85f5fa77adf3d4f9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440399.597259:0:15050:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=497s v=(0 0) 00010000:00010000:0.0:1787440399.597263:0:15050:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787440399.597269:0:15050:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004638d737/0x85f5fa77adf3d4f9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440399.597281:0:15050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004638d737/0x85f5fa77adf3d4f9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440399.597297:0:15050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004638d737/0x85f5fa77adf3d4f9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440399.597303:0:15050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004638d737/0x85f5fa77adf3d4f9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440399.597327:0:15050:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787440399.597576:0:14353:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787440399.597582:0:14353:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004638d737/0x85f5fa77adf3d4f9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440399.597589:0:14353:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee04cbce000 already unused, calling callback (ffffffffc15b52a0) 00010000:00010000:3.0:1787440399.597593:0:14353:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004638d737/0x85f5fa77adf3d4f9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440399.597602:0:14353:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004638d737/0x85f5fa77adf3d4f9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440399.597681:0:14353:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004638d737/0x85f5fa77adf3d4f9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440399.597689:0:14353:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004638d737/0x85f5fa77adf3d4f9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440399.597793:0:14353:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787440399.597796:0:14353:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787440399.597798:0:14353:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:0.0:1787440399.598269:0:15050:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:5 00000100:00100000:0.0:1787440399.598739:0:15050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee07f9f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14388:x1874266701267968:12345-0@lo:5:osp-pre-0-0.0 Request processed in 68971us (69145us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440399.598751:0:15050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787440399.603139:0:14388:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee07f9f0000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14388:1874266701267968:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1787440399.603157:0:14388:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x5:0x0] 00000100:00100000:2.0:1787440399.603208:0:14388:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee08032d180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14388:1874266701268096:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1787440399.603262:0:14388:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440399.604112:0:14388:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee0807a9cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787440399.607270:0:15049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701268096 00000100:00100000:3.0:1787440399.607288:0:15049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701268096 00000100:00100000:2.0:1787440399.607586:0:15049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787440399.607599:0:15049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee08032ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14388:x1874266701268096:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1787440399.607902:0:15049:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00000100:00100000:1.0:1787440399.619759:0:15049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee08032ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:14388:x1874266701268096:12345-0@lo:5:osp-pre-0-0.0 Request processed in 12157us (16489us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1787440399.619772:0:15049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787440399.619942:0:14388:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee08032d180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14388:1874266701268096:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1787440399.619957:0:14388:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00010000:00010000:0.0:1787440399.908267:0:14354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787440400.334876:0:15766:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787440400.334880:0:15766:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:2.0:1787440400.335011:0:15766:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8edf4356d000 00000020:01000004:2.0:1787440400.335026:0:15766:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1787440400.335038:0:15766:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:2.0:1787440400.335050:0:15766:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8ee0804519b8) 00000020:00000080:2.0:1787440400.335065:0:15766:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1787440400.358176:0:15766:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1787440400.358463:0:15766:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1787440400.359285:0:15766:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1787440400.359542:0:15766:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:3.0:1787440400.359752:0:15766:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1787440400.360121:0:15766:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 501: rc = 0 00100000:10000000:3.0:1787440400.360213:0:15766:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 501: rc = 0 00100000:10000000:3.0:1787440400.360305:0:15766:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 501: rc = 0 00100000:10000000:3.0:1787440400.363577:0:15766:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 579: rc = 0 00100000:10000000:3.0:1787440400.363868:0:15766:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 579: rc = 0 00100000:10000000:3.0:1787440400.364118:0:15766:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 579: rc = 0 00100000:10000000:3.0:1787440400.364788:0:15766:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 579: rc = 0 00100000:10000000:3.0:1787440400.365026:0:15766:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 579: rc = 0 00100000:10000000:3.0:1787440400.365345:0:15766:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 579: rc = 0 00000020:00000080:3.0:1787440400.366090:0:15766:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1787440400.366101:0:15766:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787440400.366111:0:15766:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x85f5fa77adf3d507 00000020:01000004:3.0:1787440400.366118:0:15766:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1787440400.366137:0:15766:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.158@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1787440400.366140:0:15766:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.158@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1787440400.366147:0:15766:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1787440400.366165:0:15766:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1787440400.366169:0:15766:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.158@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1787440400.380306:0:15766:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.158@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787440400.380359:0:15766:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.206.158@tcp, index=0001, flags=0x20002 00000020:01000004:2.0:1787440400.380364:0:15766:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787440400.380366:0:15766:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787440400.380368:0:15766:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787440400.380369:0:15766:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787440400.380370:0:15766:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787440400.380371:0:15766:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787440400.380373:0:15766:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787440400.380375:0:15766:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787440400.380376:0:15766:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787440400.380380:0:15766:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:2.0:1787440400.380382:0:15766:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787440400.380383:0:15766:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787440400.380384:0:15766:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787440400.380386:0:15766:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787440400.380386:0:15766:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787440400.380388:0:15766:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787440400.380389:0:15766:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787440400.380390:0:15766:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787440400.380391:0:15766:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787440400.380627:0:15766:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1787440400.380649:0:15766:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee08032e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c:15766:1874266701268224:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787440400.380715:0:15766:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440400.380820:0:15766:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee0807a9000 going to sleep for 11 seconds 00000100:00100000:0.0:1787440400.380876:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701268224 00000100:00100000:0.0:1787440400.380883:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701268224 00000100:00100000:0.0:1787440400.380966:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787440400.380974:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee07b123050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+16:15766:x1874266701268224:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787440400.381004:0:14357:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1787440400.381007:0:14357:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:0.0:1787440400.381010:0:14357:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1787440400.396648:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee07b123050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+16:15766:x1874266701268224:12345-0@lo:253:mount.lustre.0 Request processed in 15666us (15924us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440400.396661:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787440400.396741:0:15766:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee08032e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c:15766:1874266701268224:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1787440400.396755:0:15766:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1787440400.396758:0:15766:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787440400.396760:0:15766:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787440400.396762:0:15766:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787440400.396763:0:15766:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787440400.396764:0:15766:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787440400.396765:0:15766:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787440400.396780:0:15766:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787440400.396782:0:15766:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787440400.396783:0:15766:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1787440400.396801:0:15766:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8edf4356d000 from lustre-OST0001 10000000:01000000:0.0:1787440400.396824:0:15766:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1787440400.396827:0:15766:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1787440400.396834:0:15766:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8ee07745b370 local copy 00010000:00010000:0.0:1787440400.396843:0:15766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.158@tcp lock: ffff8ee07f86f000/0x85f5fa77adf3d2ad lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3d2b4 expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440400.397057:0:15766:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee07f9f2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c:15766:1874266701268352:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787440400.397092:0:15766:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440400.397312:0:15766:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee04c935840 going to sleep for 11 seconds 00000100:00100000:2.0:1787440400.397355:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701268352 00000100:00100000:2.0:1787440400.397362:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701268352 00000100:00100000:2.0:1787440400.404046:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787440400.404070:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee07b121850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+16:15766:x1874266701268352:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787440400.404563:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee07b121850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+16:15766:x1874266701268352:12345-0@lo:501:mount.lustre.0 Request processed in 494us (7459us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787440400.404572:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787440400.404736:0:15766:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee07f9f2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c:15766:1874266701268352:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1787440400.404757:0:15766:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.158@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1787440400.404957:0:15766:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.158@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1787440400.404966:0:15766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.158@tcp lock: ffff8ee07f86f000/0x85f5fa77adf3d2ad lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3d2b4 expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440400.404977:0:15766:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.158@tcp lock: ffff8ee07f86f000/0x85f5fa77adf3d2ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3d2b4 expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787440400.405002:0:15766:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8edf4356d000 10000000:01000000:0.0:1787440400.405007:0:15766:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1787440400.405012:0:15766:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1787440400.405015:0:15766:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787440400.405019:0:15766:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:0.0:1787440400.405021:0:15766:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1787440400.405050:0:15766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.158@tcp lock: ffff8ee04cbcee00/0x85f5fa77adf3d50e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440400.405070:0:15766:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.158@tcp lock: ffff8ee04cbcee00/0x85f5fa77adf3d50e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440400.405081:0:15766:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.158@tcp lock: ffff8ee04cbcee00/0x85f5fa77adf3d50e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440400.405100:0:15766:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee07f9f2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c:15766:1874266701268480:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787440400.405135:0:15766:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440400.405170:0:15766:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee04c935840 going to sleep for 11 seconds 00000100:00100000:2.0:1787440400.408355:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701268480 00000100:00100000:2.0:1787440400.408367:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701268480 00000100:00100000:2.0:1787440400.408439:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787440400.408449:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee07b122850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+16:15766:x1874266701268480:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787440400.408464:0:14357:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440400.408481:0:14357:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ee07f86e800/0x85f5fa77adf3d515 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x85f5fa77adf3d50e expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440400.408545:0:14357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ee07f86e800/0x85f5fa77adf3d515 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x85f5fa77adf3d50e expref: 17 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440400.408567:0:14357:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ee07f86e800/0x85f5fa77adf3d515 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f5fa77adf3d50e expref: 17 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440400.408576:0:14357:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee07f86e800, rc 0) 00000100:00100000:2.0:1787440400.408646:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee07b122850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+17:15766:x1874266701268480:12345-0@lo:101:mount.lustre.0 Request processed in 199us (3511us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440400.408652:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787440400.408801:0:15766:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee07f9f2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c:15766:1874266701268480:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787440400.408829:0:15766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.158@tcp lock: ffff8ee04cbcee00/0x85f5fa77adf3d50e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3d515 expref: -99 pid: 15766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440400.408839:0:15766:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.158@tcp lock: ffff8ee04cbcee00/0x85f5fa77adf3d50e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x85f5fa77adf3d515 expref: -99 pid: 15766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787440400.409766:0:15766:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1787440400.410700:0:15766:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787440400.410938:0:15766:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1787440400.410983:0:15766:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1787440400.411019:0:15766:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1787440400.411069:0:15766:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1787440400.411123:0:15766:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1787440400.411158:0:15766:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1787440400.411222:0:15766:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1787440400.411230:0:15766:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1787440400.411300:0:15766:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee050480700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c:15766:1874266701268608:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787440400.411354:0:15766:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440400.411388:0:15766:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee0478f2e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787440400.411715:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701268608 00000100:00100000:0.0:1787440400.411723:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701268608 00000100:00100000:0.0:1787440400.411766:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787440400.411775:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee07b120c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+17:15766:x1874266701268608:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787440400.412109:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee07b120c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+17:15766:x1874266701268608:12345-0@lo:501:mount.lustre.0 Request processed in 335us (754us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440400.412118:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787440400.413567:0:15766:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee050480700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c:15766:1874266701268608:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787440400.414527:0:15766:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee050480700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c:15766:1874266701268736:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787440400.414611:0:15766:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440400.414643:0:15766:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee0478f2e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787440400.414703:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701268736 00000100:00100000:0.0:1787440400.414710:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701268736 00000100:00100000:0.0:1787440400.414760:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787440400.414769:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee07b123450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+17:15766:x1874266701268736:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787440400.415078:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee07b123450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+17:15766:x1874266701268736:12345-0@lo:503:mount.lustre.0 Request processed in 310us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440400.415086:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787440400.415215:0:15766:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee050480700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c:15766:1874266701268736:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787440400.416045:0:15766:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787440400.416113:0:15766:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee050480700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c:15766:1874266701268864:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787440400.416162:0:15766:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440400.416191:0:15766:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee0478f2e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787440400.416329:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701268864 00000100:00100000:0.0:1787440400.416334:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701268864 00000100:00100000:0.0:1787440400.416408:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787440400.416433:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee07b123850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+17:15766:x1874266701268864:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787440400.416665:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee07b123850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+17:15766:x1874266701268864:12345-0@lo:502:mount.lustre.0 Request processed in 234us (503us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440400.416673:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787440400.416816:0:15766:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee050480700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c:15766:1874266701268864:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787440400.417042:0:15766:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:1.0:1787440400.417091:0:15766:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:1.0:1787440400.417124:0:15766:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:1.0:1787440400.417166:0:15766:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:1.0:1787440400.417198:0:15766:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:1.0:1787440400.417229:0:15766:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:1.0:1787440400.417562:0:15766:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:1.0:1787440400.417601:0:15766:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:1.0:1787440400.417648:0:15766:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:1.0:1787440400.417682:0:15766:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee050480700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c:15766:1874266701268992:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787440400.417736:0:15766:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440400.419148:0:15766:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee0478f2e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787440400.419214:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701268992 00000100:00100000:2.0:1787440400.419222:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701268992 00000100:00100000:2.0:1787440400.419272:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787440400.419280:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee07b121450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+17:15766:x1874266701268992:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787440400.419531:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee07b121450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+17:15766:x1874266701268992:12345-0@lo:502:mount.lustre.0 Request processed in 250us (1794us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440400.419539:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787440400.419781:0:15766:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee050480700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c:15766:1874266701268992:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787440400.419897:0:15766:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:1.0:1787440400.419910:0:15766:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:1.0:1787440400.420911:0:15767:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787440400.420919:0:15767:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:1.0:1787440400.420925:0:15767:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787440400.420927:0:15767:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1787440400.420932:0:15767:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787440400.420944:0:15767:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8ee04a7e19b8) 00000020:00000080:1.0:1787440400.420963:0:15767:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:1.0:1787440400.420968:0:15767:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787440400.421025:0:15767:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8edf4356d000 from lustre-OST0001, refs=2 00080000:01000000:1.0:1787440400.421033:0:15767:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:1.0:1787440400.421039:0:15767:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x85f5fa77adf3d523 00010000:00010000:1.0:1787440400.425010:0:15767:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:1.0:1787440400.425734:0:15767:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:1.0:1787440400.429161:0:15767:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:1.0:1787440400.431448:0:15767:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1787440400.431459:0:15767:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787440400.431465:0:15767:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787440400.431467:0:15767:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1787440400.431471:0:15767:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787440400.431475:0:15767:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787440400.431476:0:15767:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787440400.431480:0:15767:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787440400.431482:0:15767:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1787440400.431484:0:15767:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787440400.431486:0:15767:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787440400.431488:0:15767:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:1.0:1787440400.431522:0:15767:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787440400.431526:0:15767:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787440400.431527:0:15767:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1787440400.431531:0:15767:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1787440400.431595:0:15767:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787440400.431600:0:15767:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787440400.431601:0:15767:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1787440400.431605:0:15767:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:3.0:1787440400.436385:0:15766:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:3.0:1787440400.436435:0:15766:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.158@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1787440400.436462:0:15766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.158@tcp lock: ffff8ee04cbcee00/0x85f5fa77adf3d50e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3d515 expref: -99 pid: 15766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440400.436485:0:15766:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.158@tcp lock: ffff8ee04cbcee00/0x85f5fa77adf3d50e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3d515 expref: -99 pid: 15766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787440400.436507:0:15766:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8edf4356d000 from 1 10000000:01000000:3.0:1787440400.436510:0:15766:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787440400.436559:0:15766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.158@tcp lock: ffff8ee049e94200/0x85f5fa77adf3d52a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440400.436566:0:15766:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.158@tcp lock: ffff8ee049e94200/0x85f5fa77adf3d52a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440400.436577:0:15766:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.158@tcp lock: ffff8ee049e94200/0x85f5fa77adf3d52a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440400.436600:0:15766:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee0776b9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c:15766:1874266701269120:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787440400.436662:0:15766:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440400.440149:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701269120 00000100:00100000:2.0:1787440400.440163:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701269120 00000100:00100000:2.0:1787440400.440219:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787440400.440230:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee07b121050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+17:15766:x1874266701269120:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787440400.440313:0:14358:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440400.440329:0:14358:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ee07f86f800/0x85f5fa77adf3d531 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x85f5fa77adf3d52a expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440400.440355:0:14358:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ee07f86f800/0x85f5fa77adf3d531 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x85f5fa77adf3d52a expref: 18 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440400.440643:0:14358:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ee07f86f800/0x85f5fa77adf3d531 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f5fa77adf3d52a expref: 18 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440400.440654:0:14358:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee07f86f800, rc 0) 00000100:00100000:2.0:1787440400.440718:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee07b121050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+18:15766:x1874266701269120:12345-0@lo:101:mount.lustre.0 Request processed in 491us (4056us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440400.440726:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787440400.446706:0:15766:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee0807ba3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787440400.446750:0:15766:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee0776b9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c:15766:1874266701269120:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787440400.446776:0:15766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.158@tcp lock: ffff8ee049e94200/0x85f5fa77adf3d52a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3d531 expref: -99 pid: 15766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440400.446787:0:15766:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.158@tcp lock: ffff8ee049e94200/0x85f5fa77adf3d52a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x85f5fa77adf3d531 expref: -99 pid: 15766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787440400.447348:0:15766:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:0.0:1787440400.448204:0:15766:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787440400.448906:0:15766:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:0.0:1787440400.448950:0:15766:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:0.0:1787440400.449030:0:15766:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:0.0:1787440400.449038:0:15766:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:0.0:1787440400.449119:0:15766:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee07f9f1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c:15766:1874266701269248:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787440400.449183:0:15766:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440400.449214:0:15766:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee04c9356c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787440400.449330:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701269248 00000100:00100000:3.0:1787440400.449337:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701269248 00000100:00100000:3.0:1787440400.449671:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787440400.449682:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee07b120050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+18:15766:x1874266701269248:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787440400.449888:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee07b120050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+18:15766:x1874266701269248:12345-0@lo:501:mount.lustre.0 Request processed in 209us (705us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440400.449896:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787440400.449980:0:15766:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee07f9f1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c:15766:1874266701269248:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787440400.450011:0:15766:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee07f9f1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c:15766:1874266701269376:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787440400.450048:0:15766:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440400.450273:0:15766:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee04c9356c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787440400.450541:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701269376 00000100:00100000:1.0:1787440400.450547:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701269376 00000100:00100000:1.0:1787440400.450582:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787440400.450589:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee07b122450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+18:15766:x1874266701269376:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787440400.450788:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee07b122450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+18:15766:x1874266701269376:12345-0@lo:503:mount.lustre.0 Request processed in 198us (738us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440400.450795:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787440400.451385:0:15766:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee07f9f1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c:15766:1874266701269376:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1787440400.454320:0:15766:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787440400.454757:0:15766:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee07f9f1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c:15766:1874266701269504:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787440400.454834:0:15766:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440400.454884:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701269504 00000100:00100000:0.0:1787440400.454891:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701269504 00000100:00100000:0.0:1787440400.454922:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787440400.454930:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04cac6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+18:15766:x1874266701269504:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787440400.455129:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04cac6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+18:15766:x1874266701269504:12345-0@lo:502:mount.lustre.0 Request processed in 200us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440400.455136:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787440400.455185:0:15766:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee04c9356c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787440400.455203:0:15766:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee07f9f1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c:15766:1874266701269504:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787440400.455639:0:15766:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1787440400.455688:0:15766:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:0.0:1787440400.455734:0:15766:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:0.0:1787440400.455769:0:15766:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:0.0:1787440400.455800:0:15766:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:0.0:1787440400.455917:0:15766:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:0.0:1787440400.455958:0:15766:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:0.0:1787440400.455986:0:15766:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:0.0:1787440400.456012:0:15766:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee07f9f1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c:15766:1874266701269632:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787440400.456053:0:15766:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440400.456084:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701269632 00000100:00100000:0.0:1787440400.456089:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701269632 00000100:00100000:0.0:1787440400.456111:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787440400.456118:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04cac5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+18:15766:x1874266701269632:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787440400.459842:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04cac5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+18:15766:x1874266701269632:12345-0@lo:502:mount.lustre.0 Request processed in 3715us (3779us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440400.459870:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787440400.460044:0:15766:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee04c9356c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787440400.460071:0:15766:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee07f9f1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c:15766:1874266701269632:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787440400.460225:0:15766:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:0.0:1787440400.463341:0:15766:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:0.0:1787440400.469622:0:15771:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787440400.469635:0:15771:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787440400.469637:0:15771:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1787440400.469644:0:15771:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8edf4356d000 00000020:00000080:0.0:1787440400.469647:0:15771:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787440400.469653:0:15771:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787440400.469656:0:15771:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787440400.469657:0:15771:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1787440400.469659:0:15771:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787440400.469661:0:15771:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787440400.469663:0:15771:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1787440400.469665:0:15771:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8edf4356d000 00000020:00000080:0.0:1787440400.469667:0:15771:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787440400.469717:0:15771:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787440400.469721:0:15771:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787440400.469723:0:15771:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1787440400.469725:0:15771:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787440400.469728:0:15771:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787440400.469729:0:15771:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787440400.469733:0:15771:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8edf4356d000 00000020:00000080:0.0:1787440400.469735:0:15771:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787440400.470874:0:15771:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787440400.470880:0:15771:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787440400.470882:0:15771:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1787440400.470886:0:15771:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:3.0:1787440400.472336:0:15766:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1787440400.472378:0:15766:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.158@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787440400.472399:0:15766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.158@tcp lock: ffff8ee049e94200/0x85f5fa77adf3d52a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3d531 expref: -99 pid: 15766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440400.472410:0:15766:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.158@tcp lock: ffff8ee049e94200/0x85f5fa77adf3d52a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3d531 expref: -99 pid: 15766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787440400.472625:0:15766:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1787440400.472628:0:15766:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8edf4356d000 10000000:01000000:3.0:1787440400.472631:0:15766:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8edf4356d000 10000000:01000000:3.0:1787440400.472636:0:15766:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787440400.472642:0:15766:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8edf4356d000 from 1 10000000:01000000:3.0:1787440400.472645:0:15766:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787440400.472678:0:15766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.158@tcp lock: ffff8ee049e94400/0x85f5fa77adf3d538 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440400.472686:0:15766:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.158@tcp lock: ffff8ee049e94400/0x85f5fa77adf3d538 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440400.472697:0:15766:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.158@tcp lock: ffff8ee049e94400/0x85f5fa77adf3d538 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440400.472719:0:15766:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee0776b8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c:15766:1874266701269760:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787440400.472855:0:15766:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440400.472891:0:15766:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee0807ba240 going to sleep for 11 seconds 00000100:00100000:0.0:1787440400.473329:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701269760 00000100:00100000:0.0:1787440400.473341:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701269760 00000100:00100000:0.0:1787440400.475545:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787440400.475576:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04cac5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+18:15766:x1874266701269760:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787440400.475593:0:14360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440400.475611:0:14360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ee04cbce200/0x85f5fa77adf3d53f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x85f5fa77adf3d538 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440400.475639:0:14360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ee04cbce200/0x85f5fa77adf3d53f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x85f5fa77adf3d538 expref: 19 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440400.475651:0:14360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ee04cbce200/0x85f5fa77adf3d53f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f5fa77adf3d538 expref: 19 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440400.475659:0:14360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee04cbce200, rc 0) 00000100:00100000:0.0:1787440400.475728:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04cac5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+19:15766:x1874266701269760:12345-0@lo:101:mount.lustre.0 Request processed in 161us (2873us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440400.475736:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787440400.476821:0:15766:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee0776b8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c:15766:1874266701269760:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787440400.476841:0:15766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.158@tcp lock: ffff8ee049e94400/0x85f5fa77adf3d538 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3d53f expref: -99 pid: 15766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440400.476853:0:15766:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.158@tcp lock: ffff8ee049e94400/0x85f5fa77adf3d538 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x85f5fa77adf3d53f expref: -99 pid: 15766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787440400.478325:0:15766:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:3.0:1787440400.480967:0:15766:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787440400.484876:0:15766:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1787440400.484976:0:15766:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1787440400.485013:0:15766:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1787440400.485063:0:15766:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1787440400.485099:0:15766:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1787440400.485148:0:15766:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1787440400.485187:0:15766:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1787440400.485219:0:15766:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1787440400.485945:0:15766:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1787440400.485988:0:15766:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1787440400.486021:0:15766:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1787440400.486068:0:15766:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1787440400.486104:0:15766:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1787440400.493012:0:15766:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1787440400.493113:0:15766:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1787440400.493148:0:15766:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1787440400.493178:0:15766:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1787440400.493268:0:15766:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1787440400.493304:0:15766:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1787440400.493334:0:15766:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1787440400.493378:0:15766:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1787440400.493427:0:15766:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1787440400.493463:0:15766:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1787440400.493538:0:15766:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1787440400.493590:0:15766:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:3.0:1787440400.493624:0:15766:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:3.0:1787440400.493668:0:15766:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:3.0:1787440400.493702:0:15766:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:3.0:1787440400.493736:0:15766:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:3.0:1787440400.493798:0:15766:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:3.0:1787440400.493834:0:15766:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:3.0:1787440400.493865:0:15766:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:3.0:1787440400.493898:0:15766:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:3.0:1787440400.493962:0:15766:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:3.0:1787440400.493999:0:15766:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:3.0:1787440400.494046:0:15766:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:3.0:1787440400.494081:0:15766:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:3.0:1787440400.494171:0:15766:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:3.0:1787440400.494179:0:15766:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:3.0:1787440400.494274:0:15766:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee0776b8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c:15766:1874266701269888:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787440400.494334:0:15766:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440400.494371:0:15766:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee0807ba240 going to sleep for 11 seconds 00000100:00100000:2.0:1787440400.494568:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701269888 00000100:00100000:2.0:1787440400.494575:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701269888 00000100:00100000:2.0:1787440400.494623:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787440400.494631:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04cac4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+19:15766:x1874266701269888:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787440400.494863:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04cac4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+19:15766:x1874266701269888:12345-0@lo:501:mount.lustre.0 Request processed in 231us (528us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440400.494871:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787440400.497567:0:15766:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee0776b8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c:15766:1874266701269888:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787440400.497624:0:15766:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee0776b8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c:15766:1874266701270016:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787440400.497692:0:15766:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440400.497717:0:15766:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee0807ba240 going to sleep for 11 seconds 00000100:00100000:3.0:1787440400.497740:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701270016 00000100:00100000:3.0:1787440400.497746:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701270016 00000100:00100000:3.0:1787440400.497785:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787440400.497792:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04cac6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+19:15766:x1874266701270016:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787440400.498049:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04cac6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+19:15766:x1874266701270016:12345-0@lo:503:mount.lustre.0 Request processed in 257us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440400.498058:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787440400.498103:0:15766:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee0776b8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c:15766:1874266701270016:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787440400.504671:0:15766:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787440400.507457:0:15766:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee0776b8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c:15766:1874266701270144:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787440400.507657:0:15766:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440400.507700:0:15766:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee0807ba240 going to sleep for 11 seconds 00000100:00100000:3.0:1787440400.507730:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701270144 00000100:00100000:3.0:1787440400.507736:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701270144 00000100:00100000:3.0:1787440400.507797:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787440400.507806:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04cac6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+19:15766:x1874266701270144:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787440400.508113:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04cac6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+19:15766:x1874266701270144:12345-0@lo:502:mount.lustre.0 Request processed in 307us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440400.508121:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787440400.508186:0:15766:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee0776b8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c:15766:1874266701270144:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787440400.509932:0:15766:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1787440400.509999:0:15766:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:3.0:1787440400.510032:0:15766:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:3.0:1787440400.510078:0:15766:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:3.0:1787440400.510116:0:15766:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:3.0:1787440400.510175:0:15766:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:3.0:1787440400.510215:0:15766:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:3.0:1787440400.511593:0:15766:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:3.0:1787440400.511682:0:15766:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1787440400.511719:0:15766:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:3.0:1787440400.512615:0:15766:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:3.0:1787440400.512696:0:15766:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:3.0:1787440400.512734:0:15766:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:3.0:1787440400.513925:0:15766:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:3.0:1787440400.513995:0:15766:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:3.0:1787440400.514029:0:15766:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:3.0:1787440400.514059:0:15766:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:3.0:1787440400.514105:0:15766:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:3.0:1787440400.514141:0:15766:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:3.0:1787440400.514189:0:15766:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:3.0:1787440400.515344:0:15766:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:3.0:1787440400.515559:0:15766:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:3.0:1787440400.515604:0:15766:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:3.0:1787440400.515659:0:15766:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:3.0:1787440400.519630:0:15766:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:3.0:1787440400.519691:0:15766:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:3.0:1787440400.519781:0:15766:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:3.0:1787440400.519818:0:15766:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:3.0:1787440400.519851:0:15766:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:3.0:1787440400.519894:0:15766:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:3.0:1787440400.519927:0:15766:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:3.0:1787440400.519959:0:15766:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:3.0:1787440400.519991:0:15766:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:3.0:1787440400.520035:0:15766:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:3.0:1787440400.520069:0:15766:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:3.0:1787440400.520114:0:15766:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:3.0:1787440400.520150:0:15766:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:3.0:1787440400.520184:0:15766:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:3.0:1787440400.520262:0:15766:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:3.0:1787440400.520302:0:15766:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:3.0:1787440400.520365:0:15766:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee0776b8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c:15766:1874266701270272:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787440400.520568:0:15766:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440400.520615:0:15766:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee0807ba240 going to sleep for 11 seconds 00000100:00100000:1.0:1787440400.525672:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701270272 00000100:00100000:1.0:1787440400.525686:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701270272 00000100:00100000:1.0:1787440400.526576:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787440400.526588:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04cac7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+19:15766:x1874266701270272:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787440400.526861:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04cac7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+19:15766:x1874266701270272:12345-0@lo:502:mount.lustre.0 Request processed in 275us (6293us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440400.526869:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787440400.527621:0:15766:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee0776b8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c:15766:1874266701270272:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787440400.527734:0:15766:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:2.0:1787440400.527748:0:15766:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:0.0:1787440400.528805:0:15776:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1787440400.528819:0:15776:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8ee0800619b8) 00000020:00000080:0.0:1787440400.528842:0:15776:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:0.0:1787440400.528908:0:15776:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8edf4356d000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1787440400.528912:0:15776:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8edf4356d000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1787440400.528915:0:15776:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8edf4356d000 3 00010000:00080000:0.0:1787440400.528941:0:15776:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8ee06d8d8000@lustre-MDT0000-lwp-OST0001: add connection 192.168.206.158@tcp at head 00010000:00010000:0.0:1787440400.534864:0:15776:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:1.0:1787440400.536917:0:15776:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1787440400.536958:0:15776:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787440400.536971:0:15776:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x85f5fa77adf3d54d 00000100:00080000:1.0:1787440400.536981:0:15776:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787440400.536987:0:15776:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8ee06d8d8000 using connection 192.168.206.158@tcp/0@lo 00000100:00100000:1.0:1787440400.537019:0:15776:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ee050480700 x1874266701270400/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787440400.537095:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee050480700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3308:1874266701270400:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787440400.537176:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787440400.537246:0:15776:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1787440400.538567:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701270400 00000100:00100000:0.0:1787440400.538578:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701270400 00000100:00100000:0.0:1787440400.538616:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787440400.538624:0:14366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee0776b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3308:x1874266701270400:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1787440400.538662:0:14366:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 498 last 0 00000020:00000080:0.0:1787440400.538696:0:14366:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x85f5fa77adf3d554 00000004:00100000:0.0:1787440400.538712:0:14366:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787440400.538746:0:14366:0:(import.c:65:import_set_state_nolock()) ffff8ee06d8dd000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787440400.539239:0:14366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee0776b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1874266701270400:12345-0@lo:38:llog_process_th.0 Request processed in 603us (2052us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440400.539246:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:0.0:1787440400.539310:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787440400.539315:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1787440400.539317:0:36:0:(import.c:65:import_set_state_nolock()) ffff8ee06db94800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787440400.539322:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 497 00000100:00080000:0.0:1787440400.539325:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1787440400.539329:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8ee06db94800 using connection 192.168.206.158@tcp/0@lo 00000100:00100000:0.0:1787440400.539346:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ee07f9f2680 x1874266701270656/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787440400.539512:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee07f9f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1874266701270528:0@lo:400:kworker.0 00000100:00100000:2.0:1787440400.539565:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440400.539754:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee07f9f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874266701270784:0@lo:400:kworker.0 00000100:00100000:0.0:1787440400.539782:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440400.539803:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787440400.539809:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee07f9f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1874266701270912:0@lo:400:kworker.0 00000100:00100000:0.0:1787440400.539831:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440400.539858:0:15050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701270528 00000100:00100000:0.0:1787440400.539863:0:15050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701270528 00000100:00100000:0.0:1787440400.539898:0:15050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787440400.539905:0:15050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee08032f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3310:x1874266701270528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787440400.539946:0:15050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee08032f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3310:x1874266701270528:12345-0@lo:400:kworker.0 Request processed in 41us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440400.539963:0:15050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787440400.539981:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701270784 00000100:00100000:0.0:1787440400.539985:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701270784 00000100:00100000:0.0:1787440400.540003:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701270912 00000100:00100000:0.0:1787440400.540006:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701270912 00000100:00100000:0.0:1787440400.540018:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787440400.540023:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee07f9f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874266701270784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787440400.540057:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee07f9f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874266701270784:12345-0@lo:400:kworker.0 Request processed in 33us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440400.540063:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787440400.540076:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787440400.540081:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04ca3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874266701270912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787440400.540107:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04ca3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874266701270912:12345-0@lo:400:kworker.0 Request processed in 26us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440400.540112:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:0.0:1787440400.540148:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ee07f9f1f80 x1874266701270912/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787440416 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787440400.540161:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee07f9f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1874266701270912:0@lo:400:kworker.0 00010000:00080000:0.0:1787440400.540171:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ee07f9f0000 x1874266701270784/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787440416 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787440400.540179:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee07f9f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874266701270784:0@lo:400:kworker.0 00000100:00100000:0.0:1787440400.540211:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee07f9f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1874266701270528:0@lo:400:kworker.0 00000040:00080000:0.0:1787440400.540559:0:15776:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00010000:00080000:3.0:1787440400.540857:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ee050480700 x1874266701270400/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787440410 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787440400.540867:0:3308:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787440400.540875:0:3308:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:3.0:1787440400.540890:0:3308:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1787440400.540894:0:3308:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787440400.540898:0:3308:0:(import.c:65:import_set_state_nolock()) ffff8ee06d8d8000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787440400.540904:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee050480700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3308:1874266701270400:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787440400.540919:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee07f9f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1874266701270656:0@lo:8:kworker.0 00000100:00100000:3.0:1787440400.540965:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:2.0:1787440400.541908:0:15766:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1787440400.541946:0:15766:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.158@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787440400.541962:0:15766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.158@tcp lock: ffff8ee049e94400/0x85f5fa77adf3d538 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3d53f expref: -99 pid: 15766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440400.541972:0:15766:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.158@tcp lock: ffff8ee049e94400/0x85f5fa77adf3d538 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3d53f expref: -99 pid: 15766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1787440400.542032:0:15766:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1787440400.542034:0:15766:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787440400.542035:0:15766:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787440400.542036:0:15766:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787440400.542037:0:15766:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787440400.542039:0:15766:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787440400.542040:0:15766:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787440400.542042:0:15766:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787440400.542043:0:15766:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787440400.542048:0:15766:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:2.0:1787440400.542050:0:15766:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787440400.542052:0:15766:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787440400.542053:0:15766:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787440400.542054:0:15766:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787440400.542055:0:15766:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787440400.542056:0:15766:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787440400.542057:0:15766:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787440400.542058:0:15766:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787440400.542059:0:15766:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787440400.542077:0:15766:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1787440400.542090:0:15766:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee08032dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c:15766:1874266701271040:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787440400.542130:0:15766:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440400.542158:0:15766:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee047f96600 going to sleep for 11 seconds 00000100:00100000:2.0:1787440400.542182:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701271040 00000100:00100000:2.0:1787440400.542188:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701271040 00000100:00100000:2.0:1787440400.542227:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787440400.542296:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04cac4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+19:15766:x1874266701271040:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1787440400.542326:0:14357:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1787440400.542337:0:14357:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1787440400.545715:0:15049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701270656 00000100:00100000:1.0:1787440400.545732:0:15049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701270656 00000100:00100000:1.0:1787440400.545774:0:15049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787440400.545783:0:15049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee0776b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3308:x1874266701270656:12345-0@lo:8:kworker.0 00000100:00100000:1.0:1787440400.545885:0:15049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee0776b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3308:x1874266701270656:12345-0@lo:8:kworker.0 Request processed in 102us (4919us total) trans 0 rc -11/-11 00000100:00100000:1.0:1787440400.545891:0:15049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787440400.545978:0:3308:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787440400.545987:0:3308:0:(import.c:65:import_set_state_nolock()) ffff8ee06db94800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787440400.545991:0:3308:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1787440400.545994:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee07f9f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1874266701270656:0@lo:8:kworker.0 20000000:01000000:3.0:1787440400.578839:0:14357:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1787440400.578852:0:14357:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1787440400.578870:0:14381:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1787440400.578874:0:14381:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1787440400.578894:0:14381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8ee049e94a00/0x85f5fa77adf3d55b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440400.578912:0:14381:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ee07fb9e800/0x85f5fa77adf3d42e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f5fa77adf3d427 expref: 19 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440400.578920:0:14381:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8ee049e94a00/0x85f5fa77adf3d55b lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440400.578955:0:14381:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ee07fb9e800/0x85f5fa77adf3d42e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x85f5fa77adf3d427 expref: 19 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440400.578969:0:14381:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ee07fb9e800/0x85f5fa77adf3d42e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x85f5fa77adf3d427 expref: 19 pid: 14357 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440400.578982:0:14381:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee0776bbb80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14381:1874266701271168:0@lo:104: 00000100:00100000:3.0:1787440400.579041:0:14381:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440400.579078:0:14381:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee0807ba240 going to sleep for 11 seconds 00000100:00100000:3.0:1787440400.579104:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701271168 00000100:00100000:3.0:1787440400.579121:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701271168 00000100:00100000:3.0:1787440400.579162:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787440400.579170:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee0776b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+3:14381:x1874266701271168:12345-0@lo:104: 00010000:00010000:3.0:1787440400.579181:0:14349:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.158@tcp lock: ffff8ee049e94800/0x85f5fa77adf3d427 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x85f5fa77adf3d42e expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440400.579227:0:14349:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787440400.580827:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee0776b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+3:14381:x1874266701271168:12345-0@lo:104: Request processed in 1653us (1781us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440400.580838:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:3.0:1787440400.580866:0:14353:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787440400.580872:0:14353:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.158@tcp lock: ffff8ee049e94800/0x85f5fa77adf3d427 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x85f5fa77adf3d42e expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440400.580882:0:14353:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee049e94800 already unused, calling callback (ffffffffc1bd2c20) 10000000:00010000:3.0:1787440400.580886:0:14353:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.158@tcp lock: ffff8ee049e94800/0x85f5fa77adf3d427 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x85f5fa77adf3d42e expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440400.580896:0:14353:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.158@tcp lock: ffff8ee049e94800/0x85f5fa77adf3d427 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x85f5fa77adf3d42e expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787440400.580904:0:14353:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.158@tcp lock: ffff8ee049e94800/0x85f5fa77adf3d427 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x85f5fa77adf3d42e expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787440400.580911:0:14353:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787440400.580959:0:14353:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.158@tcp lock: ffff8ee049e94800/0x85f5fa77adf3d427 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x85f5fa77adf3d42e expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440400.580967:0:14353:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787440400.580988:0:14353:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.158@tcp lock: ffff8ee049e94800/0x85f5fa77adf3d427 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x85f5fa77adf3d42e expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440400.581006:0:14353:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.158@tcp lock: ffff8ee049e94800/0x85f5fa77adf3d427 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x85f5fa77adf3d42e expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440400.581022:0:14353:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787440400.581024:0:14353:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787440400.581026:0:14353:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787440400.581040:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee0776baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c:3309:1874266701271296:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787440400.581092:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440400.581137:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701271296 00000100:00100000:3.0:1787440400.581143:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701271296 00010000:00010000:3.0:1787440400.581164:0:14352:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ee07fb9e800/0x85f5fa77adf3d42e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x85f5fa77adf3d427 expref: 20 pid: 14357 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440400.581186:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787440400.581193:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee0776ba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+20:3309:x1874266701271296:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787440400.581203:0:14352:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787440400.581209:0:14352:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ee07fb9e800/0x85f5fa77adf3d42e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x85f5fa77adf3d427 expref: 20 pid: 14357 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440400.581218:0:14352:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ee07fb9e800/0x85f5fa77adf3d42e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x85f5fa77adf3d427 expref: 20 pid: 14357 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440400.581242:0:14352:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8ee049e94a00/0x85f5fa77adf3d55b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440400.581251:0:14352:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ee049e94a00/0x85f5fa77adf3d55b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787440400.581264:0:14352:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002390791s 00010000:00010000:3.0:1787440400.581275:0:14352:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ee049e94a00/0x85f5fa77adf3d55b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440400.581282:0:14352:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ee049e94a00/0x85f5fa77adf3d55b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440400.581290:0:14352:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8ee049e94a00/0x85f5fa77adf3d55b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440400.581296:0:14352:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8ee049e94a00/0x85f5fa77adf3d55b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440400.581301:0:14352:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee049e94a00 already unused, calling callback (ffffffffc15b52a0) 00010000:00010000:3.0:1787440400.581305:0:14352:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8ee049e94a00/0x85f5fa77adf3d55b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440400.581313:0:14352:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8ee049e94a00/0x85f5fa77adf3d55b lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440400.581322:0:14352:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8ee049e94a00/0x85f5fa77adf3d55b lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440400.581333:0:14352:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787440400.581487:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee0776ba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+20:3309:x1874266701271296:12345-0@lo:103:ldlm_bl.0 Request processed in 294us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440400.581516:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787440400.581561:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee0776baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c:3309:1874266701271296:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787440400.581590:0:14381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ee07fb9e800/0x85f5fa77adf3d42e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x85f5fa77adf3d427 expref: 19 pid: 14357 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440400.581601:0:14381:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee0776bbb80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14381:1874266701271168:0@lo:104: 00010000:00010000:3.0:1787440400.581619:0:14381:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8ee049e94a00/0x85f5fa77adf3d55b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440400.581627:0:14381:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8ee049e94a00/0x85f5fa77adf3d55b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440400.581632:0:14381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8ee049e94a00/0x85f5fa77adf3d55b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440400.581638:0:14381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ee049e94a00/0x85f5fa77adf3d55b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440400.588002:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04cac4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+18:15766:x1874266701271040:12345-0@lo:253:mount.lustre.0 Request processed in 45759us (45862us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440400.588015:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787440400.588110:0:15766:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee08032dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c:15766:1874266701271040:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787440400.588124:0:15766:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1787440400.588127:0:15766:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787440400.588129:0:15766:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787440400.588130:0:15766:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787440400.588131:0:15766:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787440400.588132:0:15766:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787440400.588133:0:15766:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787440400.588135:0:15766:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787440400.588137:0:15766:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787440400.588138:0:15766:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1787440400.588151:0:15766:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1787440400.595266:0:15766:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1787440400.595669:0:15766:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1787440400.595821:0:15766:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1787440400.595971:0:15766:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1787440400.596117:0:15766:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1787440400.596320:0:15766:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1787440400.597357:0:15766:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:2.0:1787440400.650191:0:15766:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1787440400.650200:0:15766:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1787440400.650292:0:15766:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1787440400.650359:0:15766:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.158@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1787440400.650373:0:15766:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1787440400.650401:0:15766:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:0.0:1787440400.925886:0:14354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787440401.948646:0:14353:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787440402.206602:0:14362:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787440402.206609:0:14362:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8ee0438d0800 from 8 10000000:01000000:3.0:1787440402.206615:0:14362:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787440402.206654:0:14362:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.158@tcp lock: ffff8ee049e94800/0x85f5fa77adf3d562 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440402.206666:0:14362:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.158@tcp lock: ffff8ee049e94800/0x85f5fa77adf3d562 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440402.206677:0:14362:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.158@tcp lock: ffff8ee049e94800/0x85f5fa77adf3d562 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440402.206712:0:14362:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee0776bbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c:14362:1874266701271424:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787440402.206775:0:14362:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440402.206824:0:14362:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee0412edb40 going to sleep for 11 seconds 00000100:00100000:3.0:1787440402.207160:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701271424 00000100:00100000:3.0:1787440402.207167:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701271424 00000100:00100000:3.0:1787440402.207221:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787440402.207238:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04cac5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+18:14362:x1874266701271424:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787440402.207250:0:14360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440402.207263:0:14360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ee049e94a00/0x85f5fa77adf3d569 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x85f5fa77adf3d562 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440402.207283:0:14360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ee049e94a00/0x85f5fa77adf3d569 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x85f5fa77adf3d562 expref: 19 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440402.207305:0:14360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ee049e94a00/0x85f5fa77adf3d569 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f5fa77adf3d562 expref: 19 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440402.207467:0:14360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee049e94a00, rc 0) 00000100:00100000:3.0:1787440402.207584:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04cac5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+19:14362:x1874266701271424:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 347us (807us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440402.207590:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787440402.213609:0:14362:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee0776bbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c:14362:1874266701271424:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787440402.213636:0:14362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.158@tcp lock: ffff8ee049e94800/0x85f5fa77adf3d562 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3d569 expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440402.213648:0:14362:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.158@tcp lock: ffff8ee049e94800/0x85f5fa77adf3d562 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x85f5fa77adf3d569 expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440402.213817:0:14362:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee0776baa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c:14362:1874266701271552:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1787440402.213886:0:14362:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440402.213914:0:14362:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee0412edb40 going to sleep for 11 seconds 00000100:00100000:1.0:1787440402.214050:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701271552 00000100:00100000:1.0:1787440402.214056:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701271552 00000100:00100000:1.0:1787440402.214172:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787440402.214181:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04cac5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+19:14362:x1874266701271552:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1787440402.214200:0:14357:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787440402.214216:0:14357:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787440402.214219:0:14357:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:1.0:1787440402.214325:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04cac5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+19:14362:x1874266701271552:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 135us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440402.214333:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787440402.214511:0:14362:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee0776baa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c:14362:1874266701271552:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1787440402.214583:0:14362:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.158@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787440402.214590:0:14362:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.158@tcp lock: ffff8ee049e94800/0x85f5fa77adf3d562 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3d569 expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440402.214608:0:14362:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.158@tcp lock: ffff8ee049e94800/0x85f5fa77adf3d562 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3d569 expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787440402.959779:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:1.0:1787440402.959858:0:6723:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:0.0:1787440402.973623:0:14354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787440404.015027:0:14353:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787440404.901081:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee0776bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1874266701271680:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787440404.901147:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440404.902061:0:15053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701271680 00000100:00100000:3.0:1787440404.902069:0:15053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701271680 00000100:00100000:3.0:1787440404.902127:0:15053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787440404.902144:0:15053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee08032dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874266701271680:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787440404.902177:0:15053:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1787440404.902247:0:14361:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787440404.912802:0:15053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee08032dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874266701271680:12345-0@lo:13:osp-pre-0-0.0 Request processed in 10652us (11645us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440404.912816:0:15053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787440404.918632:0:3310:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:2.0:1787440404.918678:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee0776bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1874266701271680:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787440405.023839:0:14354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787440405.918985:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787440405.918991:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1787440405.918995:0:37:0:(import.c:65:import_set_state_nolock()) ffff8ee06db94800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787440405.919006:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8ee06db94800 using connection 192.168.206.158@tcp/0@lo 00000100:00100000:1.0:1787440405.919029:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ee050483100 x1874266701272064/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787440405.919092:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee050482a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c:3311:1874266701271808:0@lo:400:kworker.0 00000100:00100000:1.0:1787440405.919155:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440405.919205:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee050480e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1874266701272448:0@lo:400:kworker.0 00000100:00100000:1.0:1787440405.919233:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440405.919258:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787440405.919264:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee050481180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874266701271936:0@lo:400:kworker.0 00000100:00100000:1.0:1787440405.919298:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440405.919329:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee050483100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1874266701272064:0@lo:8:kworker.0 00000100:00100000:1.0:1787440405.919357:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440405.919385:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee050480a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874266701272192:0@lo:400:kworker.0 00000100:00100000:1.0:1787440405.919406:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440405.919425:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787440405.919430:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee050481f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1874266701272320:0@lo:400:kworker.0 00000100:00100000:1.0:1787440405.919451:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440405.919484:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701271808 00000100:00100000:1.0:1787440405.919510:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701271808 00000100:00100000:1.0:1787440405.919561:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787440405.919570:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee08092b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+19:3311:x1874266701271808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440405.919616:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee08092b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+19:3311:x1874266701271808:12345-0@lo:400:kworker.0 Request processed in 47us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440405.919623:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787440405.919652:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701272448 00000100:00100000:1.0:1787440405.919656:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701272448 00000100:00100000:1.0:1787440405.919700:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701272192 00000100:00100000:1.0:1787440405.919704:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701272192 00000100:00100000:1.0:1787440405.919717:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701272320 00000100:00100000:1.0:1787440405.919719:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701272320 00000100:00100000:1.0:1787440405.919737:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787440405.919743:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee050480000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874266701272448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440405.919776:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee050480000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874266701272448:12345-0@lo:400:kworker.0 Request processed in 33us (542us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440405.919782:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787440405.919794:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787440405.919809:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee050480380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874266701272192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440405.919844:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee050480380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874266701272192:12345-0@lo:400:kworker.0 Request processed in 37us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440405.919850:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787440405.919863:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787440405.919870:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee050483800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1874266701272320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440405.919898:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee050483800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1874266701272320:12345-0@lo:400:kworker.0 Request processed in 29us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440405.919904:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787440405.919920:0:15051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701271936 00000100:00100000:1.0:1787440405.919924:0:15051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701271936 00000100:00100000:1.0:1787440405.919946:0:15051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701272064 00000100:00100000:1.0:1787440405.919949:0:15051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701272064 00000100:00100000:1.0:1787440405.919961:0:15051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787440405.919967:0:15051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee050481c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1874266701271936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440405.919996:0:15051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee050481c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1874266701271936:12345-0@lo:400:kworker.0 Request processed in 29us (697us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440405.920002:0:15051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787440405.920014:0:15051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787440405.920019:0:15051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee050481880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3308:x1874266701272064:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1787440405.920041:0:15051:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 504 last 0 00000020:00000080:1.0:1787440405.920065:0:15051:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x85f5fa77adf3d570 00002000:00100000:1.0:1787440405.920079:0:15051:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8edf42a75800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113940 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1787440405.920083:0:15051:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:1.0:1787440405.920086:0:15051:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1787440405.920388:0:15051:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1787440405.920418:0:15051:0:(import.c:65:import_set_state_nolock()) ffff8edf42a75000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787440405.920463:0:15051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee050481880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3308:x1874266701272064:12345-0@lo:8:kworker.0 Request processed in 443us (1104us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440405.920470:0:15051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:1.0:1787440405.920541:0:14361:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787440405.920779:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ee050483100 x1874266701272064/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787440430 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787440405.920794:0:3308:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1787440405.920802:0:3308:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1787440405.920806:0:3308:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1787440405.920809:0:3308:0:(import.c:65:import_set_state_nolock()) ffff8ee06db94800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1787440405.920823:0:3308:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1787440405.920861:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee050483100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1874266701272064:0@lo:8:kworker.0 00000004:00080000:1.0:1787440405.920922:0:14390:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x6:0x0] 00000100:00100000:1.0:1787440405.920940:0:14390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee050482300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14390:1874266701272704:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1787440405.920971:0:14390:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440405.920990:0:14390:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee0478b6540 going to sleep for 11 seconds 00000100:00100000:1.0:1787440405.921005:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee050483100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1874266701272576:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787440405.921007:0:15051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701272704 00000100:00100000:2.0:1787440405.921014:0:15051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701272704 00000100:00100000:1.0:1787440405.921032:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440405.921062:0:15051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787440405.921073:0:15051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee050480700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14390:x1874266701272704:12345-0@lo:5:osp-pre-1-0.0 00000100:00080000:1.0:1787440405.921075:0:14361:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1787440405.921097:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ee050481f80 x1874266701272320/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787440421 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787440405.921108:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee050481f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1874266701272320:0@lo:400:kworker.0 00010000:00080000:1.0:1787440405.921120:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ee050480a80 x1874266701272192/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787440421 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787440405.921128:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee050480a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874266701272192:0@lo:400:kworker.0 00000100:00100000:1.0:1787440405.921342:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee050481180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874266701271936:0@lo:400:kworker.0 00000100:00100000:1.0:1787440405.921352:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee050482a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c:3311:1874266701271808:0@lo:400:kworker.0 00010000:00080000:1.0:1787440405.921362:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ee050480e00 x1874266701272448/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787440421 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787440405.921370:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee050480e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1874266701272448:0@lo:400:kworker.0 00000004:00080000:0.0:1787440405.922875:0:14389:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1787440405.923354:0:14389:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 504293860064ns, next at 0ns, rc = 0 00000100:00100000:0.0:1787440405.923392:0:15052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701272576 00000100:00100000:0.0:1787440405.923402:0:15052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701272576 00000100:00100000:0.0:1787440405.923449:0:15052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787440405.923459:0:15052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee079914380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3312:x1874266701272576:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787440405.923515:0:15052:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787440405.923600:0:15052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee079914380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3312:x1874266701272576:12345-0@lo:13:osp-pre-1-0.0 Request processed in 143us (2567us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440405.923608:0:15052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1787440405.923661:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ee050483100 x1874266701272576/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787440421 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787440405.923757:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee050483100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1874266701272576:0@lo:13:osp-pre-1-0.0 00002000:00080000:2.0:1787440405.924028:0:15051:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:2.0:1787440405.924035:0:15051:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:2.0:1787440405.924042:0:15051:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:7 to 0x280000400:33) 00002000:00010000:2.0:1787440405.929240:0:15051:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787440405.929253:0:15051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e5acaa5e/0x85f5fa77adf3d577 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.929271:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=504s v=(0 0) 00010000:00010000:2.0:1787440405.929276:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787440405.929283:0:15051:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e5acaa5e/0x85f5fa77adf3d577 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.929301:0:15051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e5acaa5e/0x85f5fa77adf3d577 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.929319:0:15051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e5acaa5e/0x85f5fa77adf3d577 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.929327:0:15051:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e5acaa5e/0x85f5fa77adf3d577 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.929351:0:15051:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787440405.929367:0:14353:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787440405.929373:0:14353:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e5acaa5e/0x85f5fa77adf3d577 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.929381:0:14353:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee07f86e400 already unused, calling callback (ffffffffc15b52a0) 00010000:00010000:2.0:1787440405.929385:0:14353:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e5acaa5e/0x85f5fa77adf3d577 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.929394:0:14353:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e5acaa5e/0x85f5fa77adf3d577 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.929411:0:14353:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e5acaa5e/0x85f5fa77adf3d577 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.929418:0:14353:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e5acaa5e/0x85f5fa77adf3d577 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.929438:0:14353:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787440405.929446:0:14353:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787440405.929449:0:14353:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787440405.932436:0:15051:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787440405.932444:0:15051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bc5709cc/0x85f5fa77adf3d57e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.932456:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=504s v=(0 0) 00010000:00010000:2.0:1787440405.932459:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787440405.932464:0:15051:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bc5709cc/0x85f5fa77adf3d57e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.932474:0:15051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bc5709cc/0x85f5fa77adf3d57e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.932481:0:15051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bc5709cc/0x85f5fa77adf3d57e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.932486:0:15051:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bc5709cc/0x85f5fa77adf3d57e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.932514:0:15051:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787440405.932551:0:14354:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787440405.932560:0:14354:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bc5709cc/0x85f5fa77adf3d57e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440405.932581:0:14354:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee07f86e600 already unused, calling callback (ffffffffc15b52a0) 00010000:00010000:0.0:1787440405.932587:0:14354:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bc5709cc/0x85f5fa77adf3d57e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440405.932597:0:14354:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bc5709cc/0x85f5fa77adf3d57e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440405.932631:0:14354:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bc5709cc/0x85f5fa77adf3d57e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440405.932639:0:14354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bc5709cc/0x85f5fa77adf3d57e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787440405.932882:0:15051:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787440405.932887:0:15051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000072c0513f/0x85f5fa77adf3d585 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.932893:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=504s v=(0 0) 00010000:00010000:2.0:1787440405.932895:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787440405.932898:0:15051:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000072c0513f/0x85f5fa77adf3d585 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.932909:0:15051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000072c0513f/0x85f5fa77adf3d585 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.932915:0:15051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000072c0513f/0x85f5fa77adf3d585 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.932919:0:15051:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000072c0513f/0x85f5fa77adf3d585 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.932933:0:15051:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787440405.932951:0:14354:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787440405.932957:0:14354:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000072c0513f/0x85f5fa77adf3d585 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440405.932965:0:14354:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee07f86e000 already unused, calling callback (ffffffffc15b52a0) 00010000:00010000:3.0:1787440405.932969:0:14353:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787440405.932970:0:14354:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000072c0513f/0x85f5fa77adf3d585 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440405.933208:0:14354:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000072c0513f/0x85f5fa77adf3d585 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440405.933221:0:14354:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000072c0513f/0x85f5fa77adf3d585 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440405.933229:0:14354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000072c0513f/0x85f5fa77adf3d585 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440405.933246:0:14354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787440405.933249:0:14354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787440405.933274:0:14354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787440405.933371:0:15051:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787440405.933378:0:15051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000026916e4f/0x85f5fa77adf3d58c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.933386:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=504s v=(0 0) 00010000:00010000:2.0:1787440405.933389:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787440405.933393:0:15051:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000026916e4f/0x85f5fa77adf3d58c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.933402:0:15051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000026916e4f/0x85f5fa77adf3d58c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.933410:0:15051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000026916e4f/0x85f5fa77adf3d58c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.933428:0:15051:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000026916e4f/0x85f5fa77adf3d58c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.933449:0:15051:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787440405.933587:0:14353:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787440405.933594:0:14353:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000026916e4f/0x85f5fa77adf3d58c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440405.933602:0:14353:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee07f86fa00 already unused, calling callback (ffffffffc15b52a0) 00010000:00010000:3.0:1787440405.933607:0:14353:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000026916e4f/0x85f5fa77adf3d58c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440405.933615:0:14353:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000026916e4f/0x85f5fa77adf3d58c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440405.933629:0:14353:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000026916e4f/0x85f5fa77adf3d58c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440405.933637:0:14353:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000026916e4f/0x85f5fa77adf3d58c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440405.933651:0:14353:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787440405.933653:0:14353:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787440405.933655:0:14353:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787440405.933896:0:15051:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787440405.933902:0:15051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003728351c/0x85f5fa77adf3d593 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.933911:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=504s v=(0 0) 00010000:00010000:2.0:1787440405.933915:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787440405.933919:0:15051:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003728351c/0x85f5fa77adf3d593 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.933928:0:15051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003728351c/0x85f5fa77adf3d593 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.933936:0:15051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003728351c/0x85f5fa77adf3d593 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.933943:0:15051:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003728351c/0x85f5fa77adf3d593 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.933957:0:15051:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787440405.934215:0:14354:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787440405.934223:0:14354:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003728351c/0x85f5fa77adf3d593 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440405.934232:0:14354:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee07f86e200 already unused, calling callback (ffffffffc15b52a0) 00010000:00010000:0.0:1787440405.934236:0:14354:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003728351c/0x85f5fa77adf3d593 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440405.934246:0:14354:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003728351c/0x85f5fa77adf3d593 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440405.934259:0:14354:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003728351c/0x85f5fa77adf3d593 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440405.934279:0:14354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003728351c/0x85f5fa77adf3d593 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440405.934300:0:14354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787440405.934302:0:14354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787440405.934306:0:14354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787440405.934339:0:15051:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787440405.934345:0:15051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000155b1b68/0x85f5fa77adf3d59a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.934360:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=504s v=(0 0) 00010000:00010000:2.0:1787440405.934362:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787440405.934366:0:15051:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000155b1b68/0x85f5fa77adf3d59a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.934375:0:15051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000155b1b68/0x85f5fa77adf3d59a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.934383:0:15051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000155b1b68/0x85f5fa77adf3d59a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.934389:0:15051:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000155b1b68/0x85f5fa77adf3d59a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.934474:0:15051:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787440405.934900:0:15051:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787440405.934907:0:15051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e5acaa5e/0x85f5fa77adf3d5a1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.934916:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=504s v=(0 0) 00010000:00010000:2.0:1787440405.934919:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787440405.934923:0:15051:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e5acaa5e/0x85f5fa77adf3d5a1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.934933:0:15051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e5acaa5e/0x85f5fa77adf3d5a1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.934953:0:15051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e5acaa5e/0x85f5fa77adf3d5a1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.934961:0:15051:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e5acaa5e/0x85f5fa77adf3d5a1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.934978:0:15051:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1787440405.934989:0:14354:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787440405.934994:0:14354:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000155b1b68/0x85f5fa77adf3d59a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.935001:0:14354:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee07f86ec00 already unused, calling callback (ffffffffc15b52a0) 00010000:00010000:2.0:1787440405.935004:0:14354:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000155b1b68/0x85f5fa77adf3d59a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.935012:0:14354:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000155b1b68/0x85f5fa77adf3d59a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.935024:0:14354:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000155b1b68/0x85f5fa77adf3d59a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.935031:0:14354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000155b1b68/0x85f5fa77adf3d59a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.935045:0:14354:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787440405.935126:0:14354:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e5acaa5e/0x85f5fa77adf3d5a1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.935133:0:14354:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee07f86e400 already unused, calling callback (ffffffffc15b52a0) 00010000:00010000:2.0:1787440405.935136:0:14354:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e5acaa5e/0x85f5fa77adf3d5a1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.935143:0:14354:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e5acaa5e/0x85f5fa77adf3d5a1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.935154:0:14354:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e5acaa5e/0x85f5fa77adf3d5a1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.935161:0:14354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e5acaa5e/0x85f5fa77adf3d5a1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.935174:0:14354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787440405.935176:0:14354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787440405.935178:0:14354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787440405.935414:0:14353:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787440405.935615:0:15051:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787440405.935622:0:15051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004390d788/0x85f5fa77adf3d5a8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.935632:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=504s v=(0 0) 00010000:00010000:2.0:1787440405.935635:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787440405.935639:0:15051:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004390d788/0x85f5fa77adf3d5a8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.935661:0:15051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004390d788/0x85f5fa77adf3d5a8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.935670:0:15051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004390d788/0x85f5fa77adf3d5a8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.935677:0:15051:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004390d788/0x85f5fa77adf3d5a8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.935695:0:15051:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787440405.935796:0:14354:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787440405.935802:0:14354:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004390d788/0x85f5fa77adf3d5a8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440405.935810:0:14354:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee07f86f200 already unused, calling callback (ffffffffc15b52a0) 00010000:00010000:3.0:1787440405.935814:0:14354:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004390d788/0x85f5fa77adf3d5a8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440405.935822:0:14354:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004390d788/0x85f5fa77adf3d5a8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440405.935834:0:14354:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004390d788/0x85f5fa77adf3d5a8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440405.935842:0:14354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004390d788/0x85f5fa77adf3d5a8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440405.935857:0:14354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787440405.935859:0:14354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787440405.935861:0:14354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787440405.936118:0:15051:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787440405.936124:0:15051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000218ff76f/0x85f5fa77adf3d5af lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.936133:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=504s v=(0 0) 00010000:00010000:2.0:1787440405.936137:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787440405.936141:0:15051:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000218ff76f/0x85f5fa77adf3d5af lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.936162:0:15051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000218ff76f/0x85f5fa77adf3d5af lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.936170:0:15051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000218ff76f/0x85f5fa77adf3d5af lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.936188:0:15051:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000218ff76f/0x85f5fa77adf3d5af lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.936320:0:15051:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787440405.936368:0:14353:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787440405.936373:0:14353:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000218ff76f/0x85f5fa77adf3d5af lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440405.936381:0:14353:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee07f86f600 already unused, calling callback (ffffffffc15b52a0) 00010000:00010000:3.0:1787440405.936385:0:14353:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000218ff76f/0x85f5fa77adf3d5af lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787440405.936784:0:15051:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787440405.936791:0:15051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e1e0d9b4/0x85f5fa77adf3d5b6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.936800:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=504s v=(0 0) 00010000:00010000:2.0:1787440405.936803:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787440405.936808:0:15051:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e1e0d9b4/0x85f5fa77adf3d5b6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.936817:0:15051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e1e0d9b4/0x85f5fa77adf3d5b6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.936825:0:15051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e1e0d9b4/0x85f5fa77adf3d5b6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.936832:0:15051:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e1e0d9b4/0x85f5fa77adf3d5b6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440405.936846:0:14353:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000218ff76f/0x85f5fa77adf3d5af lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.936847:0:15051:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787440405.936856:0:14354:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787440405.936859:0:14353:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000218ff76f/0x85f5fa77adf3d5af lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440405.936866:0:14353:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000218ff76f/0x85f5fa77adf3d5af lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440405.936882:0:14353:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787440405.936883:0:14353:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787440405.936885:0:14353:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787440405.937128:0:16029:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787440405.937131:0:16029:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787440405.937133:0:16029:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787440405.937184:0:14354:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e1e0d9b4/0x85f5fa77adf3d5b6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.937200:0:14354:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee07f86ee00 already unused, calling callback (ffffffffc15b52a0) 00010000:00010000:2.0:1787440405.937859:0:14354:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e1e0d9b4/0x85f5fa77adf3d5b6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.937873:0:14354:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e1e0d9b4/0x85f5fa77adf3d5b6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.937887:0:14354:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e1e0d9b4/0x85f5fa77adf3d5b6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.937895:0:14354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e1e0d9b4/0x85f5fa77adf3d5b6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.937916:0:14354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787440405.937917:0:14354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787440405.937919:0:14354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787440405.939062:0:15051:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787440405.939075:0:15051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000072c0513f/0x85f5fa77adf3d5bd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.939088:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=504s v=(0 0) 00010000:00010000:2.0:1787440405.939093:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787440405.939099:0:15051:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000072c0513f/0x85f5fa77adf3d5bd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.939112:0:15051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000072c0513f/0x85f5fa77adf3d5bd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.939127:0:15051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000072c0513f/0x85f5fa77adf3d5bd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.939134:0:15051:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000072c0513f/0x85f5fa77adf3d5bd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.939277:0:15051:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787440405.939335:0:14353:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787440405.939341:0:14353:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000072c0513f/0x85f5fa77adf3d5bd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440405.939349:0:14353:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee07f86e000 already unused, calling callback (ffffffffc15b52a0) 00010000:00010000:3.0:1787440405.939354:0:14353:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000072c0513f/0x85f5fa77adf3d5bd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440405.939362:0:14353:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000072c0513f/0x85f5fa77adf3d5bd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440405.939387:0:14353:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000072c0513f/0x85f5fa77adf3d5bd lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440405.939394:0:14353:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000072c0513f/0x85f5fa77adf3d5bd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440405.939411:0:14353:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787440405.939413:0:14353:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787440405.939415:0:14353:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787440405.939917:0:15051:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787440405.939924:0:15051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e5acaa5e/0x85f5fa77adf3d5c4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.939933:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=504s v=(0 0) 00010000:00010000:2.0:1787440405.939937:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787440405.939941:0:15051:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e5acaa5e/0x85f5fa77adf3d5c4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.939964:0:15051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e5acaa5e/0x85f5fa77adf3d5c4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.939973:0:15051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e5acaa5e/0x85f5fa77adf3d5c4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.939979:0:15051:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e5acaa5e/0x85f5fa77adf3d5c4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.940008:0:15051:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787440405.940094:0:16029:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787440405.940100:0:16029:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e5acaa5e/0x85f5fa77adf3d5c4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440405.940108:0:16029:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee07f86e400 already unused, calling callback (ffffffffc15b52a0) 00010000:00010000:3.0:1787440405.940112:0:16029:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e5acaa5e/0x85f5fa77adf3d5c4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440405.940118:0:16029:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e5acaa5e/0x85f5fa77adf3d5c4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440405.940129:0:16029:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e5acaa5e/0x85f5fa77adf3d5c4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440405.940136:0:16029:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e5acaa5e/0x85f5fa77adf3d5c4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440405.940279:0:16029:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787440405.940282:0:16029:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787440405.940284:0:16029:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787440405.941001:0:15051:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787440405.941013:0:15051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000155b1b68/0x85f5fa77adf3d5cb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.941024:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=504s v=(0 0) 00010000:00010000:2.0:1787440405.941028:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787440405.941032:0:15051:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000155b1b68/0x85f5fa77adf3d5cb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.941044:0:15051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000155b1b68/0x85f5fa77adf3d5cb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.941052:0:15051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000155b1b68/0x85f5fa77adf3d5cb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.941060:0:15051:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000155b1b68/0x85f5fa77adf3d5cb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.941085:0:15051:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787440405.941318:0:14354:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787440405.941325:0:14354:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000155b1b68/0x85f5fa77adf3d5cb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440405.941335:0:14354:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee07f86ec00 already unused, calling callback (ffffffffc15b52a0) 00010000:00010000:3.0:1787440405.941339:0:14354:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000155b1b68/0x85f5fa77adf3d5cb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440405.941348:0:14354:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000155b1b68/0x85f5fa77adf3d5cb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440405.941366:0:14354:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000155b1b68/0x85f5fa77adf3d5cb lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440405.941373:0:14354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000155b1b68/0x85f5fa77adf3d5cb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440405.941390:0:14354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787440405.941392:0:14354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787440405.941394:0:14354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787440405.941906:0:15051:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787440405.941912:0:15051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bc5709cc/0x85f5fa77adf3d5d2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.941919:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=504s v=(0 0) 00010000:00010000:2.0:1787440405.941927:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787440405.941931:0:15051:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bc5709cc/0x85f5fa77adf3d5d2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.941939:0:15051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bc5709cc/0x85f5fa77adf3d5d2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.941944:0:15051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bc5709cc/0x85f5fa77adf3d5d2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.941949:0:15051:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bc5709cc/0x85f5fa77adf3d5d2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.941965:0:15051:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787440405.942012:0:14353:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787440405.942020:0:14353:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bc5709cc/0x85f5fa77adf3d5d2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440405.942030:0:14353:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee07f86e600 already unused, calling callback (ffffffffc15b52a0) 00010000:00010000:0.0:1787440405.942035:0:14353:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bc5709cc/0x85f5fa77adf3d5d2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440405.942063:0:14353:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bc5709cc/0x85f5fa77adf3d5d2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440405.942077:0:14353:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bc5709cc/0x85f5fa77adf3d5d2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440405.942085:0:14353:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bc5709cc/0x85f5fa77adf3d5d2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440405.942106:0:14353:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787440405.942109:0:14353:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787440405.942111:0:14353:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787440405.942406:0:15051:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787440405.942411:0:15051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000026916e4f/0x85f5fa77adf3d5d9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.942417:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=504s v=(0 0) 00010000:00010000:2.0:1787440405.942419:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787440405.942422:0:15051:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000026916e4f/0x85f5fa77adf3d5d9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.942428:0:15051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000026916e4f/0x85f5fa77adf3d5d9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.942433:0:15051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000026916e4f/0x85f5fa77adf3d5d9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.942442:0:15051:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000026916e4f/0x85f5fa77adf3d5d9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.942461:0:15051:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787440405.942596:0:16029:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787440405.942601:0:16029:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000026916e4f/0x85f5fa77adf3d5d9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440405.942609:0:16029:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee07f86fa00 already unused, calling callback (ffffffffc15b52a0) 00010000:00010000:0.0:1787440405.942613:0:16029:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000026916e4f/0x85f5fa77adf3d5d9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440405.942621:0:16029:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000026916e4f/0x85f5fa77adf3d5d9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440405.942633:0:16029:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000026916e4f/0x85f5fa77adf3d5d9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440405.942651:0:16029:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000026916e4f/0x85f5fa77adf3d5d9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440405.942665:0:16029:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787440405.942667:0:16029:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787440405.942669:0:16029:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787440405.942862:0:15051:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787440405.942868:0:15051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003728351c/0x85f5fa77adf3d5e0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.942876:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=504s v=(0 0) 00010000:00010000:2.0:1787440405.942879:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787440405.942884:0:15051:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003728351c/0x85f5fa77adf3d5e0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.942894:0:15051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003728351c/0x85f5fa77adf3d5e0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.942902:0:15051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003728351c/0x85f5fa77adf3d5e0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.942908:0:15051:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003728351c/0x85f5fa77adf3d5e0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.942929:0:15051:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787440405.942976:0:14354:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787440405.942982:0:14354:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003728351c/0x85f5fa77adf3d5e0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440405.942990:0:14354:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee07f86e200 already unused, calling callback (ffffffffc15b52a0) 00010000:00010000:0.0:1787440405.942994:0:14354:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003728351c/0x85f5fa77adf3d5e0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440405.943001:0:14354:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003728351c/0x85f5fa77adf3d5e0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440405.943012:0:14354:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003728351c/0x85f5fa77adf3d5e0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440405.943020:0:14354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003728351c/0x85f5fa77adf3d5e0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440405.943033:0:14354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787440405.943035:0:14354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787440405.943036:0:14354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787440405.943319:0:15051:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787440405.943326:0:15051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007c0594ea/0x85f5fa77adf3d5e7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.943340:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=504s v=(0 0) 00010000:00010000:2.0:1787440405.943343:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787440405.943347:0:15051:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007c0594ea/0x85f5fa77adf3d5e7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.943356:0:15051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007c0594ea/0x85f5fa77adf3d5e7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.943364:0:15051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007c0594ea/0x85f5fa77adf3d5e7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.943371:0:15051:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007c0594ea/0x85f5fa77adf3d5e7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.943387:0:15051:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787440405.943396:0:14353:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787440405.943400:0:14353:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007c0594ea/0x85f5fa77adf3d5e7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.943420:0:14353:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee082163c00 already unused, calling callback (ffffffffc15b52a0) 00010000:00010000:2.0:1787440405.943424:0:14353:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007c0594ea/0x85f5fa77adf3d5e7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.943431:0:14353:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007c0594ea/0x85f5fa77adf3d5e7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.943458:0:14353:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007c0594ea/0x85f5fa77adf3d5e7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.943465:0:14353:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007c0594ea/0x85f5fa77adf3d5e7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.943479:0:14353:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787440405.943481:0:14353:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787440405.943483:0:14353:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787440405.944485:0:15051:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787440405.944518:0:15051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006f93a110/0x85f5fa77adf3d5ee lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.944543:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=504s v=(0 0) 00010000:00010000:2.0:1787440405.944546:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787440405.944550:0:15051:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006f93a110/0x85f5fa77adf3d5ee lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.944562:0:15051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006f93a110/0x85f5fa77adf3d5ee lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.944572:0:15051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006f93a110/0x85f5fa77adf3d5ee lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.944579:0:15051:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006f93a110/0x85f5fa77adf3d5ee lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.944609:0:15051:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787440405.944621:0:16029:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787440405.944626:0:16029:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006f93a110/0x85f5fa77adf3d5ee lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.944633:0:16029:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee082163e00 already unused, calling callback (ffffffffc15b52a0) 00010000:00010000:2.0:1787440405.944637:0:16029:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006f93a110/0x85f5fa77adf3d5ee lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.944644:0:16029:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006f93a110/0x85f5fa77adf3d5ee lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.944656:0:16029:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006f93a110/0x85f5fa77adf3d5ee lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.944663:0:16029:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006f93a110/0x85f5fa77adf3d5ee lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.944680:0:16029:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787440405.944682:0:16029:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787440405.944685:0:16029:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787440405.945140:0:15051:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787440405.945146:0:15051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d050eb52/0x85f5fa77adf3d5f5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.945156:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=504s v=(0 0) 00010000:00010000:2.0:1787440405.945165:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787440405.945171:0:15051:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d050eb52/0x85f5fa77adf3d5f5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.945182:0:15051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d050eb52/0x85f5fa77adf3d5f5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.945190:0:15051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d050eb52/0x85f5fa77adf3d5f5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.945197:0:15051:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d050eb52/0x85f5fa77adf3d5f5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.945210:0:15051:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787440405.945656:0:15051:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787440405.945662:0:15051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000068d5df5d/0x85f5fa77adf3d5fc lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.945671:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=504s v=(0 0) 00010000:00010000:2.0:1787440405.945674:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787440405.945679:0:15051:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000068d5df5d/0x85f5fa77adf3d5fc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.945690:0:15051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000068d5df5d/0x85f5fa77adf3d5fc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.945699:0:15051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000068d5df5d/0x85f5fa77adf3d5fc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.945712:0:15051:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000068d5df5d/0x85f5fa77adf3d5fc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.945728:0:15051:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1787440405.945739:0:14353:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787440405.945744:0:14353:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d050eb52/0x85f5fa77adf3d5f5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.945751:0:14353:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee082162600 already unused, calling callback (ffffffffc15b52a0) 00010000:00010000:2.0:1787440405.945756:0:14353:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d050eb52/0x85f5fa77adf3d5f5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.945765:0:14353:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d050eb52/0x85f5fa77adf3d5f5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.945780:0:14353:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d050eb52/0x85f5fa77adf3d5f5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.945787:0:14353:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d050eb52/0x85f5fa77adf3d5f5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.945803:0:14353:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787440405.945807:0:14353:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000068d5df5d/0x85f5fa77adf3d5fc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.945825:0:14353:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee082162a00 already unused, calling callback (ffffffffc15b52a0) 00010000:00010000:2.0:1787440405.945829:0:14353:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000068d5df5d/0x85f5fa77adf3d5fc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.945837:0:14353:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000068d5df5d/0x85f5fa77adf3d5fc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.945848:0:14353:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000068d5df5d/0x85f5fa77adf3d5fc lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.945855:0:14353:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000068d5df5d/0x85f5fa77adf3d5fc lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.945868:0:14353:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787440405.945870:0:14353:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787440405.945873:0:14353:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787440405.946303:0:15051:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787440405.946310:0:15051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000056f40619/0x85f5fa77adf3d603 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.946318:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=504s v=(0 0) 00010000:00010000:2.0:1787440405.946321:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787440405.946326:0:15051:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000056f40619/0x85f5fa77adf3d603 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.946334:0:15051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000056f40619/0x85f5fa77adf3d603 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.946348:0:15051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000056f40619/0x85f5fa77adf3d603 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.946355:0:15051:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000056f40619/0x85f5fa77adf3d603 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.946370:0:15051:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787440405.946379:0:16029:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787440405.946383:0:16029:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000056f40619/0x85f5fa77adf3d603 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.946389:0:16029:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee082163000 already unused, calling callback (ffffffffc15b52a0) 00010000:00010000:2.0:1787440405.946392:0:16029:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000056f40619/0x85f5fa77adf3d603 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.946400:0:16029:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000056f40619/0x85f5fa77adf3d603 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.946411:0:16029:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000056f40619/0x85f5fa77adf3d603 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.946418:0:16029:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000056f40619/0x85f5fa77adf3d603 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.946431:0:16029:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787440405.946438:0:16029:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787440405.946440:0:16029:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787440405.946960:0:15051:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787440405.946966:0:15051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ab20d29f/0x85f5fa77adf3d60a lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.946975:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=504s v=(0 0) 00010000:00010000:2.0:1787440405.946978:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787440405.946982:0:15051:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ab20d29f/0x85f5fa77adf3d60a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.946992:0:15051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ab20d29f/0x85f5fa77adf3d60a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.947000:0:15051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ab20d29f/0x85f5fa77adf3d60a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.947008:0:15051:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ab20d29f/0x85f5fa77adf3d60a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.947024:0:15051:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787440405.947033:0:14353:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787440405.947037:0:14353:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ab20d29f/0x85f5fa77adf3d60a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.947044:0:14353:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee082162400 already unused, calling callback (ffffffffc15b52a0) 00010000:00010000:2.0:1787440405.947047:0:14353:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ab20d29f/0x85f5fa77adf3d60a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.947066:0:14353:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ab20d29f/0x85f5fa77adf3d60a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.947078:0:14353:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ab20d29f/0x85f5fa77adf3d60a lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.947084:0:14353:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ab20d29f/0x85f5fa77adf3d60a lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.947098:0:14353:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787440405.947100:0:14353:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787440405.947102:0:14353:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787440405.947613:0:15051:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787440405.947619:0:15051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fd156403/0x85f5fa77adf3d611 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.947627:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=504s v=(0 0) 00010000:00010000:2.0:1787440405.947630:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787440405.947635:0:15051:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fd156403/0x85f5fa77adf3d611 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.947644:0:15051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fd156403/0x85f5fa77adf3d611 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.947651:0:15051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fd156403/0x85f5fa77adf3d611 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.947669:0:15051:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fd156403/0x85f5fa77adf3d611 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.947683:0:15051:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787440405.947691:0:16029:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787440405.947696:0:16029:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fd156403/0x85f5fa77adf3d611 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.947703:0:16029:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee082162200 already unused, calling callback (ffffffffc15b52a0) 00010000:00010000:2.0:1787440405.947707:0:16029:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fd156403/0x85f5fa77adf3d611 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.947714:0:16029:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fd156403/0x85f5fa77adf3d611 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.947727:0:16029:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fd156403/0x85f5fa77adf3d611 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.947734:0:16029:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fd156403/0x85f5fa77adf3d611 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.947752:0:16029:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787440405.947754:0:16029:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787440405.947758:0:16029:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787440405.948207:0:15051:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787440405.948220:0:15051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000091030ef/0x85f5fa77adf3d618 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.948229:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=504s v=(0 0) 00010000:00010000:2.0:1787440405.948232:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787440405.948236:0:15051:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000091030ef/0x85f5fa77adf3d618 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.948246:0:15051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000091030ef/0x85f5fa77adf3d618 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.948253:0:15051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000091030ef/0x85f5fa77adf3d618 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.948260:0:15051:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000091030ef/0x85f5fa77adf3d618 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.948274:0:15051:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787440405.948285:0:14353:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787440405.948289:0:14353:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000091030ef/0x85f5fa77adf3d618 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.948296:0:14353:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee082163800 already unused, calling callback (ffffffffc15b52a0) 00010000:00010000:2.0:1787440405.948300:0:14353:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000091030ef/0x85f5fa77adf3d618 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.948308:0:14353:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000091030ef/0x85f5fa77adf3d618 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.948328:0:14353:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000091030ef/0x85f5fa77adf3d618 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.948335:0:14353:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000091030ef/0x85f5fa77adf3d618 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.948349:0:14353:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787440405.948351:0:14353:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787440405.948353:0:14353:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787440405.948889:0:15051:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787440405.948896:0:15051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cfcca6e8/0x85f5fa77adf3d61f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.948905:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=504s v=(0 0) 00010000:00010000:2.0:1787440405.948908:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787440405.948913:0:15051:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cfcca6e8/0x85f5fa77adf3d61f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.948923:0:15051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cfcca6e8/0x85f5fa77adf3d61f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.948931:0:15051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cfcca6e8/0x85f5fa77adf3d61f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.948938:0:15051:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cfcca6e8/0x85f5fa77adf3d61f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.948963:0:15051:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787440405.948973:0:16029:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787440405.948977:0:16029:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cfcca6e8/0x85f5fa77adf3d61f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.948984:0:16029:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee082163600 already unused, calling callback (ffffffffc15b52a0) 00010000:00010000:2.0:1787440405.948988:0:16029:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cfcca6e8/0x85f5fa77adf3d61f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.948996:0:16029:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cfcca6e8/0x85f5fa77adf3d61f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.949007:0:16029:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cfcca6e8/0x85f5fa77adf3d61f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.949014:0:16029:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cfcca6e8/0x85f5fa77adf3d61f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.949027:0:16029:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787440405.949029:0:16029:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787440405.949031:0:16029:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787440405.949242:0:14354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787440405.949428:0:15051:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787440405.949434:0:15051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eec908ea/0x85f5fa77adf3d626 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.949442:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=504s v=(0 0) 00010000:00010000:2.0:1787440405.949449:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787440405.949454:0:15051:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eec908ea/0x85f5fa77adf3d626 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.949463:0:15051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eec908ea/0x85f5fa77adf3d626 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.949471:0:15051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eec908ea/0x85f5fa77adf3d626 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.949478:0:15051:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000eec908ea/0x85f5fa77adf3d626 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.949543:0:15051:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787440405.949553:0:14353:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787440405.949557:0:14353:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000eec908ea/0x85f5fa77adf3d626 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.949564:0:14353:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8edf42bdf800 already unused, calling callback (ffffffffc15b52a0) 00010000:00010000:2.0:1787440405.949567:0:14353:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000eec908ea/0x85f5fa77adf3d626 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.949575:0:14353:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000eec908ea/0x85f5fa77adf3d626 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.949587:0:14353:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000eec908ea/0x85f5fa77adf3d626 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.949606:0:14353:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eec908ea/0x85f5fa77adf3d626 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.949623:0:14353:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787440405.949626:0:14353:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787440405.949629:0:14353:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787440405.950040:0:15051:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787440405.950045:0:15051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d438e9b7/0x85f5fa77adf3d62d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.950053:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=504s v=(0 0) 00010000:00010000:2.0:1787440405.950055:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787440405.950060:0:15051:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d438e9b7/0x85f5fa77adf3d62d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.950069:0:15051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d438e9b7/0x85f5fa77adf3d62d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.950077:0:15051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d438e9b7/0x85f5fa77adf3d62d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.950084:0:15051:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d438e9b7/0x85f5fa77adf3d62d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.950098:0:15051:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787440405.950106:0:16029:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787440405.950115:0:16029:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d438e9b7/0x85f5fa77adf3d62d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.950122:0:16029:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8edf42bdf000 already unused, calling callback (ffffffffc15b52a0) 00010000:00010000:2.0:1787440405.950125:0:16029:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d438e9b7/0x85f5fa77adf3d62d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.950131:0:16029:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d438e9b7/0x85f5fa77adf3d62d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.950141:0:16029:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d438e9b7/0x85f5fa77adf3d62d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.950147:0:16029:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d438e9b7/0x85f5fa77adf3d62d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440405.950158:0:16029:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787440405.950160:0:16029:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787440405.950161:0:16029:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:2.0:1787440405.950363:0:15051:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:6 00000100:00100000:2.0:1787440405.950447:0:15051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee050480700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14390:x1874266701272704:12345-0@lo:5:osp-pre-1-0.0 Request processed in 29373us (29472us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440405.950457:0:15051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787440405.950543:0:14390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee050482300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14390:1874266701272704:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1787440405.950557:0:14390:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x6:0x0] 00000100:00100000:2.0:1787440405.950600:0:14390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee08032d180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14390:1874266701272832:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1787440405.950646:0:14390:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440405.950672:0:14390:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee0478f2540 going to sleep for 11 seconds 00000100:00100000:2.0:1787440405.950689:0:15051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701272832 00000100:00100000:2.0:1787440405.950694:0:15051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701272832 00000100:00100000:2.0:1787440405.950728:0:15051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787440405.950736:0:15051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee08032e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14390:x1874266701272832:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1787440405.950770:0:15051:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00000100:00100000:2.0:1787440405.955282:0:15051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee08032e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:14390:x1874266701272832:12345-0@lo:5:osp-pre-1-0.0 Request processed in 4541us (4629us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1787440405.955294:0:15051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787440405.955348:0:14390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee08032d180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14390:1874266701272832:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1787440405.955362:0:14390:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000004:00080000:0.0:1787440405.999025:0:5871:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00010000:00010000:1.0:1787440406.045708:0:14354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787440406.430151:0:14399:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787440407.068818:0:14353:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787440407.269747:0:16123:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg658-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1787440408.097834:0:16029:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787440409.116831:0:14354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787440409.725782:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440409.726563:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681352960 00000100:00100000:0.0:1787440409.726577:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681352960 00000100:00100000:0.0:1787440409.726631:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 75 00000100:00100000:0.0:1787440409.726641:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee08092b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2359:x1874266681352960:12345-192.168.206.58@tcp:250:mount.lustre.0 00010000:00080000:0.0:1787440409.726676:0:14358:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 83c71368-e5e9-44e8-856a-ef5507fb8c2a@192.168.206.58@tcp t0 exp 0000000000000000 cur 508 last 0 00000020:00000080:0.0:1787440409.726747:0:14358:0:(genops.c:1385:class_connect()) connect: client 83c71368-e5e9-44e8-856a-ef5507fb8c2a, cookie 0x85f5fa77adf3d634 00000100:00080000:0.0:1787440409.726953:0:14358:0:(import.c:65:import_set_state_nolock()) ffff8ee045300000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787440409.727034:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee08092b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83c71368-e5e9-44e8-856a-ef5507fb8c2a+5:2359:x1874266681352960:12345-192.168.206.58@tcp:250:mount.lustre.0 Request processed in 393us (1267us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440409.727043:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 75 00000100:00100000:1.0:1787440409.740437:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:2.0:1787440409.740908:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681353088 00000100:00100000:2.0:1787440409.740921:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681353088 00000100:00100000:2.0:1787440409.740993:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 76 00000100:00100000:2.0:1787440409.741006:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee08092a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83c71368-e5e9-44e8-856a-ef5507fb8c2a+5:13759:x1874266681353088:12345-192.168.206.58@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787440409.741028:0:14357:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440409.741050:0:14357:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8edf42bde600/0x85f5fa77adf3d63b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fab14535dc62512 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440409.741085:0:14357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8edf42bde600/0x85f5fa77adf3d63b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62512 expref: 6 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440409.741113:0:14357:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8edf42bde600/0x85f5fa77adf3d63b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62512 expref: 6 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440409.741124:0:14357:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8edf42bde600, rc 0) 00000100:00100000:2.0:1787440409.741193:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee08092a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83c71368-e5e9-44e8-856a-ef5507fb8c2a+6:13759:x1874266681353088:12345-192.168.206.58@tcp:101:mount.lustre.0 Request processed in 189us (770us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440409.741200:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 76 00000100:00100000:2.0:1787440409.746781:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440409.746826:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681353216 00000100:00100000:0.0:1787440409.746838:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681353216 00000100:00100000:0.0:1787440409.748444:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 77 00000100:00100000:0.0:1787440409.765204:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee08092ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83c71368-e5e9-44e8-856a-ef5507fb8c2a+6:13759:x1874266681353216:12345-192.168.206.58@tcp:501:mount.lustre.0 00000100:00100000:1.0:1787440409.766396:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee08092ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83c71368-e5e9-44e8-856a-ef5507fb8c2a+6:13759:x1874266681353216:12345-192.168.206.58@tcp:501:mount.lustre.0 Request processed in 17927us (19617us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787440409.766413:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 77 00000100:00100000:2.0:1787440409.769037:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:1.0:1787440409.769102:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681353344 00000100:00100000:1.0:1787440409.769116:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681353344 00000100:00100000:1.0:1787440409.769199:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 78 00000100:00100000:1.0:1787440409.769209:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee08092bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83c71368-e5e9-44e8-856a-ef5507fb8c2a+6:13759:x1874266681353344:12345-192.168.206.58@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787440409.769224:0:14358:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440409.769241:0:14358:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ee07fb9f000/0x85f5fa77adf3d642 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fab14535dc62519 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440409.769266:0:14358:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ee07fb9f000/0x85f5fa77adf3d642 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62519 expref: 7 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440409.770107:0:14358:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ee07fb9f000/0x85f5fa77adf3d642 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62519 expref: 7 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440409.770138:0:14358:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee07fb9f000, rc 0) 00000100:00100000:1.0:1787440409.770202:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee08092bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83c71368-e5e9-44e8-856a-ef5507fb8c2a+7:13759:x1874266681353344:12345-192.168.206.58@tcp:101:mount.lustre.0 Request processed in 994us (1178us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440409.770210:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 78 00000100:00100000:1.0:1787440409.773130:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:2.0:1787440409.773302:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681353472 00000100:00100000:2.0:1787440409.773404:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681353472 00000100:00100000:2.0:1787440409.773979:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 79 00000100:00100000:2.0:1787440409.773993:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee080929c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83c71368-e5e9-44e8-856a-ef5507fb8c2a+7:13759:x1874266681353472:12345-192.168.206.58@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787440409.774365:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee080929c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83c71368-e5e9-44e8-856a-ef5507fb8c2a+8:13759:x1874266681353472:12345-192.168.206.58@tcp:501:mount.lustre.0 Request processed in 375us (1247us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440409.774375:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 79 00000100:00100000:0.0:1787440409.777243:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:1.0:1787440409.777424:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681353600 00000100:00100000:1.0:1787440409.777434:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681353600 00000100:00100000:1.0:1787440409.777590:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 80 00000100:00100000:1.0:1787440409.777610:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee080928450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83c71368-e5e9-44e8-856a-ef5507fb8c2a+8:13759:x1874266681353600:12345-192.168.206.58@tcp:503:mount.lustre.0 00000100:00100000:1.0:1787440409.777820:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee080928450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83c71368-e5e9-44e8-856a-ef5507fb8c2a+8:13759:x1874266681353600:12345-192.168.206.58@tcp:503:mount.lustre.0 Request processed in 220us (584us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440409.777829:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 80 00000100:00100000:3.0:1787440409.782098:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:2.0:1787440409.782299:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681353728 00000100:00100000:2.0:1787440409.782406:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681353728 00000100:00100000:2.0:1787440409.782636:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 81 00000100:00100000:2.0:1787440409.782650:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee080928850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83c71368-e5e9-44e8-856a-ef5507fb8c2a+8:13777:x1874266681353728:12345-192.168.206.58@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787440409.783120:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee080928850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83c71368-e5e9-44e8-856a-ef5507fb8c2a+8:13777:x1874266681353728:12345-192.168.206.58@tcp:502:llog_process_th.0 Request processed in 473us (1036us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440409.783130:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 81 00000100:00100000:3.0:1787440409.825980:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:1.0:1787440409.827233:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681353856 00000100:00100000:1.0:1787440409.827245:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681353856 00000100:00100000:1.0:1787440409.827312:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 82 00000100:00100000:1.0:1787440409.827322:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee08092a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83c71368-e5e9-44e8-856a-ef5507fb8c2a+8:13777:x1874266681353856:12345-192.168.206.58@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787440409.827703:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee08092a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83c71368-e5e9-44e8-856a-ef5507fb8c2a+8:13777:x1874266681353856:12345-192.168.206.58@tcp:502:llog_process_th.0 Request processed in 380us (1728us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440409.827712:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 82 00000100:00100000:0.0:1787440409.832113:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:2.0:1787440409.835616:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681353984 00000100:00100000:2.0:1787440409.835629:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681353984 00000100:00100000:2.0:1787440409.835714:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 83 00000100:00100000:2.0:1787440409.835724:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee08092b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83c71368-e5e9-44e8-856a-ef5507fb8c2a+8:13759:x1874266681353984:12345-192.168.206.58@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787440409.835742:0:14360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440409.835760:0:14360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8edf42bdec00/0x85f5fa77adf3d649 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fab14535dc62543 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440409.835793:0:14360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8edf42bdec00/0x85f5fa77adf3d649 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62543 expref: 9 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440409.835805:0:14360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8edf42bdec00/0x85f5fa77adf3d649 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62543 expref: 9 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440409.835815:0:14360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8edf42bdec00, rc 0) 00000100:00100000:2.0:1787440409.835890:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee08092b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83c71368-e5e9-44e8-856a-ef5507fb8c2a+9:13759:x1874266681353984:12345-192.168.206.58@tcp:101:mount.lustre.0 Request processed in 167us (3786us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440409.835898:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 83 00000100:00100000:3.0:1787440409.852093:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440409.852183:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681354112 00000100:00100000:0.0:1787440409.852194:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681354112 00000100:00100000:0.0:1787440409.852306:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 84 00000100:00100000:0.0:1787440409.852318:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee080929850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83c71368-e5e9-44e8-856a-ef5507fb8c2a+9:13759:x1874266681354112:12345-192.168.206.58@tcp:256:mount.lustre.0 20000000:01000000:0.0:1787440409.852344:0:14358:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1787440409.852366:0:14358:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1787440409.852369:0:14358:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1787440409.852372:0:14358:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1787440409.852375:0:14358:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:0.0:1787440409.856336:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee080929850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83c71368-e5e9-44e8-856a-ef5507fb8c2a+9:13759:x1874266681354112:12345-192.168.206.58@tcp:256:mount.lustre.0 Request processed in 4009us (4239us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440409.856351:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 84 00000100:00100000:1.0:1787440409.869118:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:2.0:1787440409.869264:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681354240 00000100:00100000:2.0:1787440409.869283:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681354240 00000100:00100000:1.0:1787440409.869551:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 85 00000100:00100000:1.0:1787440409.869562:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee08092a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83c71368-e5e9-44e8-856a-ef5507fb8c2a+9:13759:x1874266681354240:12345-192.168.206.58@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787440409.869576:0:14360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440409.869590:0:14360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ee07fb9fa00/0x85f5fa77adf3d650 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fab14535dc6254a expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440409.869624:0:14360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ee07fb9fa00/0x85f5fa77adf3d650 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6254a expref: 10 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440409.869646:0:14360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ee07fb9fa00/0x85f5fa77adf3d650 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6254a expref: 10 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440409.869656:0:14360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee07fb9fa00, rc 0) 00000100:00100000:1.0:1787440409.869701:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee08092a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83c71368-e5e9-44e8-856a-ef5507fb8c2a+10:13759:x1874266681354240:12345-192.168.206.58@tcp:101:mount.lustre.0 Request processed in 143us (593us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440409.869711:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 85 00000100:00100000:3.0:1787440409.873345:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440409.873448:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681354368 00000100:00100000:0.0:1787440409.873458:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681354368 00000100:00100000:0.0:1787440409.873550:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 86 00000100:00100000:0.0:1787440409.873561:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee080928c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83c71368-e5e9-44e8-856a-ef5507fb8c2a+10:13759:x1874266681354368:12345-192.168.206.58@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787440409.873851:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee080928c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83c71368-e5e9-44e8-856a-ef5507fb8c2a+10:13759:x1874266681354368:12345-192.168.206.58@tcp:501:mount.lustre.0 Request processed in 290us (513us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440409.873859:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 86 00000100:00100000:3.0:1787440409.875869:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:2.0:1787440409.875936:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681354496 00000100:00100000:2.0:1787440409.875944:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681354496 00000100:00100000:2.0:1787440409.875992:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 87 00000100:00100000:2.0:1787440409.876002:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee05fb9b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83c71368-e5e9-44e8-856a-ef5507fb8c2a+10:13759:x1874266681354496:12345-192.168.206.58@tcp:503:mount.lustre.0 00000100:00100000:2.0:1787440409.876203:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee05fb9b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83c71368-e5e9-44e8-856a-ef5507fb8c2a+10:13759:x1874266681354496:12345-192.168.206.58@tcp:503:mount.lustre.0 Request processed in 201us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440409.876211:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 87 00000100:00100000:1.0:1787440409.881607:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440409.882280:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681354624 00000100:00100000:0.0:1787440409.882290:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681354624 00000100:00100000:0.0:1787440409.882421:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 88 00000100:00100000:0.0:1787440409.882432:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee05fb9b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83c71368-e5e9-44e8-856a-ef5507fb8c2a+10:13782:x1874266681354624:12345-192.168.206.58@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787440409.882987:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee05fb9b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83c71368-e5e9-44e8-856a-ef5507fb8c2a+10:13782:x1874266681354624:12345-192.168.206.58@tcp:502:llog_process_th.0 Request processed in 554us (1385us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440409.882997:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 88 00000100:00100000:3.0:1787440409.889180:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:1.0:1787440409.889345:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681354752 00000100:00100000:1.0:1787440409.889354:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681354752 00000100:00100000:1.0:1787440409.889645:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 89 00000100:00100000:1.0:1787440409.889656:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee05fb99450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83c71368-e5e9-44e8-856a-ef5507fb8c2a+10:13782:x1874266681354752:12345-192.168.206.58@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787440409.889902:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee05fb99450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83c71368-e5e9-44e8-856a-ef5507fb8c2a+10:13782:x1874266681354752:12345-192.168.206.58@tcp:502:llog_process_th.0 Request processed in 246us (730us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440409.889910:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 89 00000100:00100000:2.0:1787440409.894368:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440409.896674:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681354880 00000100:00100000:0.0:1787440409.896687:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681354880 00000100:00100000:0.0:1787440409.896741:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 4 00000100:00100000:0.0:1787440409.896749:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee08032f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2359:x1874266681354880:12345-192.168.206.58@tcp:38:mount.lustre.0 00010000:00080000:0.0:1787440409.896778:0:14365:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from ebeced4c-c181-4444-bfc2-6340445251d5@192.168.206.58@tcp t0 exp 0000000000000000 cur 508 last 0 00000020:00000080:0.0:1787440409.896837:0:14365:0:(genops.c:1385:class_connect()) connect: client ebeced4c-c181-4444-bfc2-6340445251d5, cookie 0x85f5fa77adf3d657 00000004:00100000:0.0:1787440409.896866:0:14365:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:0.0:1787440409.896872:0:14365:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:2.0:1787440409.937678:0:14365:0:(import.c:65:import_set_state_nolock()) ffff8edf4356e000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787440409.937746:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee08032f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ebeced4c-c181-4444-bfc2-6340445251d5+6:2359:x1874266681354880:12345-192.168.206.58@tcp:38:mount.lustre.0 Request processed in 40995us (43386us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440409.937769:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 4 00000100:00100000:2.0:1787440409.941424:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440409.941610:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681355008 00000100:00100000:0.0:1787440409.941619:0:14367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681355008 00000100:00100000:0.0:1787440409.941681:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 5 00000100:00100000:0.0:1787440409.941691:0:14367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee08032f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ebeced4c-c181-4444-bfc2-6340445251d5+6:0:x1874266681355008:12345-192.168.206.58@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787440409.941733:0:14367:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1787440409.941810:0:14367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee08032f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ebeced4c-c181-4444-bfc2-6340445251d5+6:0:x1874266681355008:12345-192.168.206.58@tcp:41:mount.lustre.0 Request processed in 120us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440409.941818:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 5 00000100:00080000:2.0:1787440409.941990:0:14361:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787440409.945634:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:2.0:1787440409.945777:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681355136 00000100:00100000:2.0:1787440409.945787:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681355136 00000100:00100000:2.0:1787440409.945855:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 6 00000100:00100000:2.0:1787440409.945865:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee0776bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ebeced4c-c181-4444-bfc2-6340445251d5+6:13759:x1874266681355136:12345-192.168.206.58@tcp:41:mount.lustre.0 00000004:00000024:2.0:1787440409.945893:0:14365:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1787440409.945959:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee0776bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ebeced4c-c181-4444-bfc2-6340445251d5+6:13759:x1874266681355136:12345-192.168.206.58@tcp:41:mount.lustre.0 Request processed in 95us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440409.945967:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 6 00000100:00100000:2.0:1787440409.948604:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:1.0:1787440409.948720:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681355264 00000100:00100000:1.0:1787440409.948729:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681355264 00000100:00100000:1.0:1787440409.948791:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 7 00000100:00100000:1.0:1787440409.948801:0:14366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee08032c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ebeced4c-c181-4444-bfc2-6340445251d5+6:13759:x1874266681355264:12345-192.168.206.58@tcp:40:mount.lustre.0 00000100:00100000:1.0:1787440409.948892:0:14366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee08032c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ebeced4c-c181-4444-bfc2-6340445251d5+6:13759:x1874266681355264:12345-192.168.206.58@tcp:40:mount.lustre.0 Request processed in 92us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440409.948899:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 7 00000100:00100000:1.0:1787440409.952064:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:2.0:1787440409.952174:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681355648 00000100:00100000:2.0:1787440409.952183:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681355648 00000100:00100000:2.0:1787440409.952243:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 0 00000100:00100000:2.0:1787440409.952252:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee079914a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ebeced4c-c181-4444-bfc2-6340445251d5+6:13759:x1874266681355648:12345-192.168.206.58@tcp:33:mount.lustre.0 00000004:00080000:0.0:1787440409.956457:0:14368:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 4144us 00000100:00100000:0.0:1787440409.957255:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440409.957293:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:1.0:1787440409.957375:0:15050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681355392 00000100:00100000:1.0:1787440409.957384:0:15050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681355392 00000100:00100000:1.0:1787440409.957435:0:15050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681355520 00000100:00100000:1.0:1787440409.957439:0:15050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681355520 00000100:00100000:1.0:1787440409.957465:0:15050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 8 00000100:00100000:1.0:1787440409.957473:0:15050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04ca3a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2359:x1874266681355392:12345-192.168.206.58@tcp:8:mount.lustre.0 00010000:00080000:1.0:1787440409.957541:0:15050:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from ebeced4c-c181-4444-bfc2-6340445251d5@192.168.206.58@tcp t0 exp 0000000000000000 cur 508 last 0 00000020:00000080:1.0:1787440409.957574:0:15050:0:(genops.c:1385:class_connect()) connect: client ebeced4c-c181-4444-bfc2-6340445251d5, cookie 0x85f5fa77adf3d65e 00002000:00100000:1.0:1787440409.957668:0:15050:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli ebeced4c-c181-4444-bfc2-6340445251d5/ffff8edf42a70800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113940 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787440409.957691:0:15050:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787440409.958021:0:15050:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1787440409.958053:0:15050:0:(import.c:65:import_set_state_nolock()) ffff8edf42a76800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787440409.958121:0:15050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04ca3a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ebeced4c-c181-4444-bfc2-6340445251d5+6:2359:x1874266681355392:12345-192.168.206.58@tcp:8:mount.lustre.0 Request processed in 646us (871us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440409.958129:0:15050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 8 00000100:00100000:1.0:1787440409.958153:0:15050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 9 00000100:00100000:1.0:1787440409.958158:0:15050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04ca38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2359:x1874266681355520:12345-192.168.206.58@tcp:8:mount.lustre.0 00010000:00080000:1.0:1787440409.958176:0:15050:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from ebeced4c-c181-4444-bfc2-6340445251d5@192.168.206.58@tcp t0 exp 0000000000000000 cur 508 last 0 00000020:00000080:1.0:1787440409.958193:0:15050:0:(genops.c:1385:class_connect()) connect: client ebeced4c-c181-4444-bfc2-6340445251d5, cookie 0x85f5fa77adf3d665 00002000:00100000:1.0:1787440409.958199:0:15050:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli ebeced4c-c181-4444-bfc2-6340445251d5/ffff8edf42a74000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113940 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787440409.958213:0:15050:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787440409.958328:0:15050:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1787440409.958344:0:15050:0:(import.c:65:import_set_state_nolock()) ffff8edf42a72000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787440409.958367:0:15050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04ca38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ebeced4c-c181-4444-bfc2-6340445251d5+6:2359:x1874266681355520:12345-192.168.206.58@tcp:8:mount.lustre.0 Request processed in 208us (1074us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440409.958373:0:15050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 9 00000004:00200000:2.0:1787440409.977072:0:14368:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:2.0:1787440409.977372:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee079914a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ebeced4c-c181-4444-bfc2-6340445251d5+6:13759:x1874266681355648:12345-192.168.206.58@tcp:33:mount.lustre.0 Request processed in 25116us (25311us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440409.977384:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 0 00000100:00100000:2.0:1787440410.012908:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787440410.012930:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee0776b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1874266701272960:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787440410.012998:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440410.013169:0:15052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701272960 00000100:00100000:0.0:1787440410.013177:0:15052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701272960 00000100:00100000:0.0:1787440410.013244:0:15052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787440410.013254:0:15052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee08032ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874266701272960:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787440410.013277:0:15052:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787440410.013333:0:15052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee08032ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874266701272960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440410.013340:0:15052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787440410.013450:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee0776b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1874266701272960:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787440410.013600:0:14361:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787440410.141786:0:14353:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787440410.340047:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:1.0:1787440410.340809:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681355776 00000100:00100000:1.0:1787440410.340821:0:14367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681355776 00000100:00100000:0.0:1787440410.340982:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 8 00000100:00100000:0.0:1787440410.340993:0:14367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04ca3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ebeced4c-c181-4444-bfc2-6340445251d5+6:13803:x1874266681355776:12345-192.168.206.58@tcp:101:mkdir.0 00010000:00010000:0.0:1787440410.341026:0:14367:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440410.341055:0:14367:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce600/0x85f5fa77adf3d66c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fab14535dc62574 expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440410.341117:0:14367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcec00/0x85f5fa77adf3d673 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440410.341131:0:14367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcec00/0x85f5fa77adf3d673 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440410.341148:0:14367:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcec00/0x85f5fa77adf3d673 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787440410.341372:0:14367:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1787440410.341376:0:14367:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:0.0:1787440410.341475:0:14367:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcec00/0x85f5fa77adf3d673 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440410.341541:0:14367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce600/0x85f5fa77adf3d66c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62574 expref: 8 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440410.341560:0:14367:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcec00/0x85f5fa77adf3d673 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62574 expref: 7 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440410.341568:0:14367:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ee050ca1800) 00010000:00010000:0.0:1787440410.341571:0:14367:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787440410.341574:0:14367:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee04cbcec00, rc 0) 00000100:00100000:0.0:1787440410.341643:0:14367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04ca3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ebeced4c-c181-4444-bfc2-6340445251d5+7:13803:x1874266681355776:12345-192.168.206.58@tcp:101:mkdir.0 Request processed in 652us (1603us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440410.341650:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 8 00000100:00100000:0.0:1787440411.037488:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee04ca38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1874266701273344:0@lo:400:kworker.0 00000100:00100000:0.0:1787440411.037598:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440411.037662:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1787440411.037669:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee04ca3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1874266701273216:0@lo:400:kworker.0 00000100:00100000:0.0:1787440411.037693:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440411.037733:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee04ca38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3312:1874266701273728:0@lo:400:kworker.0 00000100:00100000:0.0:1787440411.037760:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440411.037792:0:15049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701273344 00000100:00100000:0.0:1787440411.037800:0:15049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701273344 00000100:00100000:0.0:1787440411.037847:0:15049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701273216 00000100:00100000:0.0:1787440411.037851:0:15049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701273216 00000100:00100000:0.0:1787440411.037869:0:15049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787440411.037877:0:15049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04ca3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3312:x1874266701273344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787440411.037927:0:15049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04ca3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3312:x1874266701273344:12345-0@lo:400:kworker.0 Request processed in 50us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440411.037934:0:15049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787440411.037952:0:15049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787440411.037958:0:15049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04ca3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1874266701273216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787440411.037986:0:15049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04ca3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1874266701273216:12345-0@lo:400:kworker.0 Request processed in 28us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440411.037992:0:15049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:0.0:1787440411.038007:0:14361:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787440411.038039:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee04ca3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1874266701273216:0@lo:400:kworker.0 00000100:00100000:0.0:1787440411.038051:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee04ca38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1874266701273344:0@lo:400:kworker.0 00000100:00100000:0.0:1787440411.038085:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee04ca3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874266701273472:0@lo:400:kworker.0 00000100:00100000:0.0:1787440411.038126:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440411.038147:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1787440411.038153:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee04ca3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c:3309:1874266701273088:0@lo:400:kworker.0 00000100:00100000:0.0:1787440411.038179:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440411.038202:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee04ca39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1874266701273600:0@lo:400:kworker.0 00000100:00100000:0.0:1787440411.038224:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440411.038251:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701273728 00000100:00100000:0.0:1787440411.038255:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701273728 00000100:00100000:0.0:1787440411.038297:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701273472 00000100:00100000:0.0:1787440411.038300:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701273472 00000100:00100000:0.0:1787440411.038313:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701273600 00000100:00100000:0.0:1787440411.038316:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701273600 00000100:00100000:0.0:1787440411.038332:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787440411.038338:0:14366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04ca39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874266701273728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787440411.038374:0:14366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04ca39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874266701273728:12345-0@lo:400:kworker.0 Request processed in 36us (612us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440411.038380:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787440411.038393:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787440411.038399:0:14366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04ca38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874266701273472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787440411.038430:0:14366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04ca38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874266701273472:12345-0@lo:400:kworker.0 Request processed in 31us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440411.038436:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787440411.038448:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787440411.038455:0:14366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04ca3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1874266701273600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787440411.038485:0:14366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04ca3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1874266701273600:12345-0@lo:400:kworker.0 Request processed in 31us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440411.038523:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701273088 00000100:00100000:2.0:1787440411.038535:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701273088 00000100:00100000:0.0:1787440411.038536:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:0.0:1787440411.038559:0:14361:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787440411.038579:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1787440411.038588:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee05fb99050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+19:3309:x1874266701273088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787440411.038592:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee04ca38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3312:1874266701273728:0@lo:400:kworker.0 00000100:00100000:0.0:1787440411.038631:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee04ca3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c:3309:1874266701273088:0@lo:400:kworker.0 00000100:00100000:2.0:1787440411.038633:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee05fb99050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+19:3309:x1874266701273088:12345-0@lo:400:kworker.0 Request processed in 45us (451us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440411.038641:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1787440411.038647:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee04ca39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1874266701273600:0@lo:400:kworker.0 00000100:00100000:0.0:1787440411.038661:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee04ca3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874266701273472:0@lo:400:kworker.0 00000100:00100000:0.0:1787440411.038749:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787440411.038757:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee04ca3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874266701273856:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787440411.038787:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440411.038818:0:15052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701273856 00000100:00100000:0.0:1787440411.038822:0:15052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701273856 00000100:00100000:3.0:1787440411.038877:0:15053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787440411.038888:0:15053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04ca39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3311:x1874266701273856:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787440411.038904:0:15053:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787440411.038953:0:15053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04ca39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3311:x1874266701273856:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (165us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440411.038959:0:15053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787440411.039805:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee04ca3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874266701273856:0@lo:13:osp-pre-1-0.0 00000001:00100000:3.0:1787440411.079152:0:7640:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of ebeced4c-c181-4444-bfc2-6340445251d5 00000001:00100000:3.0:1787440411.079165:0:7640:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1787440411.079175:0:7640:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00010000:00010000:2.0:1787440411.168906:0:16029:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787440412.188715:0:14354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787440412.462350:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:2.0:1787440412.463778:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681355904 00000100:00100000:2.0:1787440412.463791:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681355904 00000100:00100000:2.0:1787440412.463881:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 9 00000100:00100000:2.0:1787440412.463892:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee079917100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ebeced4c-c181-4444-bfc2-6340445251d5+7:13855:x1874266681355904:12345-192.168.206.58@tcp:41:lfs.0 00000100:00080000:0.0:1787440412.463908:0:14361:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00000024:2.0:1787440412.463932:0:14365:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1787440412.464032:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee079917100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ebeced4c-c181-4444-bfc2-6340445251d5+7:13855:x1874266681355904:12345-192.168.206.58@tcp:41:lfs.0 Request processed in 143us (1691us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440412.464040:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 9 00000100:00100000:3.0:1787440412.468054:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:1.0:1787440412.468193:0:15052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681356032 00000100:00100000:1.0:1787440412.468205:0:15052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681356032 00000100:00100000:1.0:1787440412.468302:0:15052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 5 00000100:00100000:1.0:1787440412.468314:0:15052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee0776b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ebeced4c-c181-4444-bfc2-6340445251d5+6:13855:x1874266681356032:12345-192.168.206.58@tcp:13:lfs.0 00002000:00000024:1.0:1787440412.468363:0:15052:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787440412.468544:0:15052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee0776b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ebeced4c-c181-4444-bfc2-6340445251d5+6:13855:x1874266681356032:12345-192.168.206.58@tcp:13:lfs.0 Request processed in 176us (447us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440412.468557:0:15052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 5 00000100:00080000:0.0:1787440412.468653:0:14361:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787440412.475989:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:1.0:1787440412.476099:0:15052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681356160 00000100:00100000:1.0:1787440412.476111:0:15052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681356160 00000100:00100000:1.0:1787440412.476201:0:15052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 6 00000100:00100000:1.0:1787440412.476213:0:15052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04ca3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ebeced4c-c181-4444-bfc2-6340445251d5+5:13855:x1874266681356160:12345-192.168.206.58@tcp:13:lfs.0 00002000:00000024:1.0:1787440412.476265:0:15052:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787440412.476388:0:15052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04ca3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ebeced4c-c181-4444-bfc2-6340445251d5+5:13855:x1874266681356160:12345-192.168.206.58@tcp:13:lfs.0 Request processed in 177us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440412.476396:0:15052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 6 00000100:00080000:0.0:1787440412.476482:0:14361:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787440412.674827:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:1.0:1787440412.674947:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681356288 00000100:00100000:1.0:1787440412.674960:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681356288 00000100:00100000:1.0:1787440412.675032:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 91 00000100:00100000:1.0:1787440412.675044:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee05fb98c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83c71368-e5e9-44e8-856a-ef5507fb8c2a+10:13885:x1874266681356288:12345-192.168.206.58@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787440412.675067:0:14360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440412.675107:0:14360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ee07fb9fc00/0x85f5fa77adf3d67a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fab14535dc6257b expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440412.675147:0:14360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ee07fb9fc00/0x85f5fa77adf3d67a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6257b expref: 11 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440412.675161:0:14360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ee07fb9fc00/0x85f5fa77adf3d67a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6257b expref: 11 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440412.675172:0:14360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee07fb9fc00, rc 0) 00000100:00100000:1.0:1787440412.675253:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee05fb98c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83c71368-e5e9-44e8-856a-ef5507fb8c2a+11:13885:x1874266681356288:12345-192.168.206.58@tcp:101:mount.lustre.0 Request processed in 211us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440412.675261:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 91 00000100:00100000:2.0:1787440412.701028:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440412.701130:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681356416 00000100:00100000:3.0:1787440412.701144:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681356416 00000100:00100000:3.0:1787440412.701224:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 92 00000100:00100000:3.0:1787440412.701234:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee05fb98050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83c71368-e5e9-44e8-856a-ef5507fb8c2a+11:13885:x1874266681356416:12345-192.168.206.58@tcp:501:mount.lustre.0 00000100:00100000:3.0:1787440412.701991:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee05fb98050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83c71368-e5e9-44e8-856a-ef5507fb8c2a+11:13885:x1874266681356416:12345-192.168.206.58@tcp:501:mount.lustre.0 Request processed in 756us (974us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440412.702000:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 92 00000100:00100000:2.0:1787440412.718133:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440412.718406:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681356544 00000100:00100000:0.0:1787440412.718416:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681356544 00000100:00100000:0.0:1787440412.718571:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 93 00000100:00100000:0.0:1787440412.718582:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee05fb9a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83c71368-e5e9-44e8-856a-ef5507fb8c2a+11:13885:x1874266681356544:12345-192.168.206.58@tcp:503:mount.lustre.0 00000100:00100000:0.0:1787440412.718837:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee05fb9a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83c71368-e5e9-44e8-856a-ef5507fb8c2a+11:13885:x1874266681356544:12345-192.168.206.58@tcp:503:mount.lustre.0 Request processed in 255us (711us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440412.718845:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 93 00000100:00100000:2.0:1787440412.765031:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440412.765641:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681356672 00000100:00100000:3.0:1787440412.765651:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681356672 00000100:00100000:3.0:1787440412.765703:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 94 00000100:00100000:3.0:1787440412.765713:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee05fb9ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83c71368-e5e9-44e8-856a-ef5507fb8c2a+11:13894:x1874266681356672:12345-192.168.206.58@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787440412.765970:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee05fb9ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83c71368-e5e9-44e8-856a-ef5507fb8c2a+11:13894:x1874266681356672:12345-192.168.206.58@tcp:502:llog_process_th.0 Request processed in 257us (957us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440412.765985:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 94 00000100:00100000:3.0:1787440412.782983:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:2.0:1787440412.783090:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681356800 00000100:00100000:2.0:1787440412.783098:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681356800 00000100:00100000:2.0:1787440412.783150:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 95 00000100:00100000:2.0:1787440412.783160:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee05fb9bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83c71368-e5e9-44e8-856a-ef5507fb8c2a+11:13894:x1874266681356800:12345-192.168.206.58@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787440412.783453:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee05fb9bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83c71368-e5e9-44e8-856a-ef5507fb8c2a+11:13894:x1874266681356800:12345-192.168.206.58@tcp:502:llog_process_th.0 Request processed in 293us (478us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440412.783462:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 95 00000100:00100000:2.0:1787440412.794585:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440412.794726:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681356928 00000100:00100000:0.0:1787440412.794748:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681356928 00000100:00100000:0.0:1787440412.794807:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 96 00000100:00100000:0.0:1787440412.794816:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee05fb99c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83c71368-e5e9-44e8-856a-ef5507fb8c2a+11:13885:x1874266681356928:12345-192.168.206.58@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787440412.794831:0:14358:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440412.794847:0:14358:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ee04cbcf600/0x85f5fa77adf3d681 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fab14535dc625a5 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440412.794874:0:14358:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ee04cbcf600/0x85f5fa77adf3d681 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc625a5 expref: 12 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440412.794885:0:14358:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ee04cbcf600/0x85f5fa77adf3d681 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc625a5 expref: 12 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440412.794892:0:14358:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee04cbcf600, rc 0) 00000100:00100000:0.0:1787440412.794948:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee05fb99c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83c71368-e5e9-44e8-856a-ef5507fb8c2a+12:13885:x1874266681356928:12345-192.168.206.58@tcp:101:mount.lustre.0 Request processed in 132us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440412.794955:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 96 00000100:00100000:1.0:1787440412.800143:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440412.800243:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681357056 00000100:00100000:3.0:1787440412.800252:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681357056 00000100:00100000:3.0:1787440412.800321:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 97 00000100:00100000:3.0:1787440412.800331:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee05fb98450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83c71368-e5e9-44e8-856a-ef5507fb8c2a+12:13885:x1874266681357056:12345-192.168.206.58@tcp:256:mount.lustre.0 20000000:01000000:3.0:1787440412.800358:0:14357:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1787440412.800382:0:14357:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1787440412.800385:0:14357:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1787440412.800389:0:14357:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1787440412.800391:0:14357:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:3.0:1787440412.803939:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee05fb98450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83c71368-e5e9-44e8-856a-ef5507fb8c2a+12:13885:x1874266681357056:12345-192.168.206.58@tcp:256:mount.lustre.0 Request processed in 3600us (3796us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440412.803953:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 97 00000100:00100000:2.0:1787440412.816807:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:1.0:1787440412.816993:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681357184 00000100:00100000:1.0:1787440412.817001:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681357184 00000100:00100000:1.0:1787440412.817051:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 98 00000100:00100000:1.0:1787440412.817060:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee05fb98850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83c71368-e5e9-44e8-856a-ef5507fb8c2a+12:13885:x1874266681357184:12345-192.168.206.58@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787440412.817075:0:14360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440412.817092:0:14360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ee07fb9ec00/0x85f5fa77adf3d688 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fab14535dc625ac expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440412.817120:0:14360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ee07fb9ec00/0x85f5fa77adf3d688 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc625ac expref: 13 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440412.817132:0:14360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ee07fb9ec00/0x85f5fa77adf3d688 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc625ac expref: 13 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440412.817141:0:14360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee07fb9ec00, rc 0) 00000100:00100000:1.0:1787440412.817220:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee05fb98850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83c71368-e5e9-44e8-856a-ef5507fb8c2a+13:13885:x1874266681357184:12345-192.168.206.58@tcp:101:mount.lustre.0 Request processed in 161us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440412.817227:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 98 00000100:00100000:1.0:1787440412.819852:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440412.819979:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681357312 00000100:00100000:3.0:1787440412.819989:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681357312 00000100:00100000:3.0:1787440412.820041:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 99 00000100:00100000:3.0:1787440412.820049:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee05fb9a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83c71368-e5e9-44e8-856a-ef5507fb8c2a+13:13885:x1874266681357312:12345-192.168.206.58@tcp:501:mount.lustre.0 00000100:00100000:3.0:1787440412.820748:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee05fb9a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83c71368-e5e9-44e8-856a-ef5507fb8c2a+13:13885:x1874266681357312:12345-192.168.206.58@tcp:501:mount.lustre.0 Request processed in 698us (903us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440412.820758:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 99 00000100:00100000:2.0:1787440412.823340:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440412.823849:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681357440 00000100:00100000:0.0:1787440412.823858:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681357440 00000100:00100000:0.0:1787440412.823956:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 100 00000100:00100000:0.0:1787440412.823965:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee05fb9b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83c71368-e5e9-44e8-856a-ef5507fb8c2a+13:13885:x1874266681357440:12345-192.168.206.58@tcp:503:mount.lustre.0 00000100:00100000:0.0:1787440412.824184:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee05fb9b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83c71368-e5e9-44e8-856a-ef5507fb8c2a+13:13885:x1874266681357440:12345-192.168.206.58@tcp:503:mount.lustre.0 Request processed in 219us (850us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440412.824192:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 100 00000100:00100000:2.0:1787440412.832224:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440412.832362:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681357568 00000100:00100000:3.0:1787440412.832371:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681357568 00000100:00100000:3.0:1787440412.832472:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 101 00000100:00100000:3.0:1787440412.832483:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee05fb99850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83c71368-e5e9-44e8-856a-ef5507fb8c2a+13:13898:x1874266681357568:12345-192.168.206.58@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787440412.832799:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee05fb99850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83c71368-e5e9-44e8-856a-ef5507fb8c2a+13:13898:x1874266681357568:12345-192.168.206.58@tcp:502:llog_process_th.0 Request processed in 317us (1065us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440412.832807:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 101 00000100:00100000:2.0:1787440412.849441:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440412.849535:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681357696 00000100:00100000:0.0:1787440412.849553:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681357696 00000100:00100000:0.0:1787440412.849607:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 102 00000100:00100000:0.0:1787440412.849617:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee07b940c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83c71368-e5e9-44e8-856a-ef5507fb8c2a+13:13898:x1874266681357696:12345-192.168.206.58@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787440412.850321:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee07b940c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83c71368-e5e9-44e8-856a-ef5507fb8c2a+13:13898:x1874266681357696:12345-192.168.206.58@tcp:502:llog_process_th.0 Request processed in 703us (886us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440412.850331:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 102 00000100:00100000:2.0:1787440412.858392:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440412.858779:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681357824 00000100:00100000:0.0:1787440412.858788:0:14367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681357824 00000100:00100000:0.0:1787440412.858835:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 10 00000100:00100000:0.0:1787440412.858842:0:14367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee08032fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2359:x1874266681357824:12345-192.168.206.58@tcp:38:mount.lustre.0 00010000:00080000:0.0:1787440412.858868:0:14367:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 33ce6cea-c670-4f62-bfc5-6966392caf40@192.168.206.58@tcp t0 exp 0000000000000000 cur 511 last 0 00000020:00000080:0.0:1787440412.858915:0:14367:0:(genops.c:1385:class_connect()) connect: client 33ce6cea-c670-4f62-bfc5-6966392caf40, cookie 0x85f5fa77adf3d68f 00000004:00100000:0.0:1787440412.858952:0:14367:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1787440412.859238:0:14367:0:(import.c:65:import_set_state_nolock()) ffff8ee05d22d000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787440412.859356:0:14367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee08032fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:33ce6cea-c670-4f62-bfc5-6966392caf40+6:2359:x1874266681357824:12345-192.168.206.58@tcp:38:mount.lustre.0 Request processed in 513us (974us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440412.859364:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 10 00000100:00100000:1.0:1787440412.863912:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440412.864268:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681357952 00000100:00100000:1.0:1787440412.864273:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440412.864279:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681357952 00000100:00100000:1.0:1787440412.864312:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440412.864334:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 16 00000100:00100000:0.0:1787440412.864344:0:14366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee079915500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ebeced4c-c181-4444-bfc2-6340445251d5+7:2360:x1874266681357952:12345-192.168.206.58@tcp:400:kworker.0 00000100:00100000:0.0:1787440412.864421:0:14366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee079915500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ebeced4c-c181-4444-bfc2-6340445251d5+7:2360:x1874266681357952:12345-192.168.206.58@tcp:400:kworker.0 Request processed in 79us (517us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440412.864429:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 16 00000100:00100000:2.0:1787440412.870019:0:15051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681358208 00000100:00100000:2.0:1787440412.870034:0:15051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681358208 00000100:00100000:2.0:1787440412.870087:0:15051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681358080 00000100:00100000:2.0:1787440412.870090:0:15051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681358080 00000100:00100000:2.0:1787440412.870109:0:15051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 4 00000100:00100000:2.0:1787440412.870119:0:15051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee079916300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ebeced4c-c181-4444-bfc2-6340445251d5+5:2360:x1874266681358208:12345-192.168.206.58@tcp:400:kworker.0 00000100:00100000:2.0:1787440412.870258:0:15051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee079916300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ebeced4c-c181-4444-bfc2-6340445251d5+5:2360:x1874266681358208:12345-192.168.206.58@tcp:400:kworker.0 Request processed in 140us (5997us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440412.870275:0:15051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 4 00000100:00100000:2.0:1787440412.870296:0:15051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 5 00000100:00100000:2.0:1787440412.870302:0:15051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee079917480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ebeced4c-c181-4444-bfc2-6340445251d5+6:2360:x1874266681358080:12345-192.168.206.58@tcp:400:kworker.0 00000100:00100000:2.0:1787440412.870326:0:15051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee079917480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ebeced4c-c181-4444-bfc2-6340445251d5+6:2360:x1874266681358080:12345-192.168.206.58@tcp:400:kworker.0 Request processed in 25us (6015us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440412.870331:0:15051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 5 00000100:00100000:1.0:1787440412.879484:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:1.0:1787440412.879827:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440412.880331:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681358464 00000100:00100000:0.0:1787440412.880337:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681358336 00000100:00100000:3.0:1787440412.880341:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681358464 00000100:00100000:0.0:1787440412.880345:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681358336 00000100:00100000:3.0:1787440412.880430:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 11 00000100:00100000:3.0:1787440412.880441:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee079916d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:33ce6cea-c670-4f62-bfc5-6966392caf40+7:0:x1874266681358336:12345-192.168.206.58@tcp:41:mount.lustre.0 00000004:00000024:3.0:1787440412.880483:0:14365:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1787440412.880584:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee079916d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:33ce6cea-c670-4f62-bfc5-6966392caf40+7:0:x1874266681358336:12345-192.168.206.58@tcp:41:mount.lustre.0 Request processed in 145us (757us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440412.880592:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 11 00000100:00080000:1.0:1787440412.880688:0:14361:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787440412.880717:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 12 00000100:00100000:3.0:1787440412.880728:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee079915c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:33ce6cea-c670-4f62-bfc5-6966392caf40+6:13885:x1874266681358464:12345-192.168.206.58@tcp:41:mount.lustre.0 00000004:00000024:3.0:1787440412.880740:0:14365:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1787440412.880765:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee079915c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:33ce6cea-c670-4f62-bfc5-6966392caf40+6:13885:x1874266681358464:12345-192.168.206.58@tcp:41:mount.lustre.0 Request processed in 39us (1290us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440412.880771:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 12 00000100:00100000:2.0:1787440412.887251:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440412.893157:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681358592 00000100:00100000:0.0:1787440412.893171:0:14367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681358592 00000100:00100000:0.0:1787440412.893309:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 13 00000100:00100000:0.0:1787440412.893334:0:14367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee08032c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:33ce6cea-c670-4f62-bfc5-6966392caf40+6:13885:x1874266681358592:12345-192.168.206.58@tcp:40:mount.lustre.0 00000100:00100000:0.0:1787440412.893441:0:14367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee08032c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:33ce6cea-c670-4f62-bfc5-6966392caf40+6:13885:x1874266681358592:12345-192.168.206.58@tcp:40:mount.lustre.0 Request processed in 109us (6199us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440412.893449:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 13 00000100:00100000:2.0:1787440412.906601:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:1.0:1787440412.906778:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681358976 00000100:00100000:1.0:1787440412.906796:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681358976 00000100:00100000:1.0:1787440412.906850:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 1 00000100:00100000:1.0:1787440412.906859:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee08032df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:33ce6cea-c670-4f62-bfc5-6966392caf40+6:13885:x1874266681358976:12345-192.168.206.58@tcp:33:mount.lustre.0 00000100:00100000:2.0:1787440412.907056:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000004:00200000:1.0:1787440412.907085:0:14369:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:2.0:1787440412.907093:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:2.0:1787440412.907122:0:15049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681358720 00000100:00100000:2.0:1787440412.907127:0:15049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681358720 00000100:00100000:2.0:1787440412.907150:0:15049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681358848 00000100:00100000:2.0:1787440412.907161:0:15049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681358848 00000100:00100000:2.0:1787440412.907179:0:15049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 10 00000100:00100000:2.0:1787440412.907185:0:15049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee08032ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2359:x1874266681358720:12345-192.168.206.58@tcp:8:mount.lustre.0 00010000:00080000:2.0:1787440412.907210:0:15049:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 33ce6cea-c670-4f62-bfc5-6966392caf40@192.168.206.58@tcp t0 exp 0000000000000000 cur 511 last 0 00000100:00100000:1.0:1787440412.907251:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee08032df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:33ce6cea-c670-4f62-bfc5-6966392caf40+6:13885:x1874266681358976:12345-192.168.206.58@tcp:33:mount.lustre.0 Request processed in 391us (657us total) trans 0 rc 0/0 00000020:00000080:2.0:1787440412.907253:0:15049:0:(genops.c:1385:class_connect()) connect: client 33ce6cea-c670-4f62-bfc5-6966392caf40, cookie 0x85f5fa77adf3d696 00000100:00100000:1.0:1787440412.907262:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 1 00002000:00100000:2.0:1787440412.907336:0:15049:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 33ce6cea-c670-4f62-bfc5-6966392caf40/ffff8ee07c413800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113940 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787440412.907347:0:15049:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787440412.907435:0:15049:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787440412.907610:0:15049:0:(import.c:65:import_set_state_nolock()) ffff8ee07c411000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787440412.908003:0:15049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee08032ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:33ce6cea-c670-4f62-bfc5-6966392caf40+6:2359:x1874266681358720:12345-192.168.206.58@tcp:8:mount.lustre.0 Request processed in 816us (947us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440412.908011:0:15049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 10 00000100:00100000:2.0:1787440412.908032:0:15049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 11 00000100:00100000:2.0:1787440412.908036:0:15049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee08032c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2359:x1874266681358848:12345-192.168.206.58@tcp:8:mount.lustre.0 00010000:00080000:2.0:1787440412.908053:0:15049:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 33ce6cea-c670-4f62-bfc5-6966392caf40@192.168.206.58@tcp t0 exp 0000000000000000 cur 511 last 0 00000020:00000080:2.0:1787440412.908072:0:15049:0:(genops.c:1385:class_connect()) connect: client 33ce6cea-c670-4f62-bfc5-6966392caf40, cookie 0x85f5fa77adf3d69d 00002000:00100000:2.0:1787440412.908078:0:15049:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 33ce6cea-c670-4f62-bfc5-6966392caf40/ffff8ee07c416000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113940 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787440412.908085:0:15049:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787440412.908232:0:15049:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787440412.908251:0:15049:0:(import.c:65:import_set_state_nolock()) ffff8ee07c413000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787440412.908352:0:15049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee08032c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:33ce6cea-c670-4f62-bfc5-6966392caf40+6:2359:x1874266681358848:12345-192.168.206.58@tcp:8:mount.lustre.0 Request processed in 313us (1258us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440412.908359:0:15049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 11 00000001:00100000:3.0:1787440413.152110:0:6723:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of ebeced4c-c181-4444-bfc2-6340445251d5 00000001:00100000:3.0:1787440413.152127:0:6723:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 33ce6cea-c670-4f62-bfc5-6966392caf40 00000100:00100000:2.0:1787440413.164590:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440413.164812:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681359104 00000100:00100000:3.0:1787440413.164827:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681359104 00000100:00100000:3.0:1787440413.164881:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 14 00000100:00100000:3.0:1787440413.164890:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee08032d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:33ce6cea-c670-4f62-bfc5-6966392caf40+6:13919:x1874266681359104:12345-192.168.206.58@tcp:101:mkdir.0 00010000:00010000:3.0:1787440413.164908:0:14365:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440413.164937:0:14365:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94e00/0x85f5fa77adf3d6a4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fab14535dc625d6 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440413.164994:0:14365:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95e00/0x85f5fa77adf3d6ab lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14365 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440413.165005:0:14365:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95e00/0x85f5fa77adf3d6ab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14365 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440413.165016:0:14365:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95e00/0x85f5fa77adf3d6ab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14365 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787440413.165199:0:14365:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787440413.165203:0:14365:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:3.0:1787440413.165299:0:14365:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95e00/0x85f5fa77adf3d6ab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14365 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440413.165324:0:14365:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94e00/0x85f5fa77adf3d6a4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc625d6 expref: 8 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440413.165342:0:14365:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95e00/0x85f5fa77adf3d6ab lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc625d6 expref: 7 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440413.165350:0:14365:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ee050ca1800) 00010000:00010000:3.0:1787440413.165353:0:14365:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787440413.165356:0:14365:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee049e95e00, rc 0) 00000100:00100000:3.0:1787440413.165413:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee08032d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:33ce6cea-c670-4f62-bfc5-6966392caf40+7:13919:x1874266681359104:12345-192.168.206.58@tcp:101:mkdir.0 Request processed in 524us (830us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440413.165419:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 14 00010000:00010000:2.0:1787440413.212931:0:14353:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787440414.236832:0:16029:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787440415.133029:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787440415.133051:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee0776b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1874266701273984:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787440415.133125:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440415.133461:0:15052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701273984 00000100:00100000:2.0:1787440415.133468:0:15052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701273984 00000100:00100000:2.0:1787440415.133558:0:15052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787440415.133568:0:15052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee079917800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874266701273984:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787440415.133600:0:15052:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787440415.133645:0:15052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee079917800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874266701273984:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (519us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440415.133652:0:15052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:1.0:1787440415.133814:0:14361:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787440415.133848:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee0776b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1874266701273984:0@lo:13:osp-pre-0-0.0 00000001:00100000:2.0:1787440415.187090:0:5871:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 33ce6cea-c670-4f62-bfc5-6966392caf40 00000001:00100000:2.0:1787440415.187111:0:5871:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of ebeced4c-c181-4444-bfc2-6340445251d5 00010000:00010000:1.0:1787440415.261605:0:14354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787440416.157000:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee04ca3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1874266701274112:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787440416.157074:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440416.163608:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787440416.163629:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee079916a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874266701274496:0@lo:400:kworker.0 00000100:00100000:3.0:1787440416.163890:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440416.163952:0:15052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701274112 00000100:00100000:3.0:1787440416.163960:0:15052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701274112 00000100:00100000:0.0:1787440416.164228:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701274496 00000100:00100000:0.0:1787440416.164233:0:14367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701274496 00000100:00100000:3.0:1787440416.164419:0:15052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787440416.164428:0:15052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee0776bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874266701274112:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787440416.164462:0:15052:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787440416.164536:0:15052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee0776bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874266701274112:12345-0@lo:13:osp-pre-1-0.0 Request processed in 110us (7463us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440416.164543:0:15052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:3.0:1787440416.164562:0:14361:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787440416.164588:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee079917b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3310:1874266701274624:0@lo:400:kworker.0 00000100:00100000:3.0:1787440416.164616:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440416.165584:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee079915f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1874266701274368:0@lo:400:kworker.0 00000100:00100000:1.0:1787440416.165909:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440416.165956:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1787440416.165963:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee079914000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c:3312:1874266701274240:0@lo:400:kworker.0 00000100:00100000:1.0:1787440416.165989:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440416.166008:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee079916680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3312:1874266701274752:0@lo:400:kworker.0 00000100:00100000:3.0:1787440416.166351:0:3310:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:3.0:1787440416.166376:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee04ca3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1874266701274112:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787440416.166628:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701274240 00000100:00100000:2.0:1787440416.166634:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701274240 00000100:00100000:2.0:1787440416.166671:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1787440416.166679:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee07b943450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+19:3312:x1874266701274240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787440416.166726:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee07b943450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+19:3312:x1874266701274240:12345-0@lo:400:kworker.0 Request processed in 47us (735us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440416.166733:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1787440416.171367:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440416.171413:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701274624 00000100:00100000:0.0:1787440416.171421:0:14367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701274624 00000100:00100000:0.0:1787440416.171502:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787440416.171517:0:14367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee0776bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874266701274496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440416.171541:0:14365:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1787440416.171549:0:14365:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1787440416.171599:0:14367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee0776bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874266701274496:12345-0@lo:400:kworker.0 Request processed in 89us (7710us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440416.171606:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787440416.171624:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787440416.171630:0:14367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee0776b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874266701274624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787440416.171658:0:14367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee0776b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874266701274624:12345-0@lo:400:kworker.0 Request processed in 28us (7041us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440416.171663:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787440416.171687:0:15050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701274368 00000100:00100000:0.0:1787440416.171692:0:15050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701274368 00000100:00100000:0.0:1787440416.171719:0:15050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787440416.171725:0:15050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee079914e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1874266701274368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787440416.171757:0:15050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee079914e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1874266701274368:12345-0@lo:400:kworker.0 Request processed in 32us (5849us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440416.171763:0:15050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787440416.172092:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee079917b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3310:1874266701274624:0@lo:400:kworker.0 00000100:00100000:3.0:1787440416.172107:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee079916a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874266701274496:0@lo:400:kworker.0 00000100:00080000:3.0:1787440416.172284:0:14361:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787440416.175461:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701274752 00000100:00100000:1.0:1787440416.175483:0:14367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701274752 00000100:00100000:1.0:1787440416.175555:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787440416.175563:0:14367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee08032d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874266701274752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440416.175627:0:14367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee08032d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874266701274752:12345-0@lo:400:kworker.0 Request processed in 65us (4266us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440416.175633:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:1.0:1787440416.175656:0:14361:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787440416.175766:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee079916680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3312:1874266701274752:0@lo:400:kworker.0 00000100:00100000:2.0:1787440416.175780:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee079915f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1874266701274368:0@lo:400:kworker.0 00000100:00100000:2.0:1787440416.175806:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee079914000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c:3312:1874266701274240:0@lo:400:kworker.0 00010000:00010000:2.0:1787440416.286318:0:14353:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787440416.290901:0:7640:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 33ce6cea-c670-4f62-bfc5-6966392caf40 00000040:00080000:1.0:1787440416.669335:0:14399:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:02000400:1.0:1787440417.019431:0:16332:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1787440417.308712:0:16029:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787440418.338972:0:14354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787440418.367327:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440418.367371:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440418.367403:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440418.367426:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440418.367442:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440418.367487:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440418.367539:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440418.367561:0:15050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681359616 00000100:00100000:0.0:1787440418.367569:0:15050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681359616 00000100:00100000:0.0:1787440418.367617:0:15050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681359872 00000100:00100000:0.0:1787440418.367620:0:15050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681359872 00000100:00100000:0.0:1787440418.367632:0:15050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681359488 00000100:00100000:0.0:1787440418.367634:0:15050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681359488 00000100:00100000:0.0:1787440418.367645:0:15050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681360000 00000100:00100000:0.0:1787440418.367648:0:15050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681360000 00000100:00100000:0.0:1787440418.367663:0:15050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 7 00000100:00100000:0.0:1787440418.367672:0:15050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04ca38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ebeced4c-c181-4444-bfc2-6340445251d5+5:2363:x1874266681359616:12345-192.168.206.58@tcp:400:kworker.0 00000100:00100000:0.0:1787440418.367738:0:15050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04ca38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ebeced4c-c181-4444-bfc2-6340445251d5+5:2363:x1874266681359616:12345-192.168.206.58@tcp:400:kworker.0 Request processed in 67us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440418.367746:0:15050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 7 00000100:00100000:0.0:1787440418.367762:0:15050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 8 00000100:00100000:0.0:1787440418.367768:0:15050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04ca39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:33ce6cea-c670-4f62-bfc5-6966392caf40+5:2363:x1874266681359872:12345-192.168.206.58@tcp:400:kworker.0 00000100:00100000:2.0:1787440418.368029:0:15051:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1787440418.368038:0:15051:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:3.0:1787440418.368197:0:16298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681359360 00000100:00100000:3.0:1787440418.368202:0:16298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681359360 00000100:00100000:3.0:1787440418.368230:0:16298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681359744 00000100:00100000:3.0:1787440418.368239:0:16298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681359744 00000100:00100000:3.0:1787440418.368265:0:16298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 20 00000100:00100000:3.0:1787440418.368272:0:16298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04ca38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ebeced4c-c181-4444-bfc2-6340445251d5+6:2363:x1874266681359360:12345-192.168.206.58@tcp:400:kworker.0 00000100:00100000:3.0:1787440418.368305:0:16298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04ca38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ebeced4c-c181-4444-bfc2-6340445251d5+6:2363:x1874266681359360:12345-192.168.206.58@tcp:400:kworker.0 Request processed in 33us (986us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440418.368311:0:16298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 20 00000100:00100000:3.0:1787440418.368324:0:16298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 21 00000100:00100000:3.0:1787440418.368330:0:16298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04ca39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:33ce6cea-c670-4f62-bfc5-6966392caf40+6:2363:x1874266681359744:12345-192.168.206.58@tcp:400:kworker.0 00000100:00100000:3.0:1787440418.368351:0:16298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04ca39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:33ce6cea-c670-4f62-bfc5-6966392caf40+6:2363:x1874266681359744:12345-192.168.206.58@tcp:400:kworker.0 Request processed in 22us (865us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440418.368357:0:16298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 21 00000100:00100000:0.0:1787440418.368392:0:15050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04ca39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:33ce6cea-c670-4f62-bfc5-6966392caf40+5:2363:x1874266681359872:12345-192.168.206.58@tcp:400:kworker.0 Request processed in 24us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440418.368402:0:15050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 8 00000100:00100000:0.0:1787440418.368417:0:15050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 9 00000100:00100000:0.0:1787440418.368424:0:15050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04ca39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ebeced4c-c181-4444-bfc2-6340445251d5+5:2363:x1874266681359488:12345-192.168.206.58@tcp:400:kworker.0 00000100:00100000:0.0:1787440418.368476:0:15050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04ca39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ebeced4c-c181-4444-bfc2-6340445251d5+5:2363:x1874266681359488:12345-192.168.206.58@tcp:400:kworker.0 Request processed in 53us (1032us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440418.368483:0:15050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 9 00000100:00100000:0.0:1787440418.368523:0:15050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 10 00000100:00100000:0.0:1787440418.368530:0:15050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04ca38380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:33ce6cea-c670-4f62-bfc5-6966392caf40+5:2363:x1874266681360000:12345-192.168.206.58@tcp:400:kworker.0 00000100:00100000:0.0:1787440418.368556:0:15050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04ca38380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:33ce6cea-c670-4f62-bfc5-6966392caf40+5:2363:x1874266681360000:12345-192.168.206.58@tcp:400:kworker.0 Request processed in 26us (1016us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440418.368561:0:15050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 10 00000100:00100000:0.0:1787440418.368578:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681359232 00000100:00100000:0.0:1787440418.368581:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681359232 00000100:00100000:0.0:1787440418.368610:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 104 00000100:00100000:0.0:1787440418.368615:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee07b943850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83c71368-e5e9-44e8-856a-ef5507fb8c2a+13:2363:x1874266681359232:12345-192.168.206.58@tcp:400:kworker.0 00000100:00100000:0.0:1787440418.368637:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee07b943850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83c71368-e5e9-44e8-856a-ef5507fb8c2a+13:2363:x1874266681359232:12345-192.168.206.58@tcp:400:kworker.0 Request processed in 22us (1211us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440418.368644:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 104 00000100:00080000:1.0:1787440418.369154:0:14361:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787440418.369160:0:14361:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787440418.369162:0:14361:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1787440419.357187:0:14353:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787440420.254102:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787440420.254129:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee077ec3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874266701274880:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787440420.254209:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440420.254984:0:15052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701274880 00000100:00100000:2.0:1787440420.255531:0:15052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701274880 00000100:00080000:1.0:1787440420.255707:0:14361:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787440420.256093:0:15052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787440420.256105:0:15052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04ca3b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874266701274880:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787440420.256140:0:15052:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787440420.256213:0:15052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04ca3b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874266701274880:12345-0@lo:13:osp-pre-0-0.0 Request processed in 111us (2004us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440420.256220:0:15052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787440420.256281:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee077ec3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874266701274880:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787440420.380741:0:16029:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787440420.692025:0:16481:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe1d15ae00 20000000:00000080:2.0:1787440420.692046:0:16481:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8edf412fd000 uarg=0000000000000000 20000000:01000000:2.0:1787440420.692084:0:16481:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1787440420.692091:0:16481:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1787440420.692097:0:16481:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1787440420.693172:0:16482:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:0.0:1787440420.693330:0:16481:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1787440420.711036:0:16481:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1787440420.711064:0:16481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8ee04cbcea00/0x85f5fa77adf3d6b2 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440420.711083:0:16481:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ee04cbcf200/0x85f5fa77adf3d3a9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f5fa77adf3d3a2 expref: 18 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440420.711110:0:16481:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ee049e95800/0x85f5fa77adf3d3f6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f5fa77adf3d3ef expref: 18 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440420.711118:0:16481:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ee07f86f800/0x85f5fa77adf3d531 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f5fa77adf3d52a expref: 18 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440420.711631:0:16481:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ee07fb9fa00/0x85f5fa77adf3d650 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6254a expref: 12 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440420.711645:0:16481:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ee07fb9ec00/0x85f5fa77adf3d688 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc625ac expref: 12 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440420.711653:0:16481:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8ee04cbcea00/0x85f5fa77adf3d6b2 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440420.711774:0:16481:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ee07fb9ec00/0x85f5fa77adf3d688 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc625ac expref: 12 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440420.711792:0:16481:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ee07fb9ec00/0x85f5fa77adf3d688 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc625ac expref: 12 pid: 14360 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440420.711807:0:16481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee07f9f2680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16481:1874266701275008:192.168.206.58@tcp:104: 00010000:00010000:0.0:1787440420.711985:0:16481:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ee07fb9fa00/0x85f5fa77adf3d650 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6254a expref: 12 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440420.711995:0:16481:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ee07fb9fa00/0x85f5fa77adf3d650 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6254a expref: 12 pid: 14360 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440420.712005:0:16481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee07f9f1c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16481:1874266701275136:192.168.206.58@tcp:104: 00010000:00010000:0.0:1787440420.712045:0:16481:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ee07f86f800/0x85f5fa77adf3d531 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x85f5fa77adf3d52a expref: 18 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440420.712055:0:16481:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ee07f86f800/0x85f5fa77adf3d531 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x85f5fa77adf3d52a expref: 18 pid: 14358 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440420.712066:0:16481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee07f9f0000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16481:1874266701275264:0@lo:104: 00000100:00100000:0.0:1787440420.712102:0:16481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787440420.712132:0:16481:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ee049e95800/0x85f5fa77adf3d3f6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x85f5fa77adf3d3ef expref: 18 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440420.712141:0:16481:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ee049e95800/0x85f5fa77adf3d3f6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x85f5fa77adf3d3ef expref: 18 pid: 14360 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440420.712148:0:16481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee06e6cd180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16481:1874266701275392:0@lo:104: 00000100:00100000:0.0:1787440420.712165:0:16481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787440420.712192:0:16481:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ee04cbcf200/0x85f5fa77adf3d3a9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x85f5fa77adf3d3a2 expref: 18 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440420.712202:0:16481:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ee04cbcf200/0x85f5fa77adf3d3a9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x85f5fa77adf3d3a2 expref: 18 pid: 14360 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440420.712206:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701275264 00000100:00100000:0.0:1787440420.712212:0:16481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee06e6cc380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16481:1874266701275520:0@lo:104: 00000100:00100000:1.0:1787440420.712214:0:14348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701275264 00000100:00100000:1.0:1787440420.712259:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701275392 00000100:00100000:1.0:1787440420.712262:0:14348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701275392 00000100:00100000:1.0:1787440420.712275:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787440420.712284:0:14348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee07f9f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+4:16481:x1874266701275264:12345-0@lo:104: 00010000:00010000:1.0:1787440420.712297:0:14348:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.158@tcp lock: ffff8ee049e94200/0x85f5fa77adf3d52a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x85f5fa77adf3d531 expref: -99 pid: 15766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440420.712364:0:14348:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787440420.712375:0:14348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee07f9f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+4:16481:x1874266701275264:12345-0@lo:104: Request processed in 93us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440420.712383:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787440420.712398:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787440420.712404:0:14348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee06e6ced80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+3:16481:x1874266701275392:12345-0@lo:104: 00010000:00010000:1.0:1787440420.712411:0:14348:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.158@tcp lock: ffff8ee07fb9f400/0x85f5fa77adf3d3ef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x85f5fa77adf3d3f6 expref: -99 pid: 15047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440420.712463:0:14348:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787440420.712468:0:14348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee06e6ced80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+3:16481:x1874266701275392:12345-0@lo:104: Request processed in 65us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440420.712474:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787440420.712790:0:16481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440420.712817:0:16481:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee047f96a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787440420.712838:0:16481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee07f9f0000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16481:1874266701275264:0@lo:104: 00000100:00100000:0.0:1787440420.712846:0:16481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee06e6cd180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16481:1874266701275392:0@lo:104: 00010000:00010000:3.0:1787440420.713674:0:14354:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787440420.713684:0:14354:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.158@tcp lock: ffff8ee049e94200/0x85f5fa77adf3d52a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x85f5fa77adf3d531 expref: -99 pid: 15766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440420.713693:0:14354:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee049e94200 already unused, calling callback (ffffffffc1bd2c20) 10000000:00010000:3.0:1787440420.713697:0:14354:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.158@tcp lock: ffff8ee049e94200/0x85f5fa77adf3d52a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x85f5fa77adf3d531 expref: -99 pid: 15766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440420.713707:0:14354:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.158@tcp lock: ffff8ee049e94200/0x85f5fa77adf3d52a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x85f5fa77adf3d531 expref: -99 pid: 15766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787440420.713715:0:14354:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.158@tcp lock: ffff8ee049e94200/0x85f5fa77adf3d52a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x85f5fa77adf3d531 expref: -99 pid: 15766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787440420.713720:0:14354:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:1.0:1787440420.714085:0:14349:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1787440420.714099:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701275520 00000100:00100000:1.0:1787440420.714105:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701275520 00000100:00100000:1.0:1787440420.714141:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787440420.714148:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee07c2c8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+3:16481:x1874266701275520:12345-0@lo:104: 00010000:00010000:1.0:1787440420.714160:0:14349:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.158@tcp lock: ffff8ee049e95200/0x85f5fa77adf3d3a2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x85f5fa77adf3d3a9 expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440420.714219:0:14349:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787440420.714226:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee07c2c8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+3:16481:x1874266701275520:12345-0@lo:104: Request processed in 78us (1436us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440420.714232:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:1.0:1787440420.714275:0:16029:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787440420.714280:0:16029:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.158@tcp lock: ffff8ee07fb9f400/0x85f5fa77adf3d3ef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x85f5fa77adf3d3f6 expref: -99 pid: 15047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440420.714287:0:16029:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee07fb9f400 already unused, calling callback (ffffffffc1bd2c20) 10000000:00010000:1.0:1787440420.714299:0:16029:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.158@tcp lock: ffff8ee07fb9f400/0x85f5fa77adf3d3ef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x85f5fa77adf3d3f6 expref: -99 pid: 15047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440420.714306:0:16029:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.158@tcp lock: ffff8ee07fb9f400/0x85f5fa77adf3d3ef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x85f5fa77adf3d3f6 expref: -99 pid: 15047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787440420.714313:0:16029:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.158@tcp lock: ffff8ee07fb9f400/0x85f5fa77adf3d3ef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x85f5fa77adf3d3f6 expref: -99 pid: 15047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787440420.714319:0:16029:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787440420.715678:0:14354:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.158@tcp lock: ffff8ee049e94200/0x85f5fa77adf3d52a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x85f5fa77adf3d531 expref: -99 pid: 15766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440420.715702:0:14354:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787440420.715728:0:14354:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.158@tcp lock: ffff8ee049e94200/0x85f5fa77adf3d52a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x85f5fa77adf3d531 expref: -99 pid: 15766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440420.715736:0:14354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.158@tcp lock: ffff8ee049e94200/0x85f5fa77adf3d52a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x85f5fa77adf3d531 expref: -99 pid: 15766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440420.715750:0:14354:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787440420.715754:0:14354:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.158@tcp lock: ffff8ee049e95200/0x85f5fa77adf3d3a2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x85f5fa77adf3d3a9 expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440420.715760:0:14354:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee049e95200 already unused, calling callback (ffffffffc1bd2c20) 10000000:00010000:3.0:1787440420.715774:0:14354:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.158@tcp lock: ffff8ee049e95200/0x85f5fa77adf3d3a2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x85f5fa77adf3d3a9 expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440420.715783:0:14354:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.158@tcp lock: ffff8ee049e95200/0x85f5fa77adf3d3a2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x85f5fa77adf3d3a9 expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787440420.715789:0:14354:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.158@tcp lock: ffff8ee049e95200/0x85f5fa77adf3d3a2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x85f5fa77adf3d3a9 expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787440420.715794:0:14354:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787440420.716404:0:14353:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787440420.716956:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787440420.716979:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee0776b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c:3310:1874266701275648:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787440420.717045:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440420.717295:0:16481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee06e6cc380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16481:1874266701275520:0@lo:104: 00010000:00010000:1.0:1787440420.721863:0:16029:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.158@tcp lock: ffff8ee07fb9f400/0x85f5fa77adf3d3ef lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x85f5fa77adf3d3f6 expref: -99 pid: 15047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440420.721890:0:16029:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787440420.721910:0:16029:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.158@tcp lock: ffff8ee07fb9f400/0x85f5fa77adf3d3ef lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x85f5fa77adf3d3f6 expref: -99 pid: 15047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440420.721918:0:16029:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.158@tcp lock: ffff8ee07fb9f400/0x85f5fa77adf3d3ef lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x85f5fa77adf3d3f6 expref: -99 pid: 15047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440420.721935:0:16029:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787440420.721937:0:16029:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787440420.721940:0:16029:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787440420.722194:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee079914700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c:3310:1874266701275776:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787440420.722256:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440420.722423:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701275648 00000100:00100000:0.0:1787440420.722440:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701275648 00010000:00010000:0.0:1787440420.722475:0:14350:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ee07f86f800/0x85f5fa77adf3d531 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x85f5fa77adf3d52a expref: 19 pid: 14358 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440420.722521:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701275776 00000100:00100000:0.0:1787440420.722523:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701275776 00010000:00010000:0.0:1787440420.722534:0:14350:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ee049e95800/0x85f5fa77adf3d3f6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x85f5fa77adf3d3ef expref: 20 pid: 14360 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440420.722548:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787440420.722556:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee077ec3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+20:3310:x1874266701275648:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787440420.722568:0:14350:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787440420.722573:0:14350:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ee07f86f800/0x85f5fa77adf3d531 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x85f5fa77adf3d52a expref: 20 pid: 14358 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440420.722583:0:14350:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ee07f86f800/0x85f5fa77adf3d531 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x85f5fa77adf3d52a expref: 20 pid: 14358 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440420.722597:0:14350:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ee07f86f800/0x85f5fa77adf3d531 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x85f5fa77adf3d52a expref: 20 pid: 14358 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440420.722612:0:14350:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787440420.722649:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee077ec3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+19:3310:x1874266701275648:12345-0@lo:103:ldlm_bl.0 Request processed in 92us (5604us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440420.722656:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787440420.722673:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787440420.722680:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee077ec2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+18:3310:x1874266701275776:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787440420.722688:0:14350:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787440420.722693:0:14350:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ee049e95800/0x85f5fa77adf3d3f6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x85f5fa77adf3d3ef expref: 18 pid: 14360 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440420.722712:0:14350:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ee049e95800/0x85f5fa77adf3d3f6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x85f5fa77adf3d3ef expref: 18 pid: 14360 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440420.722722:0:14350:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ee049e95800/0x85f5fa77adf3d3f6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x85f5fa77adf3d3ef expref: 18 pid: 14360 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440420.722731:0:14350:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787440420.722753:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee077ec2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+17:3310:x1874266701275776:12345-0@lo:103:ldlm_bl.0 Request processed in 75us (498us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440420.722759:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787440420.723033:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee079914700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c:3310:1874266701275776:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787440420.723043:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee0776b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c:3310:1874266701275648:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787440420.724118:0:14354:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.158@tcp lock: ffff8ee049e95200/0x85f5fa77adf3d3a2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x85f5fa77adf3d3a9 expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440420.724232:0:14354:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1787440420.724278:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee0776b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c:3311:1874266701275904:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787440420.724330:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440420.724438:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440420.724478:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701275904 00000100:00100000:0.0:1787440420.724485:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701275904 00010000:00010000:0.0:1787440420.724527:0:14350:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ee04cbcf200/0x85f5fa77adf3d3a9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x85f5fa77adf3d3a2 expref: 17 pid: 14360 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440420.724535:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00010000:00010000:3.0:1787440420.724581:0:14354:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.158@tcp lock: ffff8ee049e95200/0x85f5fa77adf3d3a2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x85f5fa77adf3d3a9 expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440420.724589:0:14354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.158@tcp lock: ffff8ee049e95200/0x85f5fa77adf3d3a2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x85f5fa77adf3d3a9 expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440420.724621:0:14354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787440420.724623:0:14354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787440420.724625:0:14354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787440420.725102:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681360128 00000100:00100000:0.0:1787440420.725108:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681360128 00010000:00010000:0.0:1787440420.725141:0:14350:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ee07fb9ec00/0x85f5fa77adf3d688 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc625ac expref: 13 pid: 14360 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440420.725156:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681360256 00000100:00100000:0.0:1787440420.725159:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681360256 00010000:00010000:0.0:1787440420.725183:0:14350:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ee07fb9fa00/0x85f5fa77adf3d650 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6254a expref: 14 pid: 14360 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440420.725199:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787440420.725208:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee07fb18450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+17:3311:x1874266701275904:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787440420.725220:0:14350:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787440420.725226:0:14350:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ee04cbcf200/0x85f5fa77adf3d3a9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x85f5fa77adf3d3a2 expref: 17 pid: 14360 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440420.725242:0:14350:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ee04cbcf200/0x85f5fa77adf3d3a9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x85f5fa77adf3d3a2 expref: 17 pid: 14360 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440420.725258:0:14350:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ee04cbcf200/0x85f5fa77adf3d3a9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x85f5fa77adf3d3a2 expref: 17 pid: 14360 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440420.725270:0:14350:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787440420.725323:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee07fb18450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+16:3311:x1874266701275904:12345-0@lo:103:ldlm_bl.0 Request processed in 115us (992us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440420.725330:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787440420.725371:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 7 00000100:00100000:0.0:1787440420.725378:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee079915180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:83c71368-e5e9-44e8-856a-ef5507fb8c2a+14:2363:x1874266681360128:12345-192.168.206.58@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787440420.725386:0:14350:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787440420.725390:0:14350:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ee07fb9ec00/0x85f5fa77adf3d688 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc625ac expref: 14 pid: 14360 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440420.725702:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee0776b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c:3311:1874266701275904:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787440420.725778:0:14350:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ee07fb9ec00/0x85f5fa77adf3d688 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc625ac expref: 14 pid: 14360 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440420.725791:0:14350:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787440420.725868:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee079915180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:83c71368-e5e9-44e8-856a-ef5507fb8c2a+14:2363:x1874266681360128:12345-192.168.206.58@tcp:103:ldlm_bl.0 Request processed in 489us (1432us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440420.725876:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 7 00000100:00100000:0.0:1787440420.725891:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 8 00000100:00100000:0.0:1787440420.725898:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee079915880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:83c71368-e5e9-44e8-856a-ef5507fb8c2a+13:2363:x1874266681360256:12345-192.168.206.58@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787440420.725906:0:14350:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787440420.725918:0:14350:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ee07fb9fa00/0x85f5fa77adf3d650 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6254a expref: 13 pid: 14360 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440420.725928:0:14350:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ee07fb9fa00/0x85f5fa77adf3d650 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6254a expref: 13 pid: 14360 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440420.725940:0:14350:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8ee04cbcea00/0x85f5fa77adf3d6b2 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440420.725947:0:14350:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ee04cbcea00/0x85f5fa77adf3d6b2 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440420.725962:0:14350:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ee04cbcea00/0x85f5fa77adf3d6b2 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440420.725969:0:14350:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ee04cbcea00/0x85f5fa77adf3d6b2 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440420.725975:0:14350:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8ee04cbcea00/0x85f5fa77adf3d6b2 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440420.725983:0:14350:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8ee04cbcea00/0x85f5fa77adf3d6b2 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440420.725988:0:14350:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee04cbcea00 already unused, calling callback (ffffffffc15b52a0) 00010000:00010000:0.0:1787440420.725992:0:14350:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8ee04cbcea00/0x85f5fa77adf3d6b2 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440420.726000:0:14350:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8ee04cbcea00/0x85f5fa77adf3d6b2 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440420.726007:0:14350:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8ee04cbcea00/0x85f5fa77adf3d6b2 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440420.726022:0:14350:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787440420.726043:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee079915880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:83c71368-e5e9-44e8-856a-ef5507fb8c2a+13:2363:x1874266681360256:12345-192.168.206.58@tcp:103:ldlm_bl.0 Request processed in 146us (1507us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440420.726050:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 8 00010000:00010000:0.0:1787440420.726087:0:16481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ee07fb9ec00/0x85f5fa77adf3d688 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc625ac expref: 12 pid: 14360 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440420.726098:0:16481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee07f9f2680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16481:1874266701275008:192.168.206.58@tcp:104: 00010000:00010000:0.0:1787440420.726109:0:16481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ee07fb9fa00/0x85f5fa77adf3d650 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6254a expref: 11 pid: 14360 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440420.726117:0:16481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee07f9f1c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16481:1874266701275136:192.168.206.58@tcp:104: 00010000:00010000:0.0:1787440420.726155:0:16481:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8ee04cbcea00/0x85f5fa77adf3d6b2 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440420.726163:0:16481:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8ee04cbcea00/0x85f5fa77adf3d6b2 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440420.726168:0:16481:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8ee04cbcea00/0x85f5fa77adf3d6b2 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440420.726173:0:16481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ee04cbcea00/0x85f5fa77adf3d6b2 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440421.277479:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee077ec0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1874266701276032:0@lo:400:kworker.0 00000100:00100000:0.0:1787440421.277561:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440421.278173:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee077ec1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1874266701276416:0@lo:400:kworker.0 00000100:00100000:3.0:1787440421.278211:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440421.280251:0:15050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701276032 00000100:00100000:0.0:1787440421.280337:0:15050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701276032 00000100:00100000:0.0:1787440421.280467:0:15050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787440421.280478:0:15050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee06e6cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1874266701276032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787440421.280590:0:15050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee06e6cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1874266701276032:12345-0@lo:400:kworker.0 Request processed in 114us (3028us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440421.280597:0:15050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787440421.280730:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee06e6cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1874266701276544:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787440421.280767:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440421.280811:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee077ec0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1874266701276032:0@lo:400:kworker.0 00000100:00100000:0.0:1787440421.280838:0:15052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701276544 00000100:00100000:0.0:1787440421.280842:0:15052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701276544 00000100:00100000:0.0:1787440421.280878:0:15052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787440421.280885:0:15052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee06e6ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874266701276544:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787440421.280913:0:15052:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787440421.280947:0:15052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee06e6ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874266701276544:12345-0@lo:13:osp-pre-1-0.0 Request processed in 62us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440421.280953:0:15052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787440421.280965:0:16298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701276416 00000100:00080000:0.0:1787440421.280967:0:14361:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787440421.280969:0:16298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701276416 00000100:00080000:0.0:1787440421.280985:0:14361:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787440421.281002:0:16298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787440421.281004:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee06e6cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1874266701276544:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787440421.281008:0:16298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee0776b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874266701276416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440421.281040:0:16298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee0776b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874266701276416:12345-0@lo:400:kworker.0 Request processed in 32us (2829us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440421.281045:0:16298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787440421.281068:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee077ec2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874266701276288:0@lo:400:kworker.0 00000100:00100000:0.0:1787440421.281092:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440421.281112:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787440421.281118:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee077ec0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1874266701276160:0@lo:400:kworker.0 00000100:00100000:0.0:1787440421.281137:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440421.281169:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701276288 00000100:00100000:0.0:1787440421.282377:0:14367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701276288 00000100:00100000:3.0:1787440421.283386:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee077ec1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1874266701276416:0@lo:400:kworker.0 00000100:00100000:0.0:1787440421.283562:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787440421.283573:0:14367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee06e6cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874266701276288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787440421.284519:0:14367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee06e6cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874266701276288:12345-0@lo:400:kworker.0 Request processed in 943us (3419us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440421.284531:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787440421.284588:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee077ec2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874266701276288:0@lo:400:kworker.0 00000100:00100000:2.0:1787440421.284708:0:15051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701276160 00000100:00100000:2.0:1787440421.284717:0:15051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701276160 00000100:00100000:2.0:1787440421.287573:0:15051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787440421.287592:0:15051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee06e6cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1874266701276160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787440421.289763:0:15051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee06e6cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1874266701276160:12345-0@lo:400:kworker.0 Request processed in 2171us (8618us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440421.289776:0:15051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787440421.290371:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee0776b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1874266701276672:0@lo:400:kworker.0 00000100:00100000:1.0:1787440421.290425:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440421.290955:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee077ec0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1874266701276160:0@lo:400:kworker.0 00000100:00100000:3.0:1787440421.294924:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701276672 00000100:00100000:3.0:1787440421.294939:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701276672 00000100:00100000:3.0:1787440421.295006:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787440421.295016:0:14366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee079914700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1874266701276672:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1787440421.295099:0:14361:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787440421.299906:0:14366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee079914700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1874266701276672:12345-0@lo:400:kworker.0 Request processed in 4882us (9471us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440421.299922:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787440421.300148:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee0776b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1874266701276672:0@lo:400:kworker.0 00010000:00010000:0.0:1787440421.405737:0:14353:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787440422.050996:0:14362:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787440422.051002:0:14362:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8edf4356d000 from 10 10000000:01000000:2.0:1787440422.051006:0:14362:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787440422.051045:0:14362:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.158@tcp lock: ffff8edf42bde400/0x85f5fa77adf3d6b9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440422.051055:0:14362:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.158@tcp lock: ffff8edf42bde400/0x85f5fa77adf3d6b9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440422.051066:0:14362:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.158@tcp lock: ffff8edf42bde400/0x85f5fa77adf3d6b9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440422.051090:0:14362:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee077ec0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c:14362:1874266701276800:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787440422.051149:0:14362:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440422.051184:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701276800 00000100:00100000:2.0:1787440422.051189:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701276800 00000100:00100000:2.0:1787440422.051230:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1787440422.051238:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee07b941450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+16:14362:x1874266701276800:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787440422.051249:0:14360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440422.051261:0:14360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8edf42bdf800/0x85f5fa77adf3d6c0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x85f5fa77adf3d6b9 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440422.051282:0:14360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8edf42bdf800/0x85f5fa77adf3d6c0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x85f5fa77adf3d6b9 expref: 17 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440422.051300:0:14360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8edf42bdf800/0x85f5fa77adf3d6c0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f5fa77adf3d6b9 expref: 17 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440422.051308:0:14360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8edf42bdf800, rc 0) 00000100:00100000:2.0:1787440422.051337:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee07b941450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+17:14362:x1874266701276800:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 101us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440422.051344:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1787440422.051390:0:14362:0:(client.c:2715:ptlrpc_set_wait()) set ffff8edf411073c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787440422.051409:0:14362:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee077ec0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c:14362:1874266701276800:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787440422.051422:0:14362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.158@tcp lock: ffff8edf42bde400/0x85f5fa77adf3d6b9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3d6c0 expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440422.051431:0:14362:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.158@tcp lock: ffff8edf42bde400/0x85f5fa77adf3d6b9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x85f5fa77adf3d6c0 expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440422.051515:0:14362:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee077ec0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c:14362:1874266701276928:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787440422.051542:0:14362:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440422.051563:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701276928 00000100:00100000:2.0:1787440422.051566:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701276928 00000100:00100000:2.0:1787440422.051586:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1787440422.051593:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee07b941050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+17:14362:x1874266701276928:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787440422.051810:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee07b941050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+17:14362:x1874266701276928:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 217us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440422.051818:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1787440422.051841:0:14362:0:(client.c:2715:ptlrpc_set_wait()) set ffff8edf411073c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787440422.051852:0:14362:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee077ec0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c:14362:1874266701276928:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787440422.051884:0:14362:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee077ec0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c:14362:1874266701277056:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787440422.051920:0:14362:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440422.051938:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701277056 00000100:00100000:2.0:1787440422.051942:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701277056 00000100:00100000:2.0:1787440422.051963:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1787440422.051969:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee07b940050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+17:14362:x1874266701277056:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787440422.052094:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee07b940050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+17:14362:x1874266701277056:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 124us (173us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440422.052101:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1787440422.052128:0:14362:0:(client.c:2715:ptlrpc_set_wait()) set ffff8edf411073c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787440422.052139:0:14362:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee077ec0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c:14362:1874266701277056:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787440422.052755:0:16542:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1787440422.052807:0:14362:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1787440422.052820:0:14362:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.158@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787440422.052828:0:14362:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.158@tcp lock: ffff8edf42bde400/0x85f5fa77adf3d6b9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3d6c0 expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440422.052837:0:14362:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.158@tcp lock: ffff8edf42bde400/0x85f5fa77adf3d6b9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3d6c0 expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787440422.052846:0:14362:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787440422.052848:0:14362:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8ee07c2d3800 from 10 10000000:01000000:2.0:1787440422.052851:0:14362:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787440422.052874:0:14362:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.158@tcp lock: ffff8edf42bdf000/0x85f5fa77adf3d6c7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440422.052881:0:14362:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.158@tcp lock: ffff8edf42bdf000/0x85f5fa77adf3d6c7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440422.052897:0:14362:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.158@tcp lock: ffff8edf42bdf000/0x85f5fa77adf3d6c7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440422.052911:0:14362:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee077ec0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c:14362:1874266701277184:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787440422.052943:0:14362:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440422.052961:0:14362:0:(client.c:2715:ptlrpc_set_wait()) set ffff8edf411076c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787440422.052975:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701277184 00000100:00100000:2.0:1787440422.052979:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701277184 00000100:00100000:2.0:1787440422.053003:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1787440422.053010:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee07b942450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+17:14362:x1874266701277184:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787440422.053019:0:14360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440422.053030:0:14360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8edf42bdf600/0x85f5fa77adf3d6ce lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x85f5fa77adf3d6c7 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440422.053046:0:14360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8edf42bdf600/0x85f5fa77adf3d6ce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x85f5fa77adf3d6c7 expref: 18 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440422.053055:0:14360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8edf42bdf600/0x85f5fa77adf3d6ce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f5fa77adf3d6c7 expref: 18 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440422.053063:0:14360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8edf42bdf600, rc 0) 00000100:00100000:2.0:1787440422.053094:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee07b942450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+18:14362:x1874266701277184:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 84us (150us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440422.053101:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1787440422.053133:0:14362:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee077ec0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c:14362:1874266701277184:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787440422.053144:0:14362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.158@tcp lock: ffff8edf42bdf000/0x85f5fa77adf3d6c7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3d6ce expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440422.053158:0:14362:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.158@tcp lock: ffff8edf42bdf000/0x85f5fa77adf3d6c7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x85f5fa77adf3d6ce expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440422.053196:0:14362:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee077ec0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c:14362:1874266701277312:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787440422.053221:0:14362:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440422.053234:0:14362:0:(client.c:2715:ptlrpc_set_wait()) set ffff8edf411076c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787440422.053246:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701277312 00000100:00100000:2.0:1787440422.053249:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701277312 00000100:00100000:2.0:1787440422.053269:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1787440422.053275:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee07b942c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+18:14362:x1874266701277312:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787440422.053462:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee07b942c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+18:14362:x1874266701277312:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 186us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440422.053469:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1787440422.058660:0:14362:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee077ec0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c:14362:1874266701277312:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787440422.058717:0:14362:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee077ec0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c:14362:1874266701277440:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787440422.058784:0:14362:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440422.058823:0:14362:0:(client.c:2715:ptlrpc_set_wait()) set ffff8edf411076c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787440422.058950:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701277440 00000100:00100000:3.0:1787440422.058956:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701277440 00000100:00100000:3.0:1787440422.059003:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1787440422.059012:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee07b943c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+18:14362:x1874266701277440:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787440422.059189:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee07b943c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+18:14362:x1874266701277440:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 178us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440422.059197:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1787440422.059240:0:14362:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee077ec0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c:14362:1874266701277440:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787440422.063088:0:16543:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1787440422.063247:0:14362:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1787440422.063267:0:14362:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.158@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787440422.063289:0:14362:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.158@tcp lock: ffff8edf42bdf000/0x85f5fa77adf3d6c7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3d6ce expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440422.063300:0:14362:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.158@tcp lock: ffff8edf42bdf000/0x85f5fa77adf3d6c7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3d6ce expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787440422.063310:0:14362:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787440422.063312:0:14362:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8ee0438d0800 from 10 10000000:01000000:1.0:1787440422.063315:0:14362:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787440422.063348:0:14362:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.158@tcp lock: ffff8ee07fb9fe00/0x85f5fa77adf3d6d5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440422.063355:0:14362:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.158@tcp lock: ffff8ee07fb9fe00/0x85f5fa77adf3d6d5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440422.063366:0:14362:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.158@tcp lock: ffff8ee07fb9fe00/0x85f5fa77adf3d6d5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440422.063388:0:14362:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee079914000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c:14362:1874266701277568:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787440422.063462:0:14362:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440422.063520:0:14362:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee080443cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787440422.063577:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701277568 00000100:00100000:2.0:1787440422.063583:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701277568 00000100:00100000:2.0:1787440422.063628:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1787440422.063636:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee07b941c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+18:14362:x1874266701277568:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787440422.063649:0:14360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440422.063661:0:14360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8edf42bdea00/0x85f5fa77adf3d6dc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x85f5fa77adf3d6d5 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440422.063693:0:14360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8edf42bdea00/0x85f5fa77adf3d6dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x85f5fa77adf3d6d5 expref: 19 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440422.063704:0:14360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8edf42bdea00/0x85f5fa77adf3d6dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f5fa77adf3d6d5 expref: 19 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440422.063713:0:14360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8edf42bdea00, rc 0) 00000100:00100000:2.0:1787440422.063755:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee07b941c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+19:14362:x1874266701277568:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 120us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440422.063763:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1787440422.063803:0:14362:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee079914000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c:14362:1874266701277568:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787440422.063817:0:14362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.158@tcp lock: ffff8ee07fb9fe00/0x85f5fa77adf3d6d5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3d6dc expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440422.063826:0:14362:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.158@tcp lock: ffff8ee07fb9fe00/0x85f5fa77adf3d6d5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x85f5fa77adf3d6dc expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440422.063870:0:14362:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee077ec3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c:14362:1874266701277696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787440422.063894:0:14362:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440422.063908:0:14362:0:(client.c:2715:ptlrpc_set_wait()) set ffff8edf411070c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787440422.063920:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701277696 00000100:00100000:2.0:1787440422.063923:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701277696 00000100:00100000:2.0:1787440422.063944:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1787440422.063950:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee07b940450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+19:14362:x1874266701277696:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787440422.064167:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee07b940450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+19:14362:x1874266701277696:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 215us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440422.064182:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1787440422.064213:0:14362:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee077ec3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c:14362:1874266701277696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787440422.064238:0:14362:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee077ec3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c:14362:1874266701277824:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787440422.064272:0:14362:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440422.064285:0:14362:0:(client.c:2715:ptlrpc_set_wait()) set ffff8edf411070c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787440422.064296:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701277824 00000100:00100000:2.0:1787440422.064299:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701277824 00000100:00100000:2.0:1787440422.064319:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1787440422.064324:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee07b940850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+19:14362:x1874266701277824:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787440422.064463:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee07b940850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+19:14362:x1874266701277824:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 138us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440422.064470:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1787440422.064530:0:14362:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee077ec3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c:14362:1874266701277824:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787440422.065137:0:16544:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1787440422.065181:0:14362:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1787440422.065192:0:14362:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.158@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787440422.065199:0:14362:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.158@tcp lock: ffff8ee07fb9fe00/0x85f5fa77adf3d6d5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3d6dc expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440422.065207:0:14362:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.158@tcp lock: ffff8ee07fb9fe00/0x85f5fa77adf3d6d5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f5fa77adf3d6dc expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440422.428884:0:16029:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787440422.522005:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:1.0:1787440422.522050:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681360384 00000100:00100000:1.0:1787440422.522060:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681360384 00000100:00100000:1.0:1787440422.522112:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 114 00000100:00100000:1.0:1787440422.522121:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee07b942050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83c71368-e5e9-44e8-856a-ef5507fb8c2a+11:13774:x1874266681360384:12345-192.168.206.58@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787440422.522140:0:14357:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440422.522160:0:14357:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ee07fb9e800/0x85f5fa77adf3d6e3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fab14535dc625dd expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440422.522205:0:14357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ee07fb9e800/0x85f5fa77adf3d6e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc625dd expref: 12 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440422.522216:0:14357:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ee07fb9e800/0x85f5fa77adf3d6e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc625dd expref: 12 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440422.522238:0:14357:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee07fb9e800, rc 0) 00000100:00100000:1.0:1787440422.522290:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee07b942050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83c71368-e5e9-44e8-856a-ef5507fb8c2a+12:13774:x1874266681360384:12345-192.168.206.58@tcp:101:ll_cfg_requeue.0 Request processed in 170us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440422.522298:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 114 00000100:00100000:0.0:1787440422.532044:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:1.0:1787440422.532550:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681360512 00000100:00100000:1.0:1787440422.532561:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681360512 00000100:00100000:1.0:1787440422.532614:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 115 00000100:00100000:1.0:1787440422.532625:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee07b943050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83c71368-e5e9-44e8-856a-ef5507fb8c2a+12:13774:x1874266681360512:12345-192.168.206.58@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787440422.534158:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee07b943050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83c71368-e5e9-44e8-856a-ef5507fb8c2a+12:13774:x1874266681360512:12345-192.168.206.58@tcp:501:ll_cfg_requeue.0 Request processed in 1527us (2115us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440422.534170:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 115 00000100:00100000:1.0:1787440422.556301:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440422.556419:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681360640 00000100:00100000:3.0:1787440422.556433:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681360640 00000100:00100000:3.0:1787440422.556558:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 116 00000100:00100000:3.0:1787440422.556572:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee07b941850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83c71368-e5e9-44e8-856a-ef5507fb8c2a+12:13774:x1874266681360640:12345-192.168.206.58@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787440422.556903:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee07b941850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83c71368-e5e9-44e8-856a-ef5507fb8c2a+12:13774:x1874266681360640:12345-192.168.206.58@tcp:503:ll_cfg_requeue.0 Request processed in 331us (617us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440422.556913:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 116 00000100:00100000:2.0:1787440422.571846:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:2.0:1787440422.571897:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681360768 00000100:00100000:2.0:1787440422.571907:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681360768 00000100:00100000:2.0:1787440422.572007:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 117 00000100:00100000:2.0:1787440422.572020:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee07b122050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83c71368-e5e9-44e8-856a-ef5507fb8c2a+12:13774:x1874266681360768:12345-192.168.206.58@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787440422.572958:0:14357:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440422.572987:0:14357:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8edf42bdfe00/0x85f5fa77adf3d6ea lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fab14535dc625e4 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440422.573026:0:14357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8edf42bdfe00/0x85f5fa77adf3d6ea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc625e4 expref: 13 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440422.573038:0:14357:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8edf42bdfe00/0x85f5fa77adf3d6ea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc625e4 expref: 13 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440422.573047:0:14357:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8edf42bdfe00, rc 0) 00000100:00100000:2.0:1787440422.573254:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee07b122050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83c71368-e5e9-44e8-856a-ef5507fb8c2a+13:13774:x1874266681360768:12345-192.168.206.58@tcp:101:ll_cfg_requeue.0 Request processed in 1233us (1414us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440422.573265:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 117 00000100:00100000:3.0:1787440422.584550:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:1.0:1787440422.585273:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681360896 00000100:00100000:1.0:1787440422.585290:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681360896 00000100:00100000:1.0:1787440422.585390:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 118 00000100:00100000:1.0:1787440422.585405:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee07b123050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83c71368-e5e9-44e8-856a-ef5507fb8c2a+13:13774:x1874266681360896:12345-192.168.206.58@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787440422.588874:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee07b123050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83c71368-e5e9-44e8-856a-ef5507fb8c2a+13:13774:x1874266681360896:12345-192.168.206.58@tcp:501:ll_cfg_requeue.0 Request processed in 3455us (4371us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440422.588893:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 118 00000100:00100000:1.0:1787440422.599788:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440422.599873:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681361024 00000100:00100000:3.0:1787440422.599887:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681361024 00000100:00100000:3.0:1787440422.599968:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 119 00000100:00100000:3.0:1787440422.599981:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee07b121850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83c71368-e5e9-44e8-856a-ef5507fb8c2a+13:13774:x1874266681361024:12345-192.168.206.58@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787440422.600361:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee07b121850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83c71368-e5e9-44e8-856a-ef5507fb8c2a+13:13774:x1874266681361024:12345-192.168.206.58@tcp:503:ll_cfg_requeue.0 Request processed in 380us (583us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440422.600371:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 119 00010000:00010000:3.0:1787440423.452646:0:14354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787440423.481062:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:2.0:1787440423.481109:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:2.0:1787440423.481145:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:2.0:1787440423.481182:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:2.0:1787440423.481211:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440423.481219:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681361664 00000100:00100000:2.0:1787440423.481230:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440423.481231:0:14367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681361664 00000100:00100000:2.0:1787440423.481255:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:2.0:1787440423.481279:0:15049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681361408 00000100:00100000:2.0:1787440423.481284:0:15049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681361408 00000100:00100000:3.0:1787440423.481296:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681361280 00000100:00100000:3.0:1787440423.481301:0:14367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681361280 00000100:00100000:2.0:1787440423.481315:0:15049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681361920 00000100:00100000:2.0:1787440423.481320:0:15049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681361920 00000100:00100000:3.0:1787440423.481336:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 25 00000100:00100000:2.0:1787440423.481340:0:15049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681361536 00000100:00100000:2.0:1787440423.481344:0:15049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681361536 00000100:00100000:3.0:1787440423.481348:0:14367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee077ec2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:33ce6cea-c670-4f62-bfc5-6966392caf40+6:2360:x1874266681361664:12345-192.168.206.58@tcp:400:kworker.0 00000100:00100000:2.0:1787440423.481382:0:15049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681361792 00000100:00100000:2.0:1787440423.481385:0:15049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681361792 00000100:00100000:2.0:1787440423.481401:0:15049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 13 00000100:00100000:2.0:1787440423.481408:0:15049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee077ec3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ebeced4c-c181-4444-bfc2-6340445251d5+5:2360:x1874266681361408:12345-192.168.206.58@tcp:400:kworker.0 00000100:00100000:3.0:1787440423.481461:0:14367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee077ec2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:33ce6cea-c670-4f62-bfc5-6966392caf40+6:2360:x1874266681361664:12345-192.168.206.58@tcp:400:kworker.0 Request processed in 115us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440423.481470:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 25 00000100:00100000:3.0:1787440423.481519:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 26 00000100:00100000:3.0:1787440423.481528:0:14367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee077ec2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ebeced4c-c181-4444-bfc2-6340445251d5+6:2360:x1874266681361280:12345-192.168.206.58@tcp:400:kworker.0 00000100:00100000:1.0:1787440423.481542:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681361152 00000100:00100000:1.0:1787440423.481548:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681361152 00000100:00100000:0.0:1787440423.481608:0:15050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 14 00000100:00100000:0.0:1787440423.481618:0:15050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee077ec1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:33ce6cea-c670-4f62-bfc5-6966392caf40+5:2360:x1874266681361920:12345-192.168.206.58@tcp:400:kworker.0 00000100:00100000:1.0:1787440423.481679:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 120 00000100:00100000:1.0:1787440423.481700:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee07b122850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83c71368-e5e9-44e8-856a-ef5507fb8c2a+13:2360:x1874266681361152:12345-192.168.206.58@tcp:400:kworker.0 00000100:00100000:2.0:1787440423.482142:0:15049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee077ec3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ebeced4c-c181-4444-bfc2-6340445251d5+5:2360:x1874266681361408:12345-192.168.206.58@tcp:400:kworker.0 Request processed in 731us (1029us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440423.482151:0:15049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 13 00000100:00100000:2.0:1787440423.482171:0:15049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 15 00000100:00100000:2.0:1787440423.482179:0:15049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee077ec3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ebeced4c-c181-4444-bfc2-6340445251d5+5:2360:x1874266681361536:12345-192.168.206.58@tcp:400:kworker.0 00000100:00100000:2.0:1787440423.482210:0:15049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee077ec3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ebeced4c-c181-4444-bfc2-6340445251d5+5:2360:x1874266681361536:12345-192.168.206.58@tcp:400:kworker.0 Request processed in 33us (980us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440423.482216:0:15049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 15 00000100:00100000:2.0:1787440423.482229:0:15049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 16 00000100:00100000:2.0:1787440423.482235:0:15049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee077ec0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:33ce6cea-c670-4f62-bfc5-6966392caf40+5:2360:x1874266681361792:12345-192.168.206.58@tcp:400:kworker.0 00000100:00100000:2.0:1787440423.482258:0:15049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee077ec0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:33ce6cea-c670-4f62-bfc5-6966392caf40+5:2360:x1874266681361792:12345-192.168.206.58@tcp:400:kworker.0 Request processed in 24us (1005us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440423.482265:0:15049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 16 00000100:00080000:2.0:1787440423.482321:0:14361:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787440423.482326:0:14361:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787440423.482330:0:14361:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787440423.485566:0:14367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee077ec2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ebeced4c-c181-4444-bfc2-6340445251d5+6:2360:x1874266681361280:12345-192.168.206.58@tcp:400:kworker.0 Request processed in 4025us (4339us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440423.485580:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 26 00000100:00100000:0.0:1787440423.494217:0:15050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee077ec1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:33ce6cea-c670-4f62-bfc5-6966392caf40+5:2360:x1874266681361920:12345-192.168.206.58@tcp:400:kworker.0 Request processed in 12589us (13022us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440423.494232:0:15050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 14 00000100:00100000:1.0:1787440423.495401:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee07b122850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83c71368-e5e9-44e8-856a-ef5507fb8c2a+13:2360:x1874266681361152:12345-192.168.206.58@tcp:400:kworker.0 Request processed in 13706us (14342us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440423.495416:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 120 00000100:00100000:2.0:1787440424.181765:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440424.181873:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681362048 00000100:00100000:0.0:1787440424.181883:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681362048 00000100:00100000:0.0:1787440424.181949:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 15 00000100:00100000:0.0:1787440424.181959:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee077ec1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ebeced4c-c181-4444-bfc2-6340445251d5+6:14432:x1874266681362048:12345-192.168.206.58@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787440424.181978:0:14365:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440424.181999:0:14365:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce000/0x85f5fa77adf3d6f1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fab14535dc625eb expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440424.182061:0:14365:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce400/0x85f5fa77adf3d6f8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14365 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440424.182087:0:14365:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce400/0x85f5fa77adf3d6f8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14365 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440424.182099:0:14365:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce400/0x85f5fa77adf3d6f8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14365 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440424.182113:0:14365:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce600/0x85f5fa77adf3d6ff lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14365 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440424.182120:0:14365:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce600/0x85f5fa77adf3d6ff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14365 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440424.182127:0:14365:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce600/0x85f5fa77adf3d6ff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14365 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440424.182640:0:14365:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfc00/0x85f5fa77adf3d706 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14365 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440424.182651:0:14365:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfc00/0x85f5fa77adf3d706 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14365 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440424.182659:0:14365:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfc00/0x85f5fa77adf3d706 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14365 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787440424.182733:0:14365:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:0.0:1787440424.182736:0:14365:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1787440424.182816:0:14365:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfc00/0x85f5fa77adf3d706 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14365 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440424.182829:0:14365:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce400/0x85f5fa77adf3d6f8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14365 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440424.182845:0:14365:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce400/0x85f5fa77adf3d6f8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14365 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440424.182852:0:14365:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce400/0x85f5fa77adf3d6f8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14365 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440424.182857:0:14365:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee04cbce400 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:0.0:1787440424.182862:0:14365:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce400/0x85f5fa77adf3d6f8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14365 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440424.182868:0:14365:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce400/0x85f5fa77adf3d6f8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14365 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440424.182880:0:14365:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ee050ca1800) 00010000:00010000:0.0:1787440424.182883:0:14365:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440424.182887:0:14365:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce400/0x85f5fa77adf3d6f8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14365 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440424.182910:0:14365:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce400/0x85f5fa77adf3d6f8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14365 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440424.182923:0:14365:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce600/0x85f5fa77adf3d6ff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14365 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440424.182929:0:14365:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce600/0x85f5fa77adf3d6ff lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14365 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440424.182935:0:14365:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce600/0x85f5fa77adf3d6ff lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14365 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440424.182940:0:14365:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee04cbce600 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:0.0:1787440424.182949:0:14365:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce600/0x85f5fa77adf3d6ff lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14365 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440424.182956:0:14365:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce600/0x85f5fa77adf3d6ff lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14365 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440424.182964:0:14365:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8ee050ca1c00) 00010000:00010000:0.0:1787440424.182967:0:14365:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440424.182970:0:14365:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce600/0x85f5fa77adf3d6ff lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14365 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440424.182975:0:14365:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce600/0x85f5fa77adf3d6ff lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14365 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440424.183008:0:14365:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce000/0x85f5fa77adf3d6f1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc625eb expref: 8 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440424.183022:0:14365:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfc00/0x85f5fa77adf3d706 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc625eb expref: 7 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440424.183029:0:14365:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8ee050ca1700) 00010000:00010000:0.0:1787440424.183032:0:14365:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787440424.183034:0:14365:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee04cbcfc00, rc 0) 00000100:00100000:0.0:1787440424.183094:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee077ec1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ebeced4c-c181-4444-bfc2-6340445251d5+7:14432:x1874266681362048:12345-192.168.206.58@tcp:101:lhsmtool_posix.0 Request processed in 1137us (1339us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440424.183101:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 15 00000100:00100000:2.0:1787440424.194215:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440424.194360:0:16298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681362304 00000100:00100000:3.0:1787440424.194372:0:16298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681362304 00000100:00100000:3.0:1787440424.194448:0:16298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 16 00000100:00100000:3.0:1787440424.194457:0:16298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee077ec1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ebeced4c-c181-4444-bfc2-6340445251d5+7:14432:x1874266681362304:12345-192.168.206.58@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787440424.194479:0:16298:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440424.194529:0:16298:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94e00/0x85f5fa77adf3d70d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fab14535dc625f2 expref: -99 pid: 16298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440424.194605:0:16298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95200/0x85f5fa77adf3d714 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440424.194620:0:16298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95200/0x85f5fa77adf3d714 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440424.194633:0:16298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95200/0x85f5fa77adf3d714 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440424.194647:0:16298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94200/0x85f5fa77adf3d71b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440424.194671:0:16298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94200/0x85f5fa77adf3d71b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440424.194677:0:16298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94200/0x85f5fa77adf3d71b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440424.195196:0:16298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95a00/0x85f5fa77adf3d722 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440424.195207:0:16298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95a00/0x85f5fa77adf3d722 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440424.195215:0:16298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95a00/0x85f5fa77adf3d722 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16298 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787440424.195225:0:16298:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:3.0:1787440424.195536:0:16298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95200/0x85f5fa77adf3d714 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440424.195544:0:16298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95200/0x85f5fa77adf3d714 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440424.195551:0:16298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95200/0x85f5fa77adf3d714 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440424.195556:0:16298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee049e95200 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:3.0:1787440424.195561:0:16298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95200/0x85f5fa77adf3d714 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440424.195568:0:16298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95200/0x85f5fa77adf3d714 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440424.195590:0:16298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8ee050ca1700) 00010000:00010000:3.0:1787440424.195593:0:16298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440424.195598:0:16298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95200/0x85f5fa77adf3d714 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440424.195610:0:16298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95200/0x85f5fa77adf3d714 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440424.195622:0:16298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94200/0x85f5fa77adf3d71b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440424.195628:0:16298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94200/0x85f5fa77adf3d71b lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440424.195634:0:16298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94200/0x85f5fa77adf3d71b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440424.195639:0:16298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee049e94200 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:3.0:1787440424.195643:0:16298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94200/0x85f5fa77adf3d71b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440424.195648:0:16298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94200/0x85f5fa77adf3d71b lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440424.195655:0:16298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8ee050cada00) 00010000:00010000:3.0:1787440424.195658:0:16298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440424.195660:0:16298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94200/0x85f5fa77adf3d71b lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440424.195665:0:16298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94200/0x85f5fa77adf3d71b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440424.196058:0:16298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94e00/0x85f5fa77adf3d70d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc625f2 expref: 10 pid: 16298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440424.196074:0:16298:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95a00/0x85f5fa77adf3d722 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc625f2 expref: 9 pid: 16298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440424.196081:0:16298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ee050cad200) 00010000:00010000:3.0:1787440424.196084:0:16298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440424.196086:0:16298:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee049e95a00, rc 0) 00000100:00100000:3.0:1787440424.196163:0:16298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee077ec1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ebeced4c-c181-4444-bfc2-6340445251d5+9:14432:x1874266681362304:12345-192.168.206.58@tcp:101:lhsmtool_posix.0 Request processed in 1707us (1957us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1787440424.196171:0:16298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 16 00000100:00100000:3.0:1787440424.205562:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440424.205766:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681362432 00000100:00100000:0.0:1787440424.205775:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681362432 00000100:00100000:0.0:1787440424.205836:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 17 00000100:00100000:0.0:1787440424.205847:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee0776bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ebeced4c-c181-4444-bfc2-6340445251d5+9:14432:x1874266681362432:12345-192.168.206.58@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1787440424.205968:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee0776bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ebeced4c-c181-4444-bfc2-6340445251d5+9:14432:x1874266681362432:12345-192.168.206.58@tcp:59:lhsmtool_posix.0 Request processed in 123us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440424.205976:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 17 00000100:00100000:2.0:1787440424.251462:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440424.251582:0:16298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681362560 00000100:00100000:3.0:1787440424.251600:0:16298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681362560 00000100:00100000:3.0:1787440424.251657:0:16298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 18 00000100:00100000:3.0:1787440424.251667:0:16298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee077ec1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ebeced4c-c181-4444-bfc2-6340445251d5+9:14438:x1874266681362560:12345-192.168.206.58@tcp:101:lfs.0 00010000:00010000:3.0:1787440424.251685:0:16298:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440424.251702:0:16298:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94e00/0x85f5fa77adf3d730 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fab14535dc625f9 expref: -99 pid: 16298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440424.251773:0:16298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94200/0x85f5fa77adf3d737 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440424.251787:0:16298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94200/0x85f5fa77adf3d737 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440424.251815:0:16298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94200/0x85f5fa77adf3d737 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440424.251830:0:16298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95200/0x85f5fa77adf3d73e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440424.251838:0:16298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95200/0x85f5fa77adf3d73e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440424.251845:0:16298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95200/0x85f5fa77adf3d73e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440424.252075:0:16298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94200/0x85f5fa77adf3d737 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440424.252083:0:16298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94200/0x85f5fa77adf3d737 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440424.252089:0:16298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94200/0x85f5fa77adf3d737 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440424.252095:0:16298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee049e94200 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:3.0:1787440424.252099:0:16298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94200/0x85f5fa77adf3d737 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440424.252107:0:16298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94200/0x85f5fa77adf3d737 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440424.252119:0:16298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ee050ca1800) 00010000:00010000:3.0:1787440424.252121:0:16298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440424.252125:0:16298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94200/0x85f5fa77adf3d737 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440424.252137:0:16298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94200/0x85f5fa77adf3d737 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440424.252148:0:16298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95200/0x85f5fa77adf3d73e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440424.252155:0:16298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95200/0x85f5fa77adf3d73e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440424.252160:0:16298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95200/0x85f5fa77adf3d73e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440424.252165:0:16298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee049e95200 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:3.0:1787440424.252168:0:16298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95200/0x85f5fa77adf3d73e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440424.252173:0:16298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95200/0x85f5fa77adf3d73e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440424.252181:0:16298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8ee050cada00) 00010000:00010000:3.0:1787440424.252183:0:16298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440424.252186:0:16298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95200/0x85f5fa77adf3d73e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440424.252191:0:16298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95200/0x85f5fa77adf3d73e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440424.252220:0:16298:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94e00/0x85f5fa77adf3d730 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc625f9 expref: 10 pid: 16298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440424.252247:0:16298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ee050ca1800) 00010000:00010000:3.0:1787440424.252250:0:16298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440424.252254:0:16298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94e00/0x85f5fa77adf3d730 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc625f9 expref: 10 pid: 16298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440424.252263:0:16298:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee049e94e00, rc 0) 00000100:00100000:3.0:1787440424.252327:0:16298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee077ec1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ebeced4c-c181-4444-bfc2-6340445251d5+9:14438:x1874266681362560:12345-192.168.206.58@tcp:101:lfs.0 Request processed in 663us (874us total) trans 0 rc 301/301 00000100:00100000:3.0:1787440424.252335:0:16298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 18 00000100:00100000:1.0:1787440424.256487:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440424.256654:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681362688 00000100:00100000:0.0:1787440424.256664:0:14374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681362688 00000100:00100000:0.0:1787440424.256716:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 0 00000100:00100000:0.0:1787440424.256726:0:14374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee079915f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:ebeced4c-c181-4444-bfc2-6340445251d5+9:14438:x1874266681362688:12345-192.168.206.58@tcp:700:lfs.0 00000100:00100000:0.0:1787440424.256817:0:14374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee079915f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:ebeced4c-c181-4444-bfc2-6340445251d5+9:14438:x1874266681362688:12345-192.168.206.58@tcp:700:lfs.0 Request processed in 92us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440424.256826:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 0 00000100:00100000:2.0:1787440424.260774:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440424.261901:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681362944 00000100:00100000:0.0:1787440424.261914:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681362944 00000100:00100000:0.0:1787440424.261977:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 19 00000100:00100000:0.0:1787440424.261987:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee077ec0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ebeced4c-c181-4444-bfc2-6340445251d5+9:14438:x1874266681362944:12345-192.168.206.58@tcp:36:lfs.0 00010000:00010000:0.0:1787440424.262039:0:14365:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787440424.262065:0:14365:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcec00/0x85f5fa77adf3d673 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62574 expref: 9 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440424.262084:0:14365:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ee050ca1800) 00010000:00010000:0.0:1787440424.262089:0:14365:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787440424.262364:0:14365:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce000/0x85f5fa77adf3d745 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14365 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440424.262378:0:14365:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95e00/0x85f5fa77adf3d6ab lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc625d6 expref: 5 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440424.262396:0:14365:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce000/0x85f5fa77adf3d745 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14365 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440424.262438:0:14365:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95e00/0x85f5fa77adf3d6ab lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc625d6 expref: 5 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440424.262452:0:14365:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95e00/0x85f5fa77adf3d6ab lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc625d6 expref: 5 pid: 14365 timeout: 622 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440424.262467:0:14365:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee06e6cf800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14365:1874266701277952:192.168.206.58@tcp:104: 00000100:00100000:0.0:1787440424.262954:0:14365:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee0776f9480 going to sleep for 11 seconds 00000100:00100000:2.0:1787440424.266665:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440424.266762:0:14365:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee06e6cf800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14365:1874266701277952:192.168.206.58@tcp:104: 00010000:00010000:0.0:1787440424.266792:0:14365:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce000/0x85f5fa77adf3d745 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14365 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440424.267000:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681363072 00000100:00100000:3.0:1787440424.267012:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681363072 00010000:00010000:3.0:1787440424.267061:0:14350:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95e00/0x85f5fa77adf3d6ab lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc625d6 expref: 6 pid: 14365 timeout: 622 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440424.267121:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 9 00000100:00100000:3.0:1787440424.267131:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee077ec3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:33ce6cea-c670-4f62-bfc5-6966392caf40+6:2363:x1874266681363072:12345-192.168.206.58@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787440424.267151:0:14350:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787440424.267159:0:14350:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95e00/0x85f5fa77adf3d6ab lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc625d6 expref: 6 pid: 14365 timeout: 622 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440424.267173:0:14350:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95e00/0x85f5fa77adf3d6ab lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc625d6 expref: 6 pid: 14365 timeout: 622 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440424.267202:0:14350:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95e00/0x85f5fa77adf3d6ab lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc625d6 expref: 6 pid: 14365 timeout: 622 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440424.267244:0:14350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ee050ca1800) 00010000:00010000:3.0:1787440424.267250:0:14350:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce000/0x85f5fa77adf3d745 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14365 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440424.267261:0:14350:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce000/0x85f5fa77adf3d745 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14365 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440424.267270:0:14350:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce000/0x85f5fa77adf3d745 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14365 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440424.267300:0:14350:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787440424.267369:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee077ec3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:33ce6cea-c670-4f62-bfc5-6966392caf40+5:2363:x1874266681363072:12345-192.168.206.58@tcp:103:ldlm_bl.0 Request processed in 239us (722us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440424.267388:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 9 00010000:00010000:0.0:1787440424.267529:0:14365:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce000/0x85f5fa77adf3d745 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14365 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440424.267542:0:14365:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce000/0x85f5fa77adf3d745 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14365 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440424.267582:0:14365:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce600/0x85f5fa77adf3d74c lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14365 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440424.267604:0:14365:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce600/0x85f5fa77adf3d74c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14365 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440424.267615:0:14365:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce600/0x85f5fa77adf3d74c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14365 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787440424.269025:0:14365:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:0.0:1787440424.269040:0:14365:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce000/0x85f5fa77adf3d745 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14365 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440424.269049:0:14365:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce000/0x85f5fa77adf3d745 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14365 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440424.269057:0:14365:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce000/0x85f5fa77adf3d745 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14365 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440424.269063:0:14365:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee04cbce000 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:0.0:1787440424.269067:0:14365:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce000/0x85f5fa77adf3d745 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14365 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440424.269074:0:14365:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce000/0x85f5fa77adf3d745 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14365 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440424.269088:0:14365:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ee050ca1800) 00010000:00010000:0.0:1787440424.269091:0:14365:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440424.269095:0:14365:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce000/0x85f5fa77adf3d745 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14365 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440424.269101:0:14365:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce000/0x85f5fa77adf3d745 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14365 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787440424.269120:0:14365:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009b731b70 reply state 00000000f51ad6ba transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce600/0x85f5fa77adf3d74c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14365 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440424.269129:0:14365:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787440424.269232:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee077ec0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ebeced4c-c181-4444-bfc2-6340445251d5+10:14438:x1874266681362944:12345-192.168.206.58@tcp:36:lfs.0 Request processed in 7243us (8463us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1787440424.269254:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 19 00010000:00010000:1.0:1787440424.271180:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce600/0x85f5fa77adf3d74c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14365 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440424.271207:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce600/0x85f5fa77adf3d74c lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14365 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440424.271221:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce600/0x85f5fa77adf3d74c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14365 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440424.271228:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee04cbce600 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:1.0:1787440424.271237:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce600/0x85f5fa77adf3d74c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14365 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440424.271246:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce600/0x85f5fa77adf3d74c lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14365 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440424.271276:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8ee050ca1c00) 00010000:00010000:1.0:1787440424.271280:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440424.271288:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce600/0x85f5fa77adf3d74c lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14365 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440424.271324:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce600/0x85f5fa77adf3d74c lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14365 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440424.362204:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:2.0:1787440424.362298:0:16298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681363200 00000100:00100000:2.0:1787440424.362328:0:16298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681363200 00000100:00100000:2.0:1787440424.362414:0:16298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 20 00000100:00100000:2.0:1787440424.362438:0:16298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee0776baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ebeced4c-c181-4444-bfc2-6340445251d5+9:14446:x1874266681363200:12345-192.168.206.58@tcp:101:lctl.0 00010000:00010000:2.0:1787440424.362479:0:16298:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440424.362556:0:16298:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8edf42bdf200/0x85f5fa77adf3d753 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fab14535dc62600 expref: -99 pid: 16298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440424.362638:0:16298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8edf42bde800/0x85f5fa77adf3d75a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440424.362655:0:16298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8edf42bde800/0x85f5fa77adf3d75a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440424.362669:0:16298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8edf42bde800/0x85f5fa77adf3d75a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16298 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787440424.362749:0:16298:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1787440424.362754:0:16298:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:2.0:1787440424.362804:0:16298:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8edf42bde800/0x85f5fa77adf3d75a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440424.362848:0:16298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8edf42bdf200/0x85f5fa77adf3d753 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62600 expref: 11 pid: 16298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440424.362870:0:16298:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8edf42bde800/0x85f5fa77adf3d75a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62600 expref: 10 pid: 16298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440424.362880:0:16298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ee054b3cd00) 00010000:00010000:2.0:1787440424.362884:0:16298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787440424.362889:0:16298:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8edf42bde800, rc 0) 00000100:00100000:2.0:1787440424.362973:0:16298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee0776baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ebeced4c-c181-4444-bfc2-6340445251d5+10:14446:x1874266681363200:12345-192.168.206.58@tcp:101:lctl.0 Request processed in 548us (781us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440424.363399:0:16298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 20 00000100:00100000:2.0:1787440424.393824:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440424.394444:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681363328 00000100:00100000:3.0:1787440424.394466:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681363328 00000100:00100000:3.0:1787440424.394617:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 21 00000100:00100000:3.0:1787440424.394628:0:14366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee077ec0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:33ce6cea-c670-4f62-bfc5-6966392caf40+5:14447:x1874266681363328:12345-192.168.206.58@tcp:101:lfs.0 00010000:00010000:3.0:1787440424.394655:0:14366:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440424.394682:0:14366:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95e00/0x85f5fa77adf3d761 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fab14535dc62607 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440424.394766:0:14366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94e00/0x85f5fa77adf3d768 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440424.394783:0:14366:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94e00/0x85f5fa77adf3d768 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440424.394818:0:14366:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94e00/0x85f5fa77adf3d768 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787440424.394897:0:14366:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787440424.394902:0:14366:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:3.0:1787440424.394934:0:14366:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94e00/0x85f5fa77adf3d768 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440424.394963:0:14366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95e00/0x85f5fa77adf3d761 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62607 expref: 7 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440424.394998:0:14366:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94e00/0x85f5fa77adf3d768 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62607 expref: 6 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440424.395008:0:14366:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ee054b3cd00) 00010000:00010000:3.0:1787440424.395012:0:14366:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787440424.395017:0:14366:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee049e94e00, rc 0) 00000100:00100000:3.0:1787440424.395108:0:14366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee077ec0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:33ce6cea-c670-4f62-bfc5-6966392caf40+6:14447:x1874266681363328:12345-192.168.206.58@tcp:101:lfs.0 Request processed in 481us (1298us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440424.395116:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 21 00000100:00100000:1.0:1787440424.399024:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440424.399151:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681363456 00000100:00100000:0.0:1787440424.399163:0:14367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681363456 00000100:00100000:0.0:1787440424.399254:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 22 00000100:00100000:0.0:1787440424.399266:0:14367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee079916680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:33ce6cea-c670-4f62-bfc5-6966392caf40+6:14447:x1874266681363456:12345-192.168.206.58@tcp:101:lfs.0 00010000:00010000:0.0:1787440424.399292:0:14367:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440424.399319:0:14367:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce000/0x85f5fa77adf3d76f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fab14535dc6260e expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440424.399416:0:14367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcec00/0x85f5fa77adf3d776 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440424.399453:0:14367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcec00/0x85f5fa77adf3d776 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440424.399468:0:14367:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcec00/0x85f5fa77adf3d776 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440424.399485:0:14367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce400/0x85f5fa77adf3d77d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440424.399535:0:14367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce400/0x85f5fa77adf3d77d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440424.399544:0:14367:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce400/0x85f5fa77adf3d77d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440424.399674:0:14367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce600/0x85f5fa77adf3d784 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440424.399702:0:14367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce600/0x85f5fa77adf3d784 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440424.399709:0:14367:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce600/0x85f5fa77adf3d784 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787440424.399756:0:14367:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:0.0:1787440424.399760:0:14367:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787440424.399786:0:14367:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce600/0x85f5fa77adf3d784 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440424.399800:0:14367:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcec00/0x85f5fa77adf3d776 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440424.399807:0:14367:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcec00/0x85f5fa77adf3d776 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440424.399814:0:14367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcec00/0x85f5fa77adf3d776 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440424.399820:0:14367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee04cbcec00 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:0.0:1787440424.399825:0:14367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcec00/0x85f5fa77adf3d776 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440424.399833:0:14367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcec00/0x85f5fa77adf3d776 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440424.399848:0:14367:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ee054b3cd00) 00010000:00010000:0.0:1787440424.399851:0:14367:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440424.399857:0:14367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcec00/0x85f5fa77adf3d776 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440424.399876:0:14367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcec00/0x85f5fa77adf3d776 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440424.399893:0:14367:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce400/0x85f5fa77adf3d77d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440424.399900:0:14367:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce400/0x85f5fa77adf3d77d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440424.399907:0:14367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce400/0x85f5fa77adf3d77d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440424.399912:0:14367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee04cbce400 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:0.0:1787440424.399915:0:14367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce400/0x85f5fa77adf3d77d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440424.399922:0:14367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce400/0x85f5fa77adf3d77d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440424.399931:0:14367:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8ee050ca1800) 00010000:00010000:0.0:1787440424.399934:0:14367:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440424.399937:0:14367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce400/0x85f5fa77adf3d77d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440424.399943:0:14367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce400/0x85f5fa77adf3d77d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440424.399982:0:14367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce000/0x85f5fa77adf3d76f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6260e expref: 8 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440424.400010:0:14367:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce600/0x85f5fa77adf3d784 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6260e expref: 7 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440424.400018:0:14367:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8ee050ca1100) 00010000:00010000:0.0:1787440424.400020:0:14367:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787440424.400022:0:14367:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee04cbce600, rc 0) 00000100:00100000:0.0:1787440424.400095:0:14367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee079916680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:33ce6cea-c670-4f62-bfc5-6966392caf40+7:14447:x1874266681363456:12345-192.168.206.58@tcp:101:lfs.0 Request processed in 831us (1083us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440424.400103:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 22 00000100:00100000:2.0:1787440424.410666:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440424.410946:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681363712 00000100:00100000:0.0:1787440424.410960:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681363712 00000100:00100000:0.0:1787440424.411081:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 23 00000100:00100000:0.0:1787440424.411092:0:14366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee077ec0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:33ce6cea-c670-4f62-bfc5-6966392caf40+7:14447:x1874266681363712:12345-192.168.206.58@tcp:101:lfs.0 00010000:00010000:0.0:1787440424.411132:0:14366:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440424.411160:0:14366:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf800/0x85f5fa77adf3d78b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fab14535dc62615 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787440424.411317:0:14366:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:0.0:1787440424.411528:0:14366:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf800/0x85f5fa77adf3d78b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62615 expref: 9 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440424.411546:0:14366:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ee054b3cd00) 00010000:00010000:0.0:1787440424.411550:0:14366:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787440424.411555:0:14366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf800/0x85f5fa77adf3d78b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62615 expref: 9 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440424.411591:0:14366:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee04cbcf800, rc 0) 00000100:00100000:0.0:1787440424.411664:0:14366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee077ec0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:33ce6cea-c670-4f62-bfc5-6966392caf40+8:14447:x1874266681363712:12345-192.168.206.58@tcp:101:lfs.0 Request processed in 573us (1011us total) trans 8589934595 rc 301/301 00000100:00100000:0.0:1787440424.411672:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 23 00000100:00100000:1.0:1787440424.414128:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440424.414223:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681363968 00000100:00100000:3.0:1787440424.414235:0:14367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681363968 00000100:00100000:3.0:1787440424.414299:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 24 00000100:00100000:3.0:1787440424.414308:0:14367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee079916a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:33ce6cea-c670-4f62-bfc5-6966392caf40+8:14447:x1874266681363968:12345-192.168.206.58@tcp:36:lfs.0 00010000:00010000:3.0:1787440424.414386:0:14367:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787440424.414417:0:14367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce600/0x85f5fa77adf3d784 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6260e expref: 8 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440424.414473:0:14367:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8ee050ca1100) 00010000:00010000:3.0:1787440424.414486:0:14367:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787440424.414547:0:14367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95e00/0x85f5fa77adf3d799 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440424.414562:0:14367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95e00/0x85f5fa77adf3d799 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440424.414575:0:14367:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95e00/0x85f5fa77adf3d799 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787440424.414860:0:14367:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006c18cf07 reply state 00000000377c2483 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95e00/0x85f5fa77adf3d799 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440424.414871:0:14367:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1787440424.414887:0:14367:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000100:00100000:3.0:1787440424.414994:0:14367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee079916a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:33ce6cea-c670-4f62-bfc5-6966392caf40+9:14447:x1874266681363968:12345-192.168.206.58@tcp:36:lfs.0 Request processed in 686us (886us total) trans 8589934596 rc 0/0 00000100:00100000:3.0:1787440424.415002:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 24 00000100:00100000:1.0:1787440424.419346:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440424.421554:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681364224 00000100:00100000:0.0:1787440424.421578:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681364224 00000100:00100000:0.0:1787440424.421662:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 2 00000100:00100000:0.0:1787440424.421675:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee079917b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:33ce6cea-c670-4f62-bfc5-6966392caf40+9:14447:x1874266681364224:12345-192.168.206.58@tcp:35:lfs.0 00010000:00010000:3.0:1787440424.421862:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95e00/0x85f5fa77adf3d799 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440424.421876:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95e00/0x85f5fa77adf3d799 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440424.421886:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95e00/0x85f5fa77adf3d799 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440424.421892:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee049e95e00 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:3.0:1787440424.421898:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95e00/0x85f5fa77adf3d799 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440424.421925:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95e00/0x85f5fa77adf3d799 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440424.421946:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8ee050cada00) 00010000:00010000:3.0:1787440424.421950:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:3.0:1787440424.421956:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95e00/0x85f5fa77adf3d799 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440424.421963:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95e00/0x85f5fa77adf3d799 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440424.422012:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee079917b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:33ce6cea-c670-4f62-bfc5-6966392caf40+9:14447:x1874266681364224:12345-192.168.206.58@tcp:35:lfs.0 Request processed in 340us (2680us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1787440424.422021:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 2 00000100:00100000:3.0:1787440424.425822:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:2.0:1787440424.425933:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681364480 00000100:00100000:2.0:1787440424.425947:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681364480 00000100:00100000:2.0:1787440424.426055:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 25 00000100:00100000:2.0:1787440424.426068:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee0776bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:33ce6cea-c670-4f62-bfc5-6966392caf40+9:14447:x1874266681364480:12345-192.168.206.58@tcp:101:lfs.0 00010000:00010000:2.0:1787440424.426103:0:14365:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440424.426144:0:14365:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8edf42bdf400/0x85f5fa77adf3d7a0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fab14535dc6261c expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440424.426242:0:14365:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8edf42bdee00/0x85f5fa77adf3d7a7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14365 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440424.426260:0:14365:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8edf42bdee00/0x85f5fa77adf3d7a7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14365 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440424.426274:0:14365:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8edf42bdee00/0x85f5fa77adf3d7a7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14365 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440424.426290:0:14365:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8edf42bde000/0x85f5fa77adf3d7ae lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14365 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440424.426297:0:14365:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8edf42bde000/0x85f5fa77adf3d7ae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14365 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440424.426303:0:14365:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8edf42bde000/0x85f5fa77adf3d7ae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14365 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787440424.426559:0:14365:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:2.0:1787440424.426677:0:14365:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8edf42bdee00/0x85f5fa77adf3d7a7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14365 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440424.426686:0:14365:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8edf42bdee00/0x85f5fa77adf3d7a7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14365 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440424.426693:0:14365:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8edf42bdee00/0x85f5fa77adf3d7a7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14365 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440424.426700:0:14365:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8edf42bdee00 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:2.0:1787440424.426704:0:14365:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8edf42bdee00/0x85f5fa77adf3d7a7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14365 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440424.426712:0:14365:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8edf42bdee00/0x85f5fa77adf3d7a7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14365 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440424.426727:0:14365:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ee054b3cd00) 00010000:00010000:2.0:1787440424.426730:0:14365:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440424.426735:0:14365:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8edf42bdee00/0x85f5fa77adf3d7a7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14365 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440424.426741:0:14365:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8edf42bdee00/0x85f5fa77adf3d7a7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14365 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440424.426757:0:14365:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8edf42bde000/0x85f5fa77adf3d7ae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14365 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440424.426766:0:14365:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8edf42bde000/0x85f5fa77adf3d7ae lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14365 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440424.426783:0:14365:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8edf42bde000/0x85f5fa77adf3d7ae lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14365 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440424.426788:0:14365:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8edf42bde000 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:2.0:1787440424.426791:0:14365:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8edf42bde000/0x85f5fa77adf3d7ae lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14365 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440424.426797:0:14365:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8edf42bde000/0x85f5fa77adf3d7ae lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14365 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440424.426804:0:14365:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8ee054b3c600) 00010000:00010000:2.0:1787440424.426806:0:14365:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440424.426810:0:14365:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8edf42bde000/0x85f5fa77adf3d7ae lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14365 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440424.426816:0:14365:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8edf42bde000/0x85f5fa77adf3d7ae lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14365 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440424.426862:0:14365:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8edf42bdf400/0x85f5fa77adf3d7a0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6261c expref: 11 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440424.426874:0:14365:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ee054b3cd00) 00010000:00010000:2.0:1787440424.426877:0:14365:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787440424.426881:0:14365:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8edf42bdf400/0x85f5fa77adf3d7a0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6261c expref: 11 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440424.426890:0:14365:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8edf42bdf400, rc 0) 00000100:00100000:2.0:1787440424.427228:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee0776bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:33ce6cea-c670-4f62-bfc5-6966392caf40+10:14447:x1874266681364480:12345-192.168.206.58@tcp:101:lfs.0 Request processed in 1160us (1416us total) trans 8589934598 rc 301/301 00000100:00100000:2.0:1787440424.427247:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 25 00000100:00100000:1.0:1787440424.432788:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440424.432895:0:16298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681364608 00000100:00100000:3.0:1787440424.432908:0:16298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681364608 00000100:00100000:3.0:1787440424.433013:0:16298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 26 00000100:00100000:3.0:1787440424.433024:0:16298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee079914000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:33ce6cea-c670-4f62-bfc5-6966392caf40+10:14447:x1874266681364608:12345-192.168.206.58@tcp:101:lfs.0 00010000:00010000:3.0:1787440424.433058:0:16298:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440424.433087:0:16298:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95200/0x85f5fa77adf3d7bc lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fab14535dc62623 expref: -99 pid: 16298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440424.433217:0:16298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94200/0x85f5fa77adf3d7c3 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440424.433234:0:16298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94200/0x85f5fa77adf3d7c3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440424.433247:0:16298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94200/0x85f5fa77adf3d7c3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16298 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787440424.433311:0:16298:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:3.0:1787440424.433335:0:16298:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787440424.433388:0:16298:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94200/0x85f5fa77adf3d7c3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440424.433423:0:16298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95200/0x85f5fa77adf3d7bc lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62623 expref: 12 pid: 16298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440424.433464:0:16298:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94200/0x85f5fa77adf3d7c3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62623 expref: 11 pid: 16298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440424.433474:0:16298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8ee050cade00) 00010000:00010000:3.0:1787440424.433477:0:16298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787440424.433481:0:16298:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee049e94200, rc 0) 00000100:00100000:3.0:1787440424.433782:0:16298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee079914000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:33ce6cea-c670-4f62-bfc5-6966392caf40+11:14447:x1874266681364608:12345-192.168.206.58@tcp:101:lfs.0 Request processed in 758us (1007us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440424.433791:0:16298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 26 00000100:00100000:1.0:1787440424.439049:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440424.439157:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681364736 00000100:00100000:0.0:1787440424.439169:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681364736 00000100:00100000:0.0:1787440424.439240:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 3 00000100:00100000:0.0:1787440424.439252:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee08032ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:33ce6cea-c670-4f62-bfc5-6966392caf40+11:14447:x1874266681364736:12345-192.168.206.58@tcp:37:lfs.0 00000100:00100000:1.0:1787440424.451276:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee08032ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:33ce6cea-c670-4f62-bfc5-6966392caf40+11:14447:x1874266681364736:12345-192.168.206.58@tcp:37:lfs.0 Request processed in 12011us (12225us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440424.451293:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 3 00000100:00100000:2.0:1787440424.458000:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440424.458095:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681364992 00000100:00100000:0.0:1787440424.458120:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681364992 00000100:00100000:0.0:1787440424.458192:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 4 00000100:00100000:0.0:1787440424.458205:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04caf2450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:33ce6cea-c670-4f62-bfc5-6966392caf40+11:14447:x1874266681364992:12345-192.168.206.58@tcp:35:lfs.0 00000100:00100000:0.0:1787440424.458590:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04caf2450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:33ce6cea-c670-4f62-bfc5-6966392caf40+12:14447:x1874266681364992:12345-192.168.206.58@tcp:35:lfs.0 Request processed in 385us (601us total) trans 8589934599 rc 0/0 00000100:00100000:0.0:1787440424.458599:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 4 00010000:00010000:0.0:1787440424.477741:0:14353:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787440424.513236:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440424.513417:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681365120 00000100:00100000:3.0:1787440424.513442:0:14367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681365120 00000100:00100000:3.0:1787440424.513586:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 27 00000100:00100000:3.0:1787440424.513598:0:14367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee077ec2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ebeced4c-c181-4444-bfc2-6340445251d5+10:14453:x1874266681365120:12345-192.168.206.58@tcp:101:bash.0 00010000:00010000:3.0:1787440424.513625:0:14367:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440424.513651:0:14367:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95200/0x85f5fa77adf3d7ca lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fab14535dc6262a expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440424.513744:0:14367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95e00/0x85f5fa77adf3d7d1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440424.513763:0:14367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95e00/0x85f5fa77adf3d7d1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440424.513798:0:14367:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95e00/0x85f5fa77adf3d7d1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440424.513822:0:14367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95000/0x85f5fa77adf3d7d8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440424.513830:0:14367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95000/0x85f5fa77adf3d7d8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440424.513837:0:14367:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95000/0x85f5fa77adf3d7d8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440424.513990:0:14367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95800/0x85f5fa77adf3d7df lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440424.514000:0:14367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95800/0x85f5fa77adf3d7df lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440424.514007:0:14367:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95800/0x85f5fa77adf3d7df lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787440424.514045:0:14367:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:3.0:1787440424.514049:0:14367:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787440424.514098:0:14367:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95800/0x85f5fa77adf3d7df lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440424.514127:0:14367:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95e00/0x85f5fa77adf3d7d1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440424.514134:0:14367:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95e00/0x85f5fa77adf3d7d1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440424.514153:0:14367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95e00/0x85f5fa77adf3d7d1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440424.514160:0:14367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee049e95e00 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:3.0:1787440424.514165:0:14367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95e00/0x85f5fa77adf3d7d1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440424.514174:0:14367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95e00/0x85f5fa77adf3d7d1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440424.514188:0:14367:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ee054b3cd00) 00010000:00010000:3.0:1787440424.514192:0:14367:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440424.514198:0:14367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95e00/0x85f5fa77adf3d7d1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440424.514205:0:14367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95e00/0x85f5fa77adf3d7d1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440424.514222:0:14367:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95000/0x85f5fa77adf3d7d8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440424.514229:0:14367:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95000/0x85f5fa77adf3d7d8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440424.514235:0:14367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95000/0x85f5fa77adf3d7d8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440424.514240:0:14367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee049e95000 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:3.0:1787440424.514243:0:14367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95000/0x85f5fa77adf3d7d8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440424.514260:0:14367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95000/0x85f5fa77adf3d7d8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440424.514271:0:14367:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8ee050cada00) 00010000:00010000:3.0:1787440424.514274:0:14367:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440424.514277:0:14367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95000/0x85f5fa77adf3d7d8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440424.514283:0:14367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95000/0x85f5fa77adf3d7d8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440424.514321:0:14367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95200/0x85f5fa77adf3d7ca lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6262a expref: 12 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440424.514336:0:14367:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95800/0x85f5fa77adf3d7df lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6262a expref: 11 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440424.514343:0:14367:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8ee050cade00) 00010000:00010000:3.0:1787440424.514345:0:14367:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1787440424.514348:0:14367:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee049e95800, rc 0) 00000100:00100000:3.0:1787440424.514443:0:14367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee077ec2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ebeced4c-c181-4444-bfc2-6340445251d5+11:14453:x1874266681365120:12345-192.168.206.58@tcp:101:bash.0 Request processed in 846us (1221us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440424.514452:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 27 00000100:00100000:1.0:1787440424.521242:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440424.522511:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681365376 00000100:00100000:3.0:1787440424.522530:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681365376 00000100:00100000:3.0:1787440424.522621:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 28 00000100:00100000:3.0:1787440424.522633:0:14366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee08032df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ebeced4c-c181-4444-bfc2-6340445251d5+11:14453:x1874266681365376:12345-192.168.206.58@tcp:101:bash.0 00010000:00010000:3.0:1787440424.522682:0:14366:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440424.522709:0:14366:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95c00/0x85f5fa77adf3d7e6 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fab14535dc62631 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440424.522880:0:14366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee041664e00/0x85f5fa77adf3d7ed lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440424.522897:0:14366:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94200/0x85f5fa77adf3d7c3 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62623 expref: 11 pid: 16298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440424.522907:0:14366:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee041664e00/0x85f5fa77adf3d7ed lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440424.522953:0:14366:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94200/0x85f5fa77adf3d7c3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62623 expref: 11 pid: 16298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440424.522969:0:14366:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94200/0x85f5fa77adf3d7c3 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62623 expref: 11 pid: 16298 timeout: 622 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440424.522985:0:14366:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee0776b8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14366:1874266701278080:192.168.206.58@tcp:104: 00000100:00100000:3.0:1787440424.523132:0:14366:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee0799f2a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787440424.526295:0:14366:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee0776b8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14366:1874266701278080:192.168.206.58@tcp:104: 00010000:00010000:3.0:1787440424.526334:0:14366:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ee041664e00/0x85f5fa77adf3d7ed lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440424.527723:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:2.0:1787440424.527994:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681365504 00000100:00100000:2.0:1787440424.528006:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681365504 00010000:00010000:2.0:1787440424.528058:0:14352:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94200/0x85f5fa77adf3d7c3 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62623 expref: 12 pid: 16298 timeout: 622 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440424.528114:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 10 00000100:00100000:2.0:1787440424.528126:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee08032ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:33ce6cea-c670-4f62-bfc5-6966392caf40+12:2363:x1874266681365504:12345-192.168.206.58@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787440424.528145:0:14352:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787440424.528152:0:14352:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94200/0x85f5fa77adf3d7c3 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62623 expref: 12 pid: 16298 timeout: 622 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440424.528166:0:14352:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94200/0x85f5fa77adf3d7c3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62623 expref: 12 pid: 16298 timeout: 622 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440424.528192:0:14352:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e94200/0x85f5fa77adf3d7c3 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62623 expref: 12 pid: 16298 timeout: 622 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440424.528211:0:14352:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8ee050cade00) 00010000:00010000:2.0:1787440424.528217:0:14352:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8ee041664e00/0x85f5fa77adf3d7ed lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440424.528228:0:14352:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee041664e00/0x85f5fa77adf3d7ed lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440424.528256:0:14352:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee041664e00/0x85f5fa77adf3d7ed lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440424.528355:0:14352:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787440424.528442:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee08032ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:33ce6cea-c670-4f62-bfc5-6966392caf40+11:2363:x1874266681365504:12345-192.168.206.58@tcp:103:ldlm_bl.0 Request processed in 318us (727us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440424.528451:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 10 00010000:00010000:0.0:1787440424.530794:0:14366:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ee041664e00/0x85f5fa77adf3d7ed lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440424.530839:0:14366:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee041664e00/0x85f5fa77adf3d7ed lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440424.530877:0:14366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce400/0x85f5fa77adf3d7f4 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440424.530893:0:14366:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce400/0x85f5fa77adf3d7f4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440424.530906:0:14366:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce400/0x85f5fa77adf3d7f4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440424.532832:0:14366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcec00/0x85f5fa77adf3d7fb lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440424.532857:0:14366:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcec00/0x85f5fa77adf3d7fb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440424.532871:0:14366:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcec00/0x85f5fa77adf3d7fb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787440424.532888:0:14366:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1787440424.532932:0:14366:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee041664e00/0x85f5fa77adf3d7ed lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440424.532940:0:14366:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee041664e00/0x85f5fa77adf3d7ed lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440424.532947:0:14366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee041664e00/0x85f5fa77adf3d7ed lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440424.532954:0:14366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee041664e00 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:0.0:1787440424.532973:0:14366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee041664e00/0x85f5fa77adf3d7ed lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440424.532982:0:14366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee041664e00/0x85f5fa77adf3d7ed lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440424.532997:0:14366:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8ee050cade00) 00010000:00010000:0.0:1787440424.533001:0:14366:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440424.533007:0:14366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee041664e00/0x85f5fa77adf3d7ed lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440424.533014:0:14366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee041664e00/0x85f5fa77adf3d7ed lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787440424.533035:0:14366:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000017e0d52 reply state 00000000ad10c005 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce400/0x85f5fa77adf3d7f4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440424.533046:0:14366:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787440424.533241:0:14366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee049e95c00/0x85f5fa77adf3d7e6 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62631 expref: 14 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440424.533259:0:14366:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcec00/0x85f5fa77adf3d7fb lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62631 expref: 13 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440424.533267:0:14366:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8ee050ca1500) 00010000:00010000:0.0:1787440424.533269:0:14366:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:0.0:1787440424.533272:0:14366:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee04cbcec00, rc 0) 00000100:00100000:0.0:1787440424.533469:0:14366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee08032df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ebeced4c-c181-4444-bfc2-6340445251d5+14:14453:x1874266681365376:12345-192.168.206.58@tcp:101:bash.0 Request processed in 10837us (12239us total) trans 8589934600 rc 0/0 00000100:00100000:0.0:1787440424.533479:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 28 00010000:00010000:2.0:1787440424.543653:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce400/0x85f5fa77adf3d7f4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440424.543676:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce400/0x85f5fa77adf3d7f4 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440424.543685:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce400/0x85f5fa77adf3d7f4 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440424.543692:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee04cbce400 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:2.0:1787440424.543698:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce400/0x85f5fa77adf3d7f4 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440424.543705:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce400/0x85f5fa77adf3d7f4 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440424.543727:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8ee050ca1800) 00010000:00010000:2.0:1787440424.543730:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440424.543736:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce400/0x85f5fa77adf3d7f4 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440424.543743:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce400/0x85f5fa77adf3d7f4 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440424.547305:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440424.547450:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681365632 00000100:00100000:0.0:1787440424.547462:0:14367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681365632 00000100:00100000:0.0:1787440424.547576:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 29 00000100:00100000:0.0:1787440424.547589:0:14367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee07f9f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ebeced4c-c181-4444-bfc2-6340445251d5+13:14453:x1874266681365632:12345-192.168.206.58@tcp:101:bash.0 00010000:00010000:0.0:1787440424.547620:0:14367:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440424.547645:0:14367:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfe00/0x85f5fa77adf3d809 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fab14535dc62638 expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440424.547733:0:14367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce800/0x85f5fa77adf3d810 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440424.547751:0:14367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce800/0x85f5fa77adf3d810 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440424.547765:0:14367:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce800/0x85f5fa77adf3d810 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787440424.547816:0:14367:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1787440424.547821:0:14367:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787440424.547845:0:14367:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce800/0x85f5fa77adf3d810 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440424.547859:0:14367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce800/0x85f5fa77adf3d810 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440424.547888:0:14367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfe00/0x85f5fa77adf3d809 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62638 expref: 15 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440424.547910:0:14367:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce800/0x85f5fa77adf3d810 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62638 expref: 14 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440424.547945:0:14367:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8ee050ca1500) 00010000:00010000:0.0:1787440424.547949:0:14367:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787440424.547953:0:14367:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee04cbce800, rc 0) 00000100:00100000:0.0:1787440424.548028:0:14367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee07f9f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ebeced4c-c181-4444-bfc2-6340445251d5+14:14453:x1874266681365632:12345-192.168.206.58@tcp:101:bash.0 Request processed in 441us (736us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440424.548036:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 29 00000100:00100000:1.0:1787440424.555324:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440424.555437:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681365888 00000100:00100000:0.0:1787440424.555449:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681365888 00000100:00100000:0.0:1787440424.555553:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 5 00000100:00100000:0.0:1787440424.555566:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee07f9f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ebeced4c-c181-4444-bfc2-6340445251d5+14:14453:x1874266681365888:12345-192.168.206.58@tcp:35:bash.0 00000100:00100000:0.0:1787440424.556008:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee07f9f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ebeced4c-c181-4444-bfc2-6340445251d5+15:14453:x1874266681365888:12345-192.168.206.58@tcp:35:bash.0 Request processed in 443us (696us total) trans 8589934601 rc 0/0 00000100:00100000:0.0:1787440424.556017:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 5 00000100:00100000:1.0:1787440424.680219:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440424.680337:0:16298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681366144 00000100:00100000:3.0:1787440424.680350:0:16298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681366144 00000100:00100000:3.0:1787440424.680444:0:16298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 30 00000100:00100000:3.0:1787440424.680474:0:16298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee07f9f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ebeced4c-c181-4444-bfc2-6340445251d5+15:14463:x1874266681366144:12345-192.168.206.58@tcp:101:lfs.0 00010000:00010000:3.0:1787440424.680548:0:16298:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440424.680574:0:16298:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee041664000/0x85f5fa77adf3d817 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fab14535dc6263f expref: -99 pid: 16298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787440424.680731:0:16298:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:3.0:1787440424.680885:0:16298:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee041664000/0x85f5fa77adf3d817 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6263f expref: 17 pid: 16298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440424.680903:0:16298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ee054b3cd00) 00010000:00010000:3.0:1787440424.680906:0:16298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787440424.680912:0:16298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee041664000/0x85f5fa77adf3d817 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6263f expref: 17 pid: 16298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440424.680931:0:16298:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee041664000, rc 0) 00000100:00100000:3.0:1787440424.681001:0:16298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee07f9f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ebeced4c-c181-4444-bfc2-6340445251d5+16:14463:x1874266681366144:12345-192.168.206.58@tcp:101:lfs.0 Request processed in 529us (796us total) trans 8589934602 rc 301/301 00000100:00100000:3.0:1787440424.681010:0:16298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 30 00000100:00100000:1.0:1787440424.697269:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440424.697401:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681366400 00000100:00100000:0.0:1787440424.697413:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681366400 00000100:00100000:0.0:1787440424.697552:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 6 00000100:00100000:0.0:1787440424.697563:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee07f9f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ebeced4c-c181-4444-bfc2-6340445251d5+16:14463:x1874266681366400:12345-192.168.206.58@tcp:35:lfs.0 00000100:00100000:0.0:1787440424.697888:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee07f9f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ebeced4c-c181-4444-bfc2-6340445251d5+17:14463:x1874266681366400:12345-192.168.206.58@tcp:35:lfs.0 Request processed in 325us (631us total) trans 8589934603 rc 0/0 00000100:00100000:0.0:1787440424.697897:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 6 00000100:00100000:1.0:1787440424.746058:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440424.746202:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681366656 00000100:00100000:0.0:1787440424.746215:0:14367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681366656 00000100:00100000:0.0:1787440424.746295:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 31 00000100:00100000:0.0:1787440424.746308:0:14367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee07f9f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ebeced4c-c181-4444-bfc2-6340445251d5+17:14466:x1874266681366656:12345-192.168.206.58@tcp:101:lfs.0 00010000:00010000:0.0:1787440424.746362:0:14367:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440424.746389:0:14367:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfe00/0x85f5fa77adf3d825 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fab14535dc62646 expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440424.746576:0:14367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf000/0x85f5fa77adf3d82c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440424.746595:0:14367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf000/0x85f5fa77adf3d82c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440424.746612:0:14367:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf000/0x85f5fa77adf3d82c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787440424.746625:0:14367:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1787440424.746798:0:14367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfe00/0x85f5fa77adf3d825 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62646 expref: 20 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440424.747026:0:14367:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf000/0x85f5fa77adf3d82c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62646 expref: 19 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440424.747038:0:14367:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8ee050ca1500) 00010000:00010000:0.0:1787440424.747042:0:14367:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787440424.747046:0:14367:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee04cbcf000, rc 0) 00000100:00100000:0.0:1787440424.747117:0:14367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee07f9f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ebeced4c-c181-4444-bfc2-6340445251d5+19:14466:x1874266681366656:12345-192.168.206.58@tcp:101:lfs.0 Request processed in 812us (1072us total) trans 8589934604 rc 0/0 00000100:00100000:0.0:1787440424.747126:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 31 00000100:00100000:1.0:1787440424.753960:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:1.0:1787440424.754016:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:2.0:1787440424.754464:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681366912 00000100:00100000:2.0:1787440424.754476:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681366912 00000100:00100000:2.0:1787440424.754597:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 0 00000100:00100000:2.0:1787440424.754609:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee07f9f3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ebeced4c-c181-4444-bfc2-6340445251d5+19:2361:x1874266681366912:12345-192.168.206.58@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787440424.754629:0:14351:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787440424.754663:0:14351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf000/0x85f5fa77adf3d82c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62646 expref: 19 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440424.754688:0:14351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8ee050ca1500) 00010000:00010000:2.0:1787440424.754694:0:14351:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787440424.754757:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee07f9f3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ebeced4c-c181-4444-bfc2-6340445251d5+18:2361:x1874266681366912:12345-192.168.206.58@tcp:103:ldlm_bl.0 Request processed in 150us (739us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440424.754766:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 0 00000100:00100000:3.0:1787440424.755351:0:16298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681366784 00000100:00100000:3.0:1787440424.755360:0:16298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681366784 00000100:00100000:3.0:1787440424.755408:0:16298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 32 00000100:00100000:3.0:1787440424.755417:0:16298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee07f9f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ebeced4c-c181-4444-bfc2-6340445251d5+18:14466:x1874266681366784:12345-192.168.206.58@tcp:54:lfs.0 00010000:00010000:3.0:1787440424.755529:0:16298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee041664000/0x85f5fa77adf3d83a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440424.755549:0:16298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee041664000/0x85f5fa77adf3d83a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440424.755585:0:16298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee041664000/0x85f5fa77adf3d83a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440424.755619:0:16298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee041664000/0x85f5fa77adf3d83a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440424.755627:0:16298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee041664000/0x85f5fa77adf3d83a lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440424.755634:0:16298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee041664000/0x85f5fa77adf3d83a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440424.755640:0:16298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee041664000 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:3.0:1787440424.755646:0:16298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee041664000/0x85f5fa77adf3d83a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440424.755654:0:16298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee041664000/0x85f5fa77adf3d83a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440424.755665:0:16298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8ee050ca1500) 00010000:00010000:3.0:1787440424.755668:0:16298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787440424.755672:0:16298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee041664000/0x85f5fa77adf3d83a lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440424.755679:0:16298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee041664000/0x85f5fa77adf3d83a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440424.755756:0:16298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee07f9f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ebeced4c-c181-4444-bfc2-6340445251d5+18:14466:x1874266681366784:12345-192.168.206.58@tcp:54:lfs.0 Request processed in 340us (1811us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440424.755763:0:16298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 32 00000100:00100000:1.0:1787440424.761634:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440424.761806:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681367168 00000100:00100000:0.0:1787440424.761836:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681367168 00000100:00100000:0.0:1787440424.761906:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 7 00000100:00100000:0.0:1787440424.761936:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee07f9f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ebeced4c-c181-4444-bfc2-6340445251d5+18:14466:x1874266681367168:12345-192.168.206.58@tcp:35:lfs.0 00000100:00100000:0.0:1787440424.762722:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee07f9f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ebeced4c-c181-4444-bfc2-6340445251d5+19:14466:x1874266681367168:12345-192.168.206.58@tcp:35:lfs.0 Request processed in 783us (1096us total) trans 8589934605 rc 0/0 00000100:00100000:0.0:1787440424.762733:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 7 00000040:00080000:3.0:1787440424.863527:0:14399:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1787440425.032885:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440425.033086:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681367424 00000100:00100000:0.0:1787440425.033100:0:14367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681367424 00000100:00080000:2.0:1787440425.033623:0:14361:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787440425.034242:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 33 00000100:00100000:3.0:1787440425.034265:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee050483480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ebeced4c-c181-4444-bfc2-6340445251d5+19:14497:x1874266681367424:12345-192.168.206.58@tcp:101:cat.0 00010000:00010000:3.0:1787440425.034300:0:14365:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440425.034329:0:14365:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee041664000/0x85f5fa77adf3d841 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fab14535dc6264d expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440425.034482:0:14365:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee041664400/0x85f5fa77adf3d848 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14365 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440425.035605:0:14365:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee041664400/0x85f5fa77adf3d848 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14365 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440425.035629:0:14365:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee041664400/0x85f5fa77adf3d848 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14365 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787440425.035654:0:14365:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1787440425.036097:0:14365:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee041664000/0x85f5fa77adf3d841 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6264d expref: 22 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440425.036123:0:14365:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee041664400/0x85f5fa77adf3d848 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6264d expref: 21 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440425.036134:0:14365:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8ee050ca1500) 00010000:00010000:3.0:1787440425.036137:0:14365:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787440425.036141:0:14365:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee041664400, rc 0) 00000100:00100000:3.0:1787440425.036312:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee050483480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ebeced4c-c181-4444-bfc2-6340445251d5+21:14497:x1874266681367424:12345-192.168.206.58@tcp:101:cat.0 Request processed in 2056us (3438us total) trans 8589934606 rc 0/0 00000100:00100000:3.0:1787440425.036321:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 33 00000100:00100000:1.0:1787440425.042022:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:2.0:1787440425.042135:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681367680 00000100:00100000:2.0:1787440425.042147:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681367680 00000100:00100000:2.0:1787440425.042225:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 8 00000100:00100000:2.0:1787440425.042237:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee050482300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ebeced4c-c181-4444-bfc2-6340445251d5+21:14497:x1874266681367680:12345-192.168.206.58@tcp:35:cat.0 00000100:00100000:2.0:1787440425.042712:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee050482300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ebeced4c-c181-4444-bfc2-6340445251d5+22:14497:x1874266681367680:12345-192.168.206.58@tcp:35:cat.0 Request processed in 475us (701us total) trans 8589934607 rc 0/0 00000100:00100000:2.0:1787440425.042721:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 8 00000100:00100000:1.0:1787440425.050153:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440425.050281:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681367808 00000100:00100000:3.0:1787440425.050304:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681367808 00000100:00100000:3.0:1787440425.050397:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 1 00000100:00100000:3.0:1787440425.050410:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee050483100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ebeced4c-c181-4444-bfc2-6340445251d5+22:2363:x1874266681367808:12345-192.168.206.58@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787440425.050442:0:14350:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787440425.050478:0:14350:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee041664400/0x85f5fa77adf3d848 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6264d expref: 22 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440425.050551:0:14350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8ee050ca1500) 00010000:00010000:3.0:1787440425.050558:0:14350:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787440425.050641:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee050483100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ebeced4c-c181-4444-bfc2-6340445251d5+21:2363:x1874266681367808:12345-192.168.206.58@tcp:103:ldlm_bl.0 Request processed in 233us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440425.050650:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 1 00000100:00100000:1.0:1787440425.116521:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440425.125044:0:16298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681368064 00000100:00100000:3.0:1787440425.125065:0:16298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681368064 00000100:00100000:2.0:1787440425.125402:0:16298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 34 00000100:00100000:2.0:1787440425.125419:0:16298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee050480e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ebeced4c-c181-4444-bfc2-6340445251d5+21:14503:x1874266681368064:12345-192.168.206.58@tcp:101:dd.0 00010000:00010000:2.0:1787440425.125464:0:16298:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440425.125530:0:16298:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8edf42bdfc00/0x85f5fa77adf3d856 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fab14535dc62654 expref: -99 pid: 16298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440425.125663:0:16298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8edf42bde200/0x85f5fa77adf3d85d lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440425.125681:0:16298:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcec00/0x85f5fa77adf3d7fb lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62631 expref: 22 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440425.125691:0:16298:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce800/0x85f5fa77adf3d810 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62638 expref: 22 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440425.125699:0:16298:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8edf42bde200/0x85f5fa77adf3d85d lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440425.125743:0:16298:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce800/0x85f5fa77adf3d810 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62638 expref: 22 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440425.125760:0:16298:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce800/0x85f5fa77adf3d810 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62638 expref: 22 pid: 14367 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440425.126023:0:16298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee077ec1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16298:1874266701278208:192.168.206.58@tcp:104: 00010000:00010000:2.0:1787440425.126184:0:16298:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcec00/0x85f5fa77adf3d7fb lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62631 expref: 22 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440425.126194:0:16298:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcec00/0x85f5fa77adf3d7fb lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62631 expref: 22 pid: 14366 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440425.126204:0:16298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee077ec0700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16298:1874266701278336:192.168.206.58@tcp:104: 00000100:00100000:2.0:1787440425.126446:0:16298:0:(client.c:2715:ptlrpc_set_wait()) set ffff8edf411073c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787440425.141629:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:2.0:1787440425.141673:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440425.141749:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681368192 00000100:00100000:0.0:1787440425.141766:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681368192 00010000:00010000:0.0:1787440425.141830:0:14352:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce800/0x85f5fa77adf3d810 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62638 expref: 23 pid: 14367 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440425.141877:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681368320 00000100:00100000:0.0:1787440425.141881:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681368320 00010000:00010000:0.0:1787440425.141896:0:14352:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcec00/0x85f5fa77adf3d7fb lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62631 expref: 24 pid: 14366 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440425.141913:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 11 00000100:00100000:0.0:1787440425.141923:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee07fb18c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ebeced4c-c181-4444-bfc2-6340445251d5+24:2362:x1874266681368192:12345-192.168.206.58@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787440425.141941:0:14352:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787440425.141948:0:14352:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce800/0x85f5fa77adf3d810 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62638 expref: 24 pid: 14367 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440425.141963:0:14352:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce800/0x85f5fa77adf3d810 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62638 expref: 24 pid: 14367 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440425.141989:0:14352:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8ee050ca1500) 00010000:00010000:0.0:1787440425.141995:0:14352:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8edf42bde200/0x85f5fa77adf3d85d lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440425.142035:0:14352:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8edf42bde200/0x85f5fa77adf3d85d lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440425.142042:0:14352:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787440425.142119:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee07fb18c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ebeced4c-c181-4444-bfc2-6340445251d5+24:2362:x1874266681368192:12345-192.168.206.58@tcp:103:ldlm_bl.0 Request processed in 194us (498us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440425.142130:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 11 00000100:00100000:3.0:1787440425.142131:0:14350:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1787440425.142144:0:14350:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:0.0:1787440425.142200:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 12 00000100:00100000:0.0:1787440425.142209:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee077ec3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ebeced4c-c181-4444-bfc2-6340445251d5+23:2363:x1874266681368320:12345-192.168.206.58@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787440425.142217:0:14352:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787440425.142222:0:14352:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcec00/0x85f5fa77adf3d7fb lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62631 expref: 23 pid: 14366 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440425.142231:0:14352:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcec00/0x85f5fa77adf3d7fb lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62631 expref: 23 pid: 14366 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440425.142243:0:14352:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8ee050ca1500) 00010000:00010000:0.0:1787440425.142246:0:14352:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8edf42bde200/0x85f5fa77adf3d85d lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440425.142254:0:14352:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8edf42bde200/0x85f5fa77adf3d85d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 16298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440425.142262:0:14352:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8edf42bde200/0x85f5fa77adf3d85d lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 16298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440425.142281:0:14352:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787440425.142301:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee077ec3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ebeced4c-c181-4444-bfc2-6340445251d5+23:2363:x1874266681368320:12345-192.168.206.58@tcp:103:ldlm_bl.0 Request processed in 94us (627us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440425.142314:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 12 00010000:00010000:0.0:1787440425.143195:0:16298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbce800/0x85f5fa77adf3d810 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62638 expref: 22 pid: 14367 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440425.143217:0:16298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee077ec1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16298:1874266701278208:192.168.206.58@tcp:104: 00010000:00010000:0.0:1787440425.143231:0:16298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcec00/0x85f5fa77adf3d7fb lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62631 expref: 21 pid: 14366 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440425.143240:0:16298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee077ec0700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16298:1874266701278336:192.168.206.58@tcp:104: 00010000:00010000:0.0:1787440425.143271:0:16298:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8edf42bde200/0x85f5fa77adf3d85d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440425.143282:0:16298:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8edf42bde200/0x85f5fa77adf3d85d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440425.143288:0:16298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8edf42bde200/0x85f5fa77adf3d85d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16298 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787440425.143316:0:16298:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1787440425.143619:0:16298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8edf42bdfc00/0x85f5fa77adf3d856 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62654 expref: 22 pid: 16298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440425.143637:0:16298:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8edf42bde200/0x85f5fa77adf3d85d lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62654 expref: 21 pid: 16298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440425.143646:0:16298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8ee050ca1500) 00010000:00010000:0.0:1787440425.143649:0:16298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787440425.143665:0:16298:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8edf42bde200, rc 0) 00000100:00100000:0.0:1787440425.143726:0:16298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee050480e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ebeced4c-c181-4444-bfc2-6340445251d5+21:14503:x1874266681368064:12345-192.168.206.58@tcp:101:dd.0 Request processed in 18313us (28727us total) trans 8589934608 rc 0/0 00000100:00100000:0.0:1787440425.143734:0:16298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 34 00000100:00100000:2.0:1787440425.152438:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440425.152864:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681368576 00000100:00100000:0.0:1787440425.152875:0:14367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681368576 00000100:00100000:0.0:1787440425.152932:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 35 00000100:00100000:0.0:1787440425.152942:0:14367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee077ec2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ebeced4c-c181-4444-bfc2-6340445251d5+21:14503:x1874266681368576:12345-192.168.206.58@tcp:36:dd.0 00010000:00010000:0.0:1787440425.155348:0:14367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcec00/0x85f5fa77adf3d86b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440425.155370:0:14367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcec00/0x85f5fa77adf3d86b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440425.155381:0:14367:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcec00/0x85f5fa77adf3d86b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787440425.155485:0:14367:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:0.0:1787440425.155943:0:14367:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e546aba8 reply state 00000000cbc5ff5b transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcec00/0x85f5fa77adf3d86b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440425.155953:0:14367:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787440425.156116:0:14367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee077ec2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ebeced4c-c181-4444-bfc2-6340445251d5+24:14503:x1874266681368576:12345-192.168.206.58@tcp:36:dd.0 Request processed in 3170us (3691us total) trans 8589934610 rc 0/0 00000100:00100000:0.0:1787440425.156135:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 35 00000020:00080000:0.0:1787440425.156140:0:14367:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787440425.161433:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcec00/0x85f5fa77adf3d86b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440425.161461:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcec00/0x85f5fa77adf3d86b lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440425.161476:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcec00/0x85f5fa77adf3d86b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440425.161484:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee04cbcec00 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:3.0:1787440425.161489:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcec00/0x85f5fa77adf3d86b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440425.161564:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcec00/0x85f5fa77adf3d86b lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440425.161581:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8ee050ca1500) 00010000:00010000:3.0:1787440425.161584:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440425.161589:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcec00/0x85f5fa77adf3d86b lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440425.161595:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcec00/0x85f5fa77adf3d86b lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440425.165153:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440425.165309:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681368704 00000100:00100000:0.0:1787440425.165319:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681368704 00000100:00100000:0.0:1787440425.165380:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 36 00000100:00100000:0.0:1787440425.165391:0:14366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee077ec0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ebeced4c-c181-4444-bfc2-6340445251d5+23:14503:x1874266681368704:12345-192.168.206.58@tcp:101:dd.0 00010000:00010000:0.0:1787440425.165437:0:14366:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440425.165458:0:14366:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfe00/0x85f5fa77adf3d872 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fab14535dc6265b expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440425.165569:0:14366:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfe00/0x85f5fa77adf3d872 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6265b expref: 24 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440425.165584:0:14366:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfe00/0x85f5fa77adf3d872 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6265b expref: 24 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440425.165604:0:14366:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8ee050ca1500) 00010000:00010000:0.0:1787440425.165608:0:14366:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787440425.165611:0:14366:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee04cbcfe00, rc 0) 00000100:00100000:0.0:1787440425.165661:0:14366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee077ec0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ebeced4c-c181-4444-bfc2-6340445251d5+24:14503:x1874266681368704:12345-192.168.206.58@tcp:101:dd.0 Request processed in 272us (517us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440425.165667:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 36 00000100:00100000:0.0:1787440425.190903:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:2.0:1787440425.191055:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681368960 00000100:00100000:2.0:1787440425.191064:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681368960 00000100:00100000:2.0:1787440425.191137:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 2 00000100:00100000:2.0:1787440425.191148:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee06e6cf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ebeced4c-c181-4444-bfc2-6340445251d5+24:14503:x1874266681368960:12345-192.168.206.58@tcp:103:dd.0 00010000:00010000:2.0:1787440425.191163:0:14352:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787440425.191186:0:14352:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfe00/0x85f5fa77adf3d872 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6265b expref: 24 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440425.191204:0:14352:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8ee050ca1500) 00010000:00010000:2.0:1787440425.191208:0:14352:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787440425.191262:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee06e6cf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ebeced4c-c181-4444-bfc2-6340445251d5+23:14503:x1874266681368960:12345-192.168.206.58@tcp:103:dd.0 Request processed in 117us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440425.191270:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 2 00000100:00100000:0.0:1787440425.201948:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440425.202068:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681369088 00000100:00100000:3.0:1787440425.202077:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681369088 00000100:00100000:3.0:1787440425.202288:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 37 00000100:00100000:3.0:1787440425.202299:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee06e6cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ebeced4c-c181-4444-bfc2-6340445251d5+23:14503:x1874266681369088:12345-192.168.206.58@tcp:58:dd.0 00010000:00010000:3.0:1787440425.202406:0:14365:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee041664400/0x85f5fa77adf3d879 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14365 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440425.202432:0:14365:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee041664400/0x85f5fa77adf3d879 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14365 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440425.202444:0:14365:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee041664400/0x85f5fa77adf3d879 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14365 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787440425.204006:0:14365:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787440425.204366:0:14365:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:3.0:1787440425.204454:0:14365:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:3.0:1787440425.204928:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee06e6cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ebeced4c-c181-4444-bfc2-6340445251d5+23:14503:x1874266681369088:12345-192.168.206.58@tcp:58:dd.0 Request processed in 2556us (2914us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440425.204939:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 37 00000100:00100000:1.0:1787440425.209690:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440425.209835:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681369216 00000100:00100000:0.0:1787440425.209847:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681369216 00000100:00100000:0.0:1787440425.209988:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 38 00000100:00100000:0.0:1787440425.210001:0:14366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee050482a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ebeced4c-c181-4444-bfc2-6340445251d5+23:14503:x1874266681369216:12345-192.168.206.58@tcp:101:dd.0 00010000:00010000:0.0:1787440425.210028:0:14366:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440425.210054:0:14366:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf200/0x85f5fa77adf3d880 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fab14535dc62662 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440425.210143:0:14366:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee041664400/0x85f5fa77adf3d879 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14365 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440425.210172:0:14366:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf200/0x85f5fa77adf3d880 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62662 expref: 24 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440425.210196:0:14366:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8ee041664400/0x85f5fa77adf3d879 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14365 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440425.210341:0:14366:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf200/0x85f5fa77adf3d880 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62662 expref: 24 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440425.210356:0:14366:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8ee050ca1500) 00010000:00010000:0.0:1787440425.210359:0:14366:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787440425.210363:0:14366:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf200/0x85f5fa77adf3d880 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62662 expref: 24 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440425.210382:0:14366:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee04cbcf200, rc 0) 00000100:00100000:0.0:1787440425.210474:0:14366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee050482a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ebeced4c-c181-4444-bfc2-6340445251d5+24:14503:x1874266681369216:12345-192.168.206.58@tcp:101:dd.0 Request processed in 476us (798us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440425.210483:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 38 00000100:00100000:0.0:1787440425.372994:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee077ec1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1874266701278464:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787440425.373091:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440425.375807:0:15052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701278464 00000100:00100000:3.0:1787440425.375831:0:15052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701278464 00000100:00100000:3.0:1787440425.375951:0:15052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787440425.375964:0:15052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee06e6cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874266701278464:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787440425.375965:0:14361:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:3.0:1787440425.376025:0:15052:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787440425.376142:0:15052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee06e6cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874266701278464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 182us (3049us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440425.376150:0:15052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787440425.376258:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee077ec1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1874266701278464:0@lo:13:osp-pre-0-0.0 00000001:00080000:3.0:1787440425.439040:0:5871:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934610 is committed 00000001:00080000:3.0:1787440425.439069:0:5871:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00010000:00010000:0.0:1787440425.500744:0:16029:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787440425.884776:0:14399:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1787440425.884787:0:14399:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787440425.884900:0:14399:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1787440425.884911:0:14399:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1787440425.885400:0:14399:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee0776b8a80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14399:1874266701278592:192.168.206.58@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787440425.885557:0:14399:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee0799f2240 going to sleep for 11 seconds 00000100:00100000:2.0:1787440425.891990:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:2.0:1787440425.892058:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681369344 00000100:00100000:2.0:1787440425.892066:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681369344 00000100:00100000:2.0:1787440425.892118:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 0 00000100:00100000:2.0:1787440425.892128:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee077ec3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:ebeced4c-c181-4444-bfc2-6340445251d5+12:14504:x1874266681369344:12345-192.168.206.58@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1787440425.892205:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee077ec3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:ebeced4c-c181-4444-bfc2-6340445251d5+12:14504:x1874266681369344:12345-192.168.206.58@tcp:900:lhsmtool_posix.0 Request processed in 78us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440425.892222:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 0 00000100:00100000:3.0:1787440425.892651:0:14399:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee0776b8a80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14399:1874266701278592:192.168.206.58@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787440425.897109:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440425.897544:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681369472 00000100:00100000:0.0:1787440425.897554:0:14367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681369472 00000100:00100000:0.0:1787440425.897613:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 39 00000100:00100000:0.0:1787440425.897623:0:14367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee0776b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ebeced4c-c181-4444-bfc2-6340445251d5+11:14504:x1874266681369472:12345-192.168.206.58@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787440425.897665:0:14367:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787440425.899114:0:14367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee0776b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ebeced4c-c181-4444-bfc2-6340445251d5+11:14504:x1874266681369472:12345-192.168.206.58@tcp:53:lhsmtool_posix.0 Request processed in 1485us (2015us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440425.899126:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 39 00000100:00100000:2.0:1787440425.917553:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440425.922437:0:16298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681369600 00000100:00100000:0.0:1787440425.922451:0:16298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681369600 00000100:00100000:2.0:1787440425.927777:0:16298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 40 00000100:00100000:2.0:1787440425.927792:0:16298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee077ec1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ebeced4c-c181-4444-bfc2-6340445251d5+11:14504:x1874266681369600:12345-192.168.206.58@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1787440425.927894:0:16298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8edf42bdf400/0x85f5fa77adf3d887 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440425.927912:0:16298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8edf42bdf400/0x85f5fa77adf3d887 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440425.927925:0:16298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8edf42bdf400/0x85f5fa77adf3d887 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440425.927943:0:16298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8edf42bdfa00/0x85f5fa77adf3d88e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440425.927951:0:16298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8edf42bdfa00/0x85f5fa77adf3d88e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440425.927957:0:16298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8edf42bdfa00/0x85f5fa77adf3d88e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440425.927976:0:16298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8edf42bdf200/0x85f5fa77adf3d895 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440425.927984:0:16298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8edf42bdf200/0x85f5fa77adf3d895 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440425.927990:0:16298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8edf42bdf200/0x85f5fa77adf3d895 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16298 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787440425.928041:0:16298:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1787440425.928045:0:16298:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787440425.928057:0:16298:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8edf42bdf200/0x85f5fa77adf3d895 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440425.928066:0:16298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8edf42bdf400/0x85f5fa77adf3d887 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440425.928072:0:16298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8edf42bdf400/0x85f5fa77adf3d887 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440425.928079:0:16298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8edf42bdf400/0x85f5fa77adf3d887 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440425.928084:0:16298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8edf42bdf400 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:2.0:1787440425.928088:0:16298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8edf42bdf400/0x85f5fa77adf3d887 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440425.928095:0:16298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8edf42bdf400/0x85f5fa77adf3d887 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440425.928106:0:16298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ee050cad200) 00010000:00010000:2.0:1787440425.928108:0:16298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440425.928112:0:16298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8edf42bdf400/0x85f5fa77adf3d887 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440425.928117:0:16298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8edf42bdf400/0x85f5fa77adf3d887 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440425.928129:0:16298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8edf42bdfa00/0x85f5fa77adf3d88e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440425.928143:0:16298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8edf42bdfa00/0x85f5fa77adf3d88e lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440425.928148:0:16298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8edf42bdfa00/0x85f5fa77adf3d88e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440425.928153:0:16298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8edf42bdfa00 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:2.0:1787440425.928156:0:16298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8edf42bdfa00/0x85f5fa77adf3d88e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440425.928161:0:16298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8edf42bdfa00/0x85f5fa77adf3d88e lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440425.928168:0:16298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff8ee054b3cf00) 00010000:00010000:2.0:1787440425.928171:0:16298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440425.928173:0:16298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8edf42bdfa00/0x85f5fa77adf3d88e lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440425.928178:0:16298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8edf42bdfa00/0x85f5fa77adf3d88e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440425.928191:0:16298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8edf42bdf200/0x85f5fa77adf3d895 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440425.928196:0:16298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8edf42bdf200/0x85f5fa77adf3d895 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440425.928216:0:16298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8edf42bdf200/0x85f5fa77adf3d895 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440425.928221:0:16298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8edf42bdf200 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:2.0:1787440425.928241:0:16298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8edf42bdf200/0x85f5fa77adf3d895 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440425.928254:0:16298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8edf42bdf200/0x85f5fa77adf3d895 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440425.928264:0:16298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8ee050ca1500) 00010000:00010000:2.0:1787440425.928266:0:16298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440425.928269:0:16298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8edf42bdf200/0x85f5fa77adf3d895 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440425.928274:0:16298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8edf42bdf200/0x85f5fa77adf3d895 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440425.928379:0:16298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee077ec1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ebeced4c-c181-4444-bfc2-6340445251d5+11:14504:x1874266681369600:12345-192.168.206.58@tcp:34:lhsmtool_posix.0 Request processed in 589us (10832us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440425.928387:0:16298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 40 00000100:00100000:2.0:1787440425.933169:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440425.933409:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681369856 00000100:00100000:3.0:1787440425.933427:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681369856 00000100:00100000:3.0:1787440425.933484:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 41 00000100:00100000:3.0:1787440425.933958:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee077f40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ebeced4c-c181-4444-bfc2-6340445251d5+11:14504:x1874266681369856:12345-192.168.206.58@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787440425.933985:0:14365:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440425.934010:0:14365:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee041664000/0x85f5fa77adf3d89c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fab14535dc62669 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440425.934110:0:14365:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee041665c00/0x85f5fa77adf3d8a3 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14365 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440425.934137:0:14365:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee041665c00/0x85f5fa77adf3d8a3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14365 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440425.934148:0:14365:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee041665c00/0x85f5fa77adf3d8a3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14365 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787440425.934160:0:14365:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1787440425.934973:0:14365:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee041665c00/0x85f5fa77adf3d8a3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14365 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440425.934985:0:14365:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee041665c00/0x85f5fa77adf3d8a3 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14365 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440425.934992:0:14365:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee041665c00/0x85f5fa77adf3d8a3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14365 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440425.934997:0:14365:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee041665c00 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:3.0:1787440425.935001:0:14365:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee041665c00/0x85f5fa77adf3d8a3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14365 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440425.935007:0:14365:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee041665c00/0x85f5fa77adf3d8a3 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14365 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440425.935020:0:14365:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8ee050ca1500) 00010000:00010000:3.0:1787440425.935023:0:14365:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787440425.935027:0:14365:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee041665c00/0x85f5fa77adf3d8a3 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14365 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440425.935033:0:14365:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee041665c00/0x85f5fa77adf3d8a3 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14365 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440425.935082:0:14365:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee041664000/0x85f5fa77adf3d89c lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62669 expref: 13 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440425.935102:0:14365:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ee050cad200) 00010000:00010000:3.0:1787440425.935105:0:14365:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787440425.935110:0:14365:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee041664000/0x85f5fa77adf3d89c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62669 expref: 13 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440425.935119:0:14365:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee041664000, rc 0) 00000100:00100000:3.0:1787440425.935204:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee077f40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ebeced4c-c181-4444-bfc2-6340445251d5+12:14504:x1874266681369856:12345-192.168.206.58@tcp:101:lhsmtool_posix.0 Request processed in 1703us (2035us total) trans 8589934611 rc 301/301 00000100:00100000:3.0:1787440425.935213:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 41 00000100:00100000:0.0:1787440425.942953:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:1.0:1787440425.954023:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681369984 00000100:00100000:1.0:1787440425.954052:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681369984 00000100:00100000:1.0:1787440425.954115:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 42 00000100:00100000:1.0:1787440425.954130:0:14366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee06e6cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ebeced4c-c181-4444-bfc2-6340445251d5+12:14504:x1874266681369984:12345-192.168.206.58@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787440425.954169:0:14366:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787440425.954299:0:14366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee06e6cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ebeced4c-c181-4444-bfc2-6340445251d5+12:14504:x1874266681369984:12345-192.168.206.58@tcp:53:lhsmtool_posix.0 Request processed in 170us (11355us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440425.954307:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 42 00000100:00100000:2.0:1787440425.959928:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440425.960021:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681370240 00000100:00100000:0.0:1787440425.960031:0:14367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681370240 00000100:00100000:0.0:1787440425.960089:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 43 00000100:00100000:0.0:1787440425.960100:0:14367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee077f41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ebeced4c-c181-4444-bfc2-6340445251d5+12:14504:x1874266681370240:12345-192.168.206.58@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787440425.960121:0:14367:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440425.960143:0:14367:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfa00/0x85f5fa77adf3d8b1 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fab14535dc62670 expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787440425.961237:0:14367:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000400:0x7:0x0], count =27 00000004:00080000:0.0:1787440425.961246:0:14367:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000400:0x7:0x0]+27 in llog 00000004:00080000:0.0:1787440425.961293:0:14367:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x22:0x0], index 1: 0 00010000:00010000:1.0:1787440425.968178:0:14367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9ee00/0x85f5fa77adf3d8b8 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440425.968343:0:14367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9ee00/0x85f5fa77adf3d8b8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440425.968358:0:14367:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9ee00/0x85f5fa77adf3d8b8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440425.968443:0:14367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfa00/0x85f5fa77adf3d8b1 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62670 expref: 15 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440425.968464:0:14367:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9ee00/0x85f5fa77adf3d8b8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62670 expref: 14 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440425.968473:0:14367:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8ee05132ef00) 00010000:00010000:1.0:1787440425.968476:0:14367:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787440425.968479:0:14367:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee07fb9ee00, rc 0) 00000100:00100000:1.0:1787440425.969076:0:14367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee077f41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ebeced4c-c181-4444-bfc2-6340445251d5+14:14504:x1874266681370240:12345-192.168.206.58@tcp:101:lhsmtool_posix.0 Request processed in 8975us (9154us total) trans 8589934612 rc 0/0 00000100:00100000:1.0:1787440425.969086:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 43 00000100:00100000:3.0:1787440425.985694:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:1.0:1787440425.987010:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681370496 00000100:00100000:1.0:1787440425.987024:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681370496 00000100:00100000:1.0:1787440425.987095:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 44 00000100:00100000:1.0:1787440425.987115:0:14366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee0776b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ebeced4c-c181-4444-bfc2-6340445251d5+14:14504:x1874266681370496:12345-192.168.206.58@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787440425.987173:0:14366:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787440425.987198:0:14366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9ee00/0x85f5fa77adf3d8b8 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62670 expref: 14 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440425.987219:0:14366:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8ee05132ef00) 00010000:00010000:1.0:1787440425.987229:0:14366:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787440425.987250:0:14366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9ec00/0x85f5fa77adf3d8c6 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440425.987264:0:14366:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9ec00/0x85f5fa77adf3d8c6 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440425.987274:0:14366:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9ec00/0x85f5fa77adf3d8c6 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440425.987288:0:14366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fa00/0x85f5fa77adf3d8cd lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xfdc9ec0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440425.987295:0:14366:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fa00/0x85f5fa77adf3d8cd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xfdc9ec0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440425.987302:0:14366:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fa00/0x85f5fa77adf3d8cd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xfdc9ec0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440425.988298:0:14366:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9ec00/0x85f5fa77adf3d8c6 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440425.988323:0:14366:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9ec00/0x85f5fa77adf3d8c6 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440425.988329:0:14366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9ec00/0x85f5fa77adf3d8c6 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440425.988335:0:14366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee07fb9ec00 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:1.0:1787440425.988340:0:14366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9ec00/0x85f5fa77adf3d8c6 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440425.988348:0:14366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9ec00/0x85f5fa77adf3d8c6 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440425.988372:0:14366:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8ee050cade00) 00010000:00010000:1.0:1787440425.988375:0:14366:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440425.988380:0:14366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9ec00/0x85f5fa77adf3d8c6 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440425.988385:0:14366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9ec00/0x85f5fa77adf3d8c6 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440425.988398:0:14366:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fa00/0x85f5fa77adf3d8cd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xfdc9ec0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440425.988404:0:14366:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fa00/0x85f5fa77adf3d8cd lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xfdc9ec0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440425.988410:0:14366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fa00/0x85f5fa77adf3d8cd lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xfdc9ec0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440425.988415:0:14366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee07fb9fa00 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:1.0:1787440425.988435:0:14366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fa00/0x85f5fa77adf3d8cd lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xfdc9ec0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440425.988442:0:14366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fa00/0x85f5fa77adf3d8cd lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xfdc9ec0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440425.988459:0:14366:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xfdc9ec0 (ffff8ee05132ea00) 00010000:00010000:1.0:1787440425.988462:0:14366:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440425.988465:0:14366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fa00/0x85f5fa77adf3d8cd lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xfdc9ec0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440425.988470:0:14366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9fa00/0x85f5fa77adf3d8cd lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xfdc9ec0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440425.991341:0:14366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee0776b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ebeced4c-c181-4444-bfc2-6340445251d5+13:14504:x1874266681370496:12345-192.168.206.58@tcp:36:lhsmtool_posix.0 Request processed in 4217us (5647us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787440425.991354:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 44 00000100:00100000:0.0:1787440426.002321:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440426.002413:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681370624 00000100:00100000:3.0:1787440426.002433:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681370624 00000100:00100000:3.0:1787440426.002486:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 45 00000100:00100000:3.0:1787440426.002523:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee06e6cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ebeced4c-c181-4444-bfc2-6340445251d5+13:14504:x1874266681370624:12345-192.168.206.58@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787440426.002544:0:14365:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440426.002564:0:14365:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee041665e00/0x85f5fa77adf3d8d4 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fab14535dc62677 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440426.002596:0:14365:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee041664000/0x85f5fa77adf3d8db lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14365 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440426.002609:0:14365:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee041664000/0x85f5fa77adf3d8db lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14365 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440426.002619:0:14365:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee041664000/0x85f5fa77adf3d8db lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14365 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440426.002734:0:14365:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee041665e00/0x85f5fa77adf3d8d4 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62677 expref: 15 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440426.002748:0:14365:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee041664000/0x85f5fa77adf3d8db lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62677 expref: 14 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440426.002753:0:14365:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8ee050cada00) 00010000:00010000:3.0:1787440426.002756:0:14365:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787440426.002758:0:14365:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee041664000, rc 0) 00000100:00100000:3.0:1787440426.002801:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee06e6cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ebeced4c-c181-4444-bfc2-6340445251d5+14:14504:x1874266681370624:12345-192.168.206.58@tcp:101:lhsmtool_posix.0 Request processed in 308us (491us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440426.002806:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 45 00000100:00100000:1.0:1787440426.009085:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440426.009665:0:16298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681370880 00000100:00100000:0.0:1787440426.009674:0:16298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681370880 00000100:00100000:0.0:1787440426.009724:0:16298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 46 00000100:00100000:0.0:1787440426.009732:0:16298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee050481180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ebeced4c-c181-4444-bfc2-6340445251d5+14:14504:x1874266681370880:12345-192.168.206.58@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787440426.009800:0:16298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfe00/0x85f5fa77adf3d8e2 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440426.009812:0:16298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfe00/0x85f5fa77adf3d8e2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440426.009835:0:16298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfe00/0x85f5fa77adf3d8e2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16298 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787440426.010224:0:16298:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:0.0:1787440426.010235:0:16298:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 524380742134ns, next at 525380739498ns, rc = 0 00000004:00010000:0.0:1787440426.010315:0:16298:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000dc874497 reply state 00000000644d51f0 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfe00/0x85f5fa77adf3d8e2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440426.010325:0:16298:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787440426.010438:0:16298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee050481180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ebeced4c-c181-4444-bfc2-6340445251d5+16:14504:x1874266681370880:12345-192.168.206.58@tcp:36:lhsmtool_posix.0 Request processed in 705us (1361us total) trans 8589934613 rc 0/0 00000100:00100000:0.0:1787440426.010445:0:16298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 46 00010000:00010000:1.0:1787440426.013615:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfe00/0x85f5fa77adf3d8e2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440426.013640:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfe00/0x85f5fa77adf3d8e2 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440426.013647:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfe00/0x85f5fa77adf3d8e2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440426.013653:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee04cbcfe00 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:1.0:1787440426.013658:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfe00/0x85f5fa77adf3d8e2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440426.013666:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfe00/0x85f5fa77adf3d8e2 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440426.013690:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8ee050cada00) 00010000:00010000:1.0:1787440426.013706:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787440426.013711:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfe00/0x85f5fa77adf3d8e2 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440426.013717:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfe00/0x85f5fa77adf3d8e2 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440426.016592:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440426.016646:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681371008 00000100:00100000:3.0:1787440426.016655:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681371008 00000100:00100000:3.0:1787440426.016711:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 47 00000100:00100000:3.0:1787440426.016720:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee050480a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ebeced4c-c181-4444-bfc2-6340445251d5+15:14504:x1874266681371008:12345-192.168.206.58@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787440426.016743:0:14365:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440426.016763:0:14365:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee041665e00/0x85f5fa77adf3d8e9 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fab14535dc6267e expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440426.016831:0:14365:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee041665e00/0x85f5fa77adf3d8e9 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6267e expref: 16 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440426.016846:0:14365:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee041665e00/0x85f5fa77adf3d8e9 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6267e expref: 16 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440426.016884:0:14365:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8ee050cada00) 00010000:00010000:3.0:1787440426.016888:0:14365:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787440426.016892:0:14365:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee041665e00, rc 0) 00000100:00100000:3.0:1787440426.017107:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee050480a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ebeced4c-c181-4444-bfc2-6340445251d5+16:14504:x1874266681371008:12345-192.168.206.58@tcp:101:lhsmtool_posix.0 Request processed in 387us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440426.017114:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 47 00000100:00100000:2.0:1787440426.022302:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440426.022432:0:15049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681371136 00000100:00100000:0.0:1787440426.022442:0:15049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681371136 00000100:00100000:0.0:1787440426.023292:0:15049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 12 00000100:00100000:0.0:1787440426.023306:0:15049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee077f40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ebeced4c-c181-4444-bfc2-6340445251d5+5:2360:x1874266681371136:12345-192.168.206.58@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1787440426.024119:0:15049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee077f40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ebeced4c-c181-4444-bfc2-6340445251d5+6:2360:x1874266681371136:12345-192.168.206.58@tcp:2:lhsmtool_posix.0 Request processed in 813us (1822us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1787440426.024129:0:15049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 12 00000100:00080000:2.0:1787440426.024311:0:14361:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787440426.026891:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:2.0:1787440426.027039:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681371392 00000100:00100000:2.0:1787440426.027048:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681371392 00000100:00100000:2.0:1787440426.027105:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 9 00000100:00100000:2.0:1787440426.027116:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee06e6cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ebeced4c-c181-4444-bfc2-6340445251d5+16:14504:x1874266681371392:12345-192.168.206.58@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787440426.027332:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee06e6cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ebeced4c-c181-4444-bfc2-6340445251d5+17:14504:x1874266681371392:12345-192.168.206.58@tcp:35:lhsmtool_posix.0 Request processed in 217us (449us total) trans 8589934614 rc 0/0 00000100:00100000:2.0:1787440426.027352:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 9 00000100:00100000:3.0:1787440426.030357:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:2.0:1787440426.030529:0:16298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681371648 00000100:00100000:2.0:1787440426.030538:0:16298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681371648 00000100:00100000:2.0:1787440426.030763:0:16298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 48 00000100:00100000:2.0:1787440426.030773:0:16298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee0776b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ebeced4c-c181-4444-bfc2-6340445251d5+17:14504:x1874266681371648:12345-192.168.206.58@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787440426.030882:0:16298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee0776b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ebeced4c-c181-4444-bfc2-6340445251d5+17:14504:x1874266681371648:12345-192.168.206.58@tcp:57:lhsmtool_posix.0 Request processed in 110us (534us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440426.030890:0:16298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 48 00000100:00100000:0.0:1787440426.034941:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440426.036530:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681371776 00000100:00100000:3.0:1787440426.036543:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681371776 00000100:00100000:3.0:1787440426.036716:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 49 00000100:00100000:3.0:1787440426.036726:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee06e6cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ebeced4c-c181-4444-bfc2-6340445251d5+17:14504:x1874266681371776:12345-192.168.206.58@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787440426.036754:0:14365:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440426.036773:0:14365:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee041665c00/0x85f5fa77adf3d8f0 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fab14535dc62685 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440426.036836:0:14365:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee041665400/0x85f5fa77adf3d8f7 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14365 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440426.036849:0:14365:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee041665400/0x85f5fa77adf3d8f7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14365 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440426.036867:0:14365:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee041665400/0x85f5fa77adf3d8f7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14365 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787440426.036900:0:14365:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787440426.036917:0:14365:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ee041665400/0x85f5fa77adf3d8f7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14365 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440426.036959:0:14365:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee041665c00/0x85f5fa77adf3d8f0 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62685 expref: 19 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440426.036976:0:14365:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee041665400/0x85f5fa77adf3d8f7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62685 expref: 18 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440426.036985:0:14365:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8ee050cada00) 00010000:00010000:3.0:1787440426.036988:0:14365:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787440426.036991:0:14365:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee041665400, rc 0) 00000100:00100000:3.0:1787440426.037045:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee06e6cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ebeced4c-c181-4444-bfc2-6340445251d5+18:14504:x1874266681371776:12345-192.168.206.58@tcp:101:lhsmtool_posix.0 Request processed in 321us (2113us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440426.037051:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 49 00000100:00100000:0.0:1787440426.041100:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:2.0:1787440426.041339:0:16356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681371904 00000100:00100000:2.0:1787440426.041348:0:16356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681371904 00000100:00100000:2.0:1787440426.041402:0:16356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 13 00000100:00100000:2.0:1787440426.041411:0:16356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee06e6cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ebeced4c-c181-4444-bfc2-6340445251d5+6:2360:x1874266681371904:12345-192.168.206.58@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787440426.041438:0:16356:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440426.041456:0:16356:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000e882872/0x85f5fa77adf3d8fe lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5fab14535dc6268c expref: -99 pid: 16356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787440426.041480:0:16356:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8a2d2a, blocks: 0x1 00010000:00010000:2.0:1787440426.041527:0:16356:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=524s v=(0 0) 00010000:00010000:2.0:1787440426.041532:0:16356:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787440426.041541:0:16356:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000e882872/0x85f5fa77adf3d8fe lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6268c expref: 7 pid: 16356 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440426.041558:0:16356:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000e882872/0x85f5fa77adf3d8fe lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6268c expref: 7 pid: 16356 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440426.041586:0:16356:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8edf42bdfa00, rc 0) 00000100:00100000:2.0:1787440426.041634:0:16356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee06e6cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ebeced4c-c181-4444-bfc2-6340445251d5+7:2360:x1874266681371904:12345-192.168.206.58@tcp:101:lhsmtool_posix.0 Request processed in 224us (543us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440426.041642:0:16356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 13 00000100:00100000:0.0:1787440426.046929:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440426.046998:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681372160 00000100:00100000:3.0:1787440426.047102:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681372160 00000100:00100000:3.0:1787440426.047163:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 50 00000100:00100000:3.0:1787440426.047174:0:14366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee06e6cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ebeced4c-c181-4444-bfc2-6340445251d5+18:14504:x1874266681372160:12345-192.168.206.58@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787440426.047330:0:14366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee06e6cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ebeced4c-c181-4444-bfc2-6340445251d5+18:14504:x1874266681372160:12345-192.168.206.58@tcp:57:lhsmtool_posix.0 Request processed in 157us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440426.047338:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 50 00000100:00100000:0.0:1787440426.053958:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:2.0:1787440426.054055:0:16298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681372288 00000100:00100000:2.0:1787440426.054064:0:16298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681372288 00000100:00100000:2.0:1787440426.054125:0:16298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 51 00000100:00100000:2.0:1787440426.054135:0:16298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee06e6cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ebeced4c-c181-4444-bfc2-6340445251d5+18:14504:x1874266681372288:12345-192.168.206.58@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1787440426.094531:0:5871:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934613 is committed 00000004:00080000:1.0:1787440426.094546:0:5871:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:1.0:1787440426.094570:0:5871:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000100:00100000:1.0:1787440426.094744:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee077f43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874266701278720:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1787440426.094815:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440426.095030:0:15051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701278720 00000100:00100000:1.0:1787440426.095036:0:15051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701278720 00000100:00100000:1.0:1787440426.095143:0:15051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787440426.095152:0:15051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee050481f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1874266701278720:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1787440426.095296:0:15051:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1787440426.095300:0:15051:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1787440426.095302:0:15051:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1787440426.095304:0:15051:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1787440426 -> 1787440426 00002000:00010000:1.0:1787440426.095306:0:15051:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1787440426.095352:0:15051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee050481f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3311:x1874266701278720:12345-0@lo:2:osp-syn-1-0.0 Request processed in 201us (535us total) trans 8589934595 rc 0/0 00000100:00100000:1.0:1787440426.095359:0:15051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787440426.095649:0:16298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee06e6cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ebeced4c-c181-4444-bfc2-6340445251d5+14:14504:x1874266681372288:12345-192.168.206.58@tcp:44:lhsmtool_posix.0 Request processed in 41513us (41695us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440426.095674:0:16298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 51 00000100:00080000:2.0:1787440426.096378:0:14361:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787440426.098617:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:2.0:1787440426.098700:0:16356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681372416 00000100:00100000:2.0:1787440426.098710:0:16356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681372416 00000100:00100000:2.0:1787440426.098762:0:16356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 15 00000100:00100000:2.0:1787440426.098773:0:16356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee06e6cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ebeced4c-c181-4444-bfc2-6340445251d5+7:2362:x1874266681372416:12345-192.168.206.58@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1787440426.098900:0:16356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee06e6cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ebeced4c-c181-4444-bfc2-6340445251d5+7:2362:x1874266681372416:12345-192.168.206.58@tcp:16:lhsmtool_posix.0 Request processed in 128us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440426.098908:0:16356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 15 00000004:00080000:1.0:1787440426.099548:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8ee077f43800/2, rc 0, transno 8589934595 00000100:00100000:1.0:1787440426.099558:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee077f43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874266701278720:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1787440426.102188:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:2.0:1787440426.102571:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681372672 00000100:00100000:2.0:1787440426.102581:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681372672 00000100:00100000:2.0:1787440426.102675:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 52 00000100:00100000:2.0:1787440426.102685:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee0776ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ebeced4c-c181-4444-bfc2-6340445251d5+14:14504:x1874266681372672:12345-192.168.206.58@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787440426.102733:0:14365:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787440426.102760:0:14365:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee041665400/0x85f5fa77adf3d8f7 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62685 expref: 14 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440426.102863:0:14365:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8ee050cada00) 00010000:00010000:2.0:1787440426.102868:0:14365:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787440426.102900:0:14365:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8edf42bdf400/0x85f5fa77adf3d905 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14365 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440426.102913:0:14365:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8edf42bdf400/0x85f5fa77adf3d905 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14365 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440426.102923:0:14365:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8edf42bdf400/0x85f5fa77adf3d905 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14365 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787440426.103097:0:14365:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006280cb98 reply state 000000008513461d transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff8edf42bdf400/0x85f5fa77adf3d905 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14365 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440426.103118:0:14365:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787440426.104161:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee0776ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ebeced4c-c181-4444-bfc2-6340445251d5+15:14504:x1874266681372672:12345-192.168.206.58@tcp:36:lhsmtool_posix.0 Request processed in 1469us (1975us total) trans 8589934615 rc 0/0 00000100:00100000:2.0:1787440426.104171:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 52 00000100:00100000:0.0:1787440426.107961:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:1.0:1787440426.108035:0:15049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681372800 00000100:00100000:1.0:1787440426.108056:0:15049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681372800 00000100:00100000:1.0:1787440426.108114:0:15049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 16 00000100:00100000:1.0:1787440426.108124:0:15049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee06e6ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ebeced4c-c181-4444-bfc2-6340445251d5+7:14504:x1874266681372800:12345-192.168.206.58@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787440426.108140:0:15049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440426.108159:0:15049:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a42bb28d/0x85f5fa77adf3d90c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5fab14535dc62693 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440426.108187:0:15049:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000e882872/0x85f5fa77adf3d8fe lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6268c expref: 8 pid: 16356 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440426.108196:0:15049:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787440426.108200:0:15049:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787440426.108204:0:15049:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a42bb28d/0x85f5fa77adf3d90c lrc: 4/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62693 expref: 8 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440426.108235:0:15049:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000e882872/0x85f5fa77adf3d8fe lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6268c expref: 8 pid: 16356 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440426.108247:0:15049:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000e882872/0x85f5fa77adf3d8fe lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6268c expref: 8 pid: 16356 timeout: 624 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440426.108260:0:15049:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee050483100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:15049:1874266701278848:192.168.206.58@tcp:104: 00000100:00100000:1.0:1787440426.108338:0:15049:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee047f96a80 going to sleep for 11 seconds 00010000:00010000:3.0:1787440426.111010:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8edf42bdf400/0x85f5fa77adf3d905 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14365 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440426.111027:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8edf42bdf400/0x85f5fa77adf3d905 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14365 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440426.111034:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8edf42bdf400/0x85f5fa77adf3d905 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14365 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440426.111053:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8edf42bdf400 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:3.0:1787440426.111058:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8edf42bdf400/0x85f5fa77adf3d905 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14365 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440426.111066:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8edf42bdf400/0x85f5fa77adf3d905 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14365 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440426.111080:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8ee050cada00) 00010000:00010000:3.0:1787440426.111083:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440426.111088:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8edf42bdf400/0x85f5fa77adf3d905 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14365 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440426.111094:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8edf42bdf400/0x85f5fa77adf3d905 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14365 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440426.111552:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440426.111683:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681372928 00000100:00100000:0.0:1787440426.111691:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681372928 00010000:00010000:0.0:1787440426.111720:0:14350:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000e882872/0x85f5fa77adf3d8fe lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6268c expref: 9 pid: 16356 timeout: 624 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440426.111753:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 13 00000100:00100000:0.0:1787440426.111761:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee050358a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ebeced4c-c181-4444-bfc2-6340445251d5+9:2362:x1874266681372928:12345-192.168.206.58@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787440426.111775:0:14350:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787440426.111802:0:14350:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000e882872/0x85f5fa77adf3d8fe lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6268c expref: 9 pid: 16356 timeout: 624 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440426.111815:0:14350:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000e882872/0x85f5fa77adf3d8fe lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6268c expref: 9 pid: 16356 timeout: 624 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440426.111833:0:14350:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787440426.111838:0:14350:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787440426.111845:0:14350:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a42bb28d/0x85f5fa77adf3d90c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62693 expref: 9 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440426.111854:0:14350:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a42bb28d/0x85f5fa77adf3d90c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62693 expref: 9 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440426.111899:0:14350:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000a42bb28d/0x85f5fa77adf3d90c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62693 expref: 9 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440426.111911:0:14350:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee06e6cf480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:14350:1874266701278976:192.168.206.58@tcp:105: 00000100:00100000:0.0:1787440426.111972:0:14350:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee0776f9480 going to sleep for 11 seconds 00010000:00010000:3.0:1787440426.112317:0:15049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000e882872/0x85f5fa77adf3d8fe lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6268c expref: 9 pid: 16356 timeout: 624 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440426.112330:0:15049:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee050483100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:15049:1874266701278848:192.168.206.58@tcp:104: 00010000:00010000:3.0:1787440426.112353:0:15049:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a42bb28d/0x85f5fa77adf3d90c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62693 expref: 8 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440426.112362:0:15049:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ee07fb9f800, rc 0) 00000100:00100000:3.0:1787440426.112397:0:15049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee06e6ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ebeced4c-c181-4444-bfc2-6340445251d5+8:14504:x1874266681372800:12345-192.168.206.58@tcp:101:lhsmtool_posix.0 Request processed in 4275us (4445us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440426.112404:0:15049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 16 00000100:00100000:0.0:1787440426.116163:0:14350:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee06e6cf480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:14350:1874266701278976:192.168.206.58@tcp:105: 00010000:00010000:0.0:1787440426.116189:0:14350:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787440426.116281:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee050358a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ebeced4c-c181-4444-bfc2-6340445251d5+7:2362:x1874266681372928:12345-192.168.206.58@tcp:103:ldlm_bl.0 Request processed in 4519us (4732us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440426.116291:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 13 00000100:00100000:0.0:1787440426.118432:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:1.0:1787440426.119354:0:15050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681373056 00000100:00100000:1.0:1787440426.119374:0:15050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681373056 00000100:00100000:1.0:1787440426.119459:0:15050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 17 00000100:00100000:1.0:1787440426.119469:0:15050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee06e6cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ebeced4c-c181-4444-bfc2-6340445251d5+7:2363:x1874266681373056:12345-192.168.206.58@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1787440426.120090:0:15050:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1787440426.120095:0:15050:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1787440425 00002000:00010000:1.0:1787440426.120160:0:15050:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 1787440424 00002000:00010000:1.0:1787440426.120164:0:15050:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1787440426 -> 1787440425 00002000:00010000:1.0:1787440426.120166:0:15050:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1787440426.120229:0:15050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee06e6cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ebeced4c-c181-4444-bfc2-6340445251d5+8:2363:x1874266681373056:12345-192.168.206.58@tcp:2:lhsmtool_posix.0 Request processed in 760us (1810us total) trans 8589934596 rc 0/0 00000100:00100000:1.0:1787440426.120237:0:15050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 17 00000100:00100000:2.0:1787440426.123979:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:1.0:1787440426.124077:0:16356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681373184 00000100:00100000:1.0:1787440426.124085:0:16356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681373184 00000100:00100000:1.0:1787440426.124223:0:16356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 18 00000100:00100000:1.0:1787440426.124233:0:16356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee077f40000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ebeced4c-c181-4444-bfc2-6340445251d5+8:2361:x1874266681373184:12345-192.168.206.58@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1787440426.124273:0:16356:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000a61f0530/0x85f5fa77adf3d913 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440426.124293:0:16356:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a42bb28d/0x85f5fa77adf3d90c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62693 expref: 8 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440426.124301:0:16356:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787440426.124306:0:16356:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787440426.124310:0:16356:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a61f0530/0x85f5fa77adf3d913 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440426.124342:0:16356:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a42bb28d/0x85f5fa77adf3d90c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62693 expref: 8 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440426.124379:0:16356:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a42bb28d/0x85f5fa77adf3d90c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62693 expref: 8 pid: 15049 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440426.124394:0:16356:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee05035a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:16356:1874266701279104:192.168.206.58@tcp:104: 00000100:00100000:1.0:1787440426.124540:0:16356:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee047f96c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787440426.127117:0:16356:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee05035a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:16356:1874266701279104:192.168.206.58@tcp:104: 00010000:00010000:1.0:1787440426.127145:0:16356:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a61f0530/0x85f5fa77adf3d913 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440426.128973:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440426.129234:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681373312 00000100:00100000:0.0:1787440426.129243:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681373312 00010000:00010000:0.0:1787440426.129278:0:14352:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a42bb28d/0x85f5fa77adf3d90c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62693 expref: 9 pid: 15049 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440426.129318:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 14 00000100:00100000:0.0:1787440426.129328:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee077f41c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ebeced4c-c181-4444-bfc2-6340445251d5+9:2363:x1874266681373312:12345-192.168.206.58@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787440426.129343:0:14352:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787440426.129362:0:14352:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a42bb28d/0x85f5fa77adf3d90c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62693 expref: 9 pid: 15049 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440426.129385:0:14352:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a42bb28d/0x85f5fa77adf3d90c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62693 expref: 9 pid: 15049 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440426.129432:0:14352:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a42bb28d/0x85f5fa77adf3d90c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62693 expref: 9 pid: 15049 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440426.129448:0:14352:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787440426.129452:0:14352:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787440426.129458:0:14352:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a61f0530/0x85f5fa77adf3d913 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 16356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440426.129466:0:14352:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a61f0530/0x85f5fa77adf3d913 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 16356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440426.129540:0:14352:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787440426.129588:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee077f41c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ebeced4c-c181-4444-bfc2-6340445251d5+8:2363:x1874266681373312:12345-192.168.206.58@tcp:103:ldlm_bl.0 Request processed in 261us (621us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440426.129766:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 14 00010000:00010000:1.0:1787440426.130091:0:16356:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a61f0530/0x85f5fa77adf3d913 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440426.130113:0:16356:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a61f0530/0x85f5fa77adf3d913 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440426.130138:0:16356:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000a61f0530/0x85f5fa77adf3d913 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440426.130146:0:16356:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a61f0530/0x85f5fa77adf3d913 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440426.130153:0:16356:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a61f0530/0x85f5fa77adf3d913 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440426.130172:0:16356:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee07fb9e200 already unused, calling callback (ffffffffc15b52a0) 00010000:00010000:1.0:1787440426.130175:0:16356:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a61f0530/0x85f5fa77adf3d913 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440426.130183:0:16356:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a61f0530/0x85f5fa77adf3d913 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440426.130197:0:16356:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a61f0530/0x85f5fa77adf3d913 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440426.130204:0:16356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a61f0530/0x85f5fa77adf3d913 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440426.130255:0:16356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee077f40000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ebeced4c-c181-4444-bfc2-6340445251d5+7:2361:x1874266681373184:12345-192.168.206.58@tcp:1:lhsmtool_posix.0 Request processed in 6024us (6285us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440426.130262:0:16356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 18 00000100:00100000:0.0:1787440426.133462:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:1.0:1787440426.133605:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681373568 00000100:00100000:1.0:1787440426.133614:0:14367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681373568 00000100:00100000:1.0:1787440426.133666:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 53 00000100:00100000:1.0:1787440426.133676:0:14367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee06e6ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ebeced4c-c181-4444-bfc2-6340445251d5+14:14504:x1874266681373568:12345-192.168.206.58@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1787440426.133749:0:14367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9ee00/0x85f5fa77adf3d91a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440426.133765:0:14367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9ee00/0x85f5fa77adf3d91a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440426.133957:0:14367:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9ee00/0x85f5fa77adf3d91a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440426.134235:0:14367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9ec00/0x85f5fa77adf3d921 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440426.134248:0:14367:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee041665e00/0x85f5fa77adf3d8e9 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6267e expref: 15 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440426.134256:0:14367:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9ec00/0x85f5fa77adf3d921 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440426.134290:0:14367:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ee041665e00/0x85f5fa77adf3d8e9 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6267e expref: 15 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440426.134304:0:14367:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee041665e00/0x85f5fa77adf3d8e9 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6267e expref: 15 pid: 14365 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440426.134318:0:14367:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee05035a680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14367:1874266701279232:192.168.206.58@tcp:104: 00000100:00100000:1.0:1787440426.134466:0:14367:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee047f96c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787440426.140221:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:2.0:1787440426.140296:0:16594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681373696 00000100:00100000:2.0:1787440426.140304:0:16594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681373696 00010000:00010000:2.0:1787440426.140341:0:16594:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee041665e00/0x85f5fa77adf3d8e9 lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6267e expref: 16 pid: 14365 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440426.140388:0:16594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 15 00000100:00100000:2.0:1787440426.140397:0:16594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee08032ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ebeced4c-c181-4444-bfc2-6340445251d5+16:2363:x1874266681373696:12345-192.168.206.58@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787440426.140410:0:16594:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787440426.140438:0:16594:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ee041665e00/0x85f5fa77adf3d8e9 lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6267e expref: 16 pid: 14365 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440426.140655:0:16594:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ee041665e00/0x85f5fa77adf3d8e9 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6267e expref: 16 pid: 14365 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440426.140678:0:16594:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8ee050cada00) 00010000:00010000:2.0:1787440426.140683:0:16594:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9ec00/0x85f5fa77adf3d921 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440426.140692:0:16594:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9ec00/0x85f5fa77adf3d921 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440426.140699:0:16594:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9ec00/0x85f5fa77adf3d921 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440426.140717:0:16594:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787440426.140933:0:16594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee08032ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ebeced4c-c181-4444-bfc2-6340445251d5+16:2363:x1874266681373696:12345-192.168.206.58@tcp:103:ldlm_bl.0 Request processed in 536us (720us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440426.140941:0:16594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 15 00010000:00010000:1.0:1787440426.141023:0:14367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee041665e00/0x85f5fa77adf3d8e9 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.58@tcp remote: 0x5fab14535dc6267e expref: 15 pid: 14365 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440426.141039:0:14367:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee05035a680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14367:1874266701279232:192.168.206.58@tcp:104: 00010000:00010000:1.0:1787440426.141058:0:14367:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9ec00/0x85f5fa77adf3d921 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440426.141067:0:14367:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9ec00/0x85f5fa77adf3d921 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440426.141081:0:14367:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9ec00/0x85f5fa77adf3d921 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787440426.141262:0:14367:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:1.0:1787440426.141410:0:14367:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:1.0:1787440426.141480:0:14367:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:1.0:1787440426.141611:0:14367:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee05035a680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14367:1874266701279360:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1787440426.141662:0:14367:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440426.141684:0:14367:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ee047f96c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787440426.141988:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701279360 00000100:00100000:0.0:1787440426.141994:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701279360 00000100:00100000:0.0:1787440426.142032:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787440426.142040:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee050358380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14367:x1874266701279360:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1787440426.142124:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee050358380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14367:x1874266701279360:12345-0@lo:1000:mdt00_002.0 Request processed in 85us (462us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440426.142131:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787440426.142206:0:14367:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee05035a680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14367:1874266701279360:0@lo:1000:mdt00_002.0 00000001:00080000:2.0:1787440426.142837:0:14367:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:2.0:1787440426.142898:0:14367:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee077f41f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14367:1874266701279488:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1787440426.142938:0:14367:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440426.142965:0:14367:0:(client.c:2715:ptlrpc_set_wait()) set ffff8edf41107600 going to sleep for 11 seconds 00000100:00100000:0.0:1787440426.143228:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701279488 00000100:00100000:0.0:1787440426.143240:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701279488 00000100:00100000:0.0:1787440426.143270:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787440426.143277:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee077f41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14367:x1874266701279488:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1787440426.143437:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee077f41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:14367:x1874266701279488:12345-0@lo:1000:mdt00_002.0 Request processed in 160us (499us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1787440426.143445:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787440426.144078:0:14367:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee077f41f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14367:1874266701279488:0@lo:1000:mdt00_002.0 00010000:00010000:2.0:1787440426.144122:0:14367:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9ec00/0x85f5fa77adf3d921 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440426.144145:0:14367:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9ec00/0x85f5fa77adf3d921 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440426.144152:0:14367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9ec00/0x85f5fa77adf3d921 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440426.144158:0:14367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee07fb9ec00 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:2.0:1787440426.144162:0:14367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9ec00/0x85f5fa77adf3d921 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440426.144170:0:14367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9ec00/0x85f5fa77adf3d921 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440426.144184:0:14367:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8ee050cada00) 00010000:00010000:2.0:1787440426.144187:0:14367:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787440426.144191:0:14367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9ec00/0x85f5fa77adf3d921 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440426.144197:0:14367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9ec00/0x85f5fa77adf3d921 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440426.144227:0:14367:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee041664400/0x85f5fa77adf3d879 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14365 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440426.144234:0:14367:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee041664400/0x85f5fa77adf3d879 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14365 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440426.144240:0:14367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee041664400/0x85f5fa77adf3d879 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14365 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440426.144245:0:14367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee041664400 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:2.0:1787440426.144257:0:14367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee041664400/0x85f5fa77adf3d879 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14365 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440426.144263:0:14367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee041664400/0x85f5fa77adf3d879 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 14365 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440426.144272:0:14367:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8ee050ca1500) 00010000:00010000:2.0:1787440426.144274:0:14367:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787440426.144281:0:14367:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf200/0x85f5fa77adf3d880 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62662 expref: 18 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440426.144291:0:14367:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf200/0x85f5fa77adf3d880 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62662 expref: 18 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440426.144298:0:14367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf200/0x85f5fa77adf3d880 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62662 expref: 18 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440426.144329:0:14367:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcf200/0x85f5fa77adf3d880 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.58@tcp remote: 0x5fab14535dc62662 expref: 18 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440426.144342:0:14367:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee077f42a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14367:1874266701279616:192.168.206.58@tcp:105: 00000100:00100000:2.0:1787440426.144414:0:14367:0:(client.c:2715:ptlrpc_set_wait()) set ffff8edf41107600 going to sleep for 11 seconds 00000100:00100000:2.0:1787440426.151325:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440426.151395:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681373824 00000100:00100000:0.0:1787440426.151404:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681373824 00000100:00100000:0.0:1787440426.151467:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 10 00000100:00100000:0.0:1787440426.151477:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee04caf1050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ebeced4c-c181-4444-bfc2-6340445251d5+19:14503:x1874266681373824:12345-192.168.206.58@tcp:49:dd.0 00000100:00100000:0.0:1787440426.151620:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee04caf1050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ebeced4c-c181-4444-bfc2-6340445251d5+19:14503:x1874266681373824:12345-192.168.206.58@tcp:49:dd.0 Request processed in 144us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440426.151627:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 10 00000100:00100000:1.0:1787440426.154952:0:14367:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee077f42a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14367:1874266701279616:192.168.206.58@tcp:105: 00010000:00010000:1.0:1787440426.154982:0:14367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee041664400/0x85f5fa77adf3d879 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14365 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440426.154991:0:14367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee041664400/0x85f5fa77adf3d879 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14365 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440426.155025:0:14367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e200/0x85f5fa77adf3d928 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440426.155038:0:14367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e200/0x85f5fa77adf3d928 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440426.155049:0:14367:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e200/0x85f5fa77adf3d928 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440426.155059:0:14367:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e200/0x85f5fa77adf3d928 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440426.155065:0:14367:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e200/0x85f5fa77adf3d928 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440426.155089:0:14367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e200/0x85f5fa77adf3d928 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440426.155094:0:14367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee07fb9e200 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:1.0:1787440426.155482:0:14367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e200/0x85f5fa77adf3d928 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440426.155591:0:14367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e200/0x85f5fa77adf3d928 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440426.155606:0:14367:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8ee050ca1500) 00010000:00010000:1.0:1787440426.155609:0:14367:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440426.155613:0:14367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e200/0x85f5fa77adf3d928 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440426.155620:0:14367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9e200/0x85f5fa77adf3d928 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440426.155631:0:14367:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9ee00/0x85f5fa77adf3d91a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440426.155638:0:14367:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9ee00/0x85f5fa77adf3d91a lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440426.155644:0:14367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9ee00/0x85f5fa77adf3d91a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440426.155649:0:14367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee07fb9ee00 already unused, calling callback (ffffffffc1ff44f0) 00010000:00010000:1.0:1787440426.155652:0:14367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9ee00/0x85f5fa77adf3d91a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440426.155669:0:14367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9ee00/0x85f5fa77adf3d91a lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440426.155678:0:14367:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8ee050ca1500) 00010000:00010000:1.0:1787440426.155680:0:14367:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787440426.155683:0:14367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9ee00/0x85f5fa77adf3d91a lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440426.155688:0:14367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee07fb9ee00/0x85f5fa77adf3d91a lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440426.156751:0:14367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee06e6ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ebeced4c-c181-4444-bfc2-6340445251d5+18:14504:x1874266681373568:12345-192.168.206.58@tcp:57:lhsmtool_posix.0 Request processed in 23070us (23291us total) trans 8589934620 rc 0/0 00000100:00100000:1.0:1787440426.156763:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 53 00000020:00080000:1.0:1787440426.156768:0:14367:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1787440426.163158:0:14399:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1787440426.163168:0:14399:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787440426.163199:0:14399:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1787440426.163205:0:14399:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1787440426.163344:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440426.163725:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681374080 00000100:00100000:0.0:1787440426.163734:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681374080 00000100:00100000:0.0:1787440426.163792:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 11 00000100:00100000:0.0:1787440426.163802:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee077f43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ebeced4c-c181-4444-bfc2-6340445251d5+18:14504:x1874266681374080:12345-192.168.206.58@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1787440426.164876:0:14368:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1787440426.164987:0:14368:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:0.0:1787440426.165031:0:14368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfe00/0x85f5fa77adf3d92f lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440426.165048:0:14368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfe00/0x85f5fa77adf3d92f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440426.165060:0:14368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfe00/0x85f5fa77adf3d92f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440426.165079:0:14368:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfe00/0x85f5fa77adf3d92f lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440426.165086:0:14368:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfe00/0x85f5fa77adf3d92f lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440426.165093:0:14368:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfe00/0x85f5fa77adf3d92f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440426.165229:0:14368:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787440426.165330:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee077f43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ebeced4c-c181-4444-bfc2-6340445251d5+20:14504:x1874266681374080:12345-192.168.206.58@tcp:35:lhsmtool_posix.0 Request processed in 1527us (1988us total) trans 8589934622 rc 0/0 00000100:00100000:0.0:1787440426.165339:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 11 00000020:00080000:0.0:1787440426.165345:0:14368:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787440426.171263:0:14354:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787440426.171388:0:14354:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfe00/0x85f5fa77adf3d92f lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440426.171401:0:14354:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee04cbcfe00 already unused, calling callback (ffffffffc15b52a0) 00010000:00010000:3.0:1787440426.171415:0:14354:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfe00/0x85f5fa77adf3d92f lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440426.171436:0:14354:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfe00/0x85f5fa77adf3d92f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440426.171457:0:14354:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8ee050cada00) 00010000:00010000:3.0:1787440426.171460:0:14354:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787440426.171465:0:14354:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfe00/0x85f5fa77adf3d92f lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440426.171471:0:14354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ee04cbcfe00/0x85f5fa77adf3d92f lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440426.171583:0:14354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787440426.171586:0:14354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787440426.171588:0:14354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787440426.309590:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440426.309647:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440426.309798:0:15055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681374336 00000100:00100000:3.0:1787440426.309806:0:15055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681374336 00000100:00100000:3.0:1787440426.309857:0:15055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681374208 00000100:00100000:3.0:1787440426.309860:0:15055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681374208 00000100:00100000:3.0:1787440426.309877:0:15055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 0 00000100:00100000:3.0:1787440426.309885:0:15055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee06e6cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ebeced4c-c181-4444-bfc2-6340445251d5+8:2360:x1874266681374336:12345-192.168.206.58@tcp:4:dd.0 00002000:00010000:3.0:1787440426.309929:0:15055:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x6a8a2d29, atime: 0x6a8a2d28, ctime: 0x6a8a2d29, blocks: 0x1 00010000:00010000:3.0:1787440426.309938:0:15055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000038211e85/0x85f5fa77adf3d936 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440426.309953:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=524s v=(0 0) 00010000:00010000:3.0:1787440426.309958:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787440426.309976:0:15055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000038211e85/0x85f5fa77adf3d936 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440426.309992:0:15055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000038211e85/0x85f5fa77adf3d936 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440426.328456:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:1.0:1787440426.328510:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:2.0:1787440426.328895:0:15054:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:2.0:1787440426.328906:0:15054:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:1.0:1787440426.329643:0:15054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681374464 00000100:00100000:1.0:1787440426.329654:0:15054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681374464 00000100:00100000:1.0:1787440426.329704:0:15054:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:1.0:1787440426.329712:0:15054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681374592 00000100:00100000:1.0:1787440426.329715:0:15054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681374592 00000100:00100000:2.0:1787440426.330334:0:16597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 1 00000100:00100000:2.0:1787440426.330348:0:16597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee07f9f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ebeced4c-c181-4444-bfc2-6340445251d5+11:2360:x1874266681374208:12345-192.168.206.58@tcp:4:dd.0 00010000:00010000:2.0:1787440426.330479:0:16597:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005dfa9b49/0x85f5fa77adf3d93d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440426.330545:0:16597:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787440426.330550:0:16597:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787440426.330557:0:16597:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005dfa9b49/0x85f5fa77adf3d93d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440426.330635:0:16597:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005dfa9b49/0x85f5fa77adf3d93d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440426.339680:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:1.0:1787440426.339716:0:15054:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:3.0:1787440426.340655:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440426.340684:0:15056:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:3.0:1787440426.340693:0:15056:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_004' 00000100:00100000:3.0:1787440426.340726:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440426.340757:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:3.0:1787440426.340900:0:15056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681374720 00000100:00100000:3.0:1787440426.340908:0:15056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681374720 00000100:00100000:3.0:1787440426.340958:0:15056:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:3.0:1787440426.340966:0:15056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681374848 00000100:00100000:3.0:1787440426.340969:0:15056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681374848 00000100:00100000:3.0:1787440426.340987:0:15056:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:3.0:1787440426.340992:0:15056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681374976 00000100:00100000:3.0:1787440426.340994:0:15056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681374976 00000100:00100000:3.0:1787440426.341013:0:15056:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:3.0:1787440426.341019:0:15056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681375104 00000100:00100000:3.0:1787440426.341022:0:15056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681375104 00000100:00100000:3.0:1787440426.341439:0:16598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 2 00000100:00100000:3.0:1787440426.341450:0:16598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee050358000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ebeced4c-c181-4444-bfc2-6340445251d5+15:2361:x1874266681374464:12345-192.168.206.58@tcp:4:dd.0 00010000:00010000:3.0:1787440426.341484:0:16598:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000733ed093/0x85f5fa77adf3d944 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440426.341529:0:16598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787440426.341534:0:16598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787440426.341540:0:16598:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000733ed093/0x85f5fa77adf3d944 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440426.341564:0:16598:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000733ed093/0x85f5fa77adf3d944 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440426.342110:0:15054:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_005' 00000100:00100000:1.0:1787440426.343200:0:16599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 3 00000100:00100000:1.0:1787440426.343220:0:16599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee050359180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ebeced4c-c181-4444-bfc2-6340445251d5+17:2361:x1874266681374592:12345-192.168.206.58@tcp:4:dd.0 00010000:00010000:1.0:1787440426.343402:0:16599:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a61f0530/0x85f5fa77adf3d94b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440426.343427:0:16599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787440426.343431:0:16599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787440426.343437:0:16599:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a61f0530/0x85f5fa77adf3d94b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440426.343450:0:16599:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a61f0530/0x85f5fa77adf3d94b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440426.398262:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787440426.398282:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee050482300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874266701279744:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787440426.398359:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440426.398433:0:15053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701279744 00000100:00100000:3.0:1787440426.398440:0:15053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701279744 00000100:00100000:3.0:1787440426.398483:0:15053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787440426.398512:0:15053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee050483100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3311:x1874266701279744:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787440426.398533:0:15053:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3407872 granted 64684032 pending 6815744 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787440426.398574:0:15053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee050483100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3311:x1874266701279744:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440426.398582:0:15053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787440426.398644:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee050482300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874266701279744:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787440426.399947:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee050359c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c:3309:1874266701279872:0@lo:400:kworker.0 00000100:00100000:1.0:1787440426.399998:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440426.400038:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee05035b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1874266701280384:0@lo:400:kworker.0 00000100:00100000:1.0:1787440426.400064:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440426.400086:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787440426.400091:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee050359880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874266701280000:0@lo:400:kworker.0 00000100:00100000:1.0:1787440426.400113:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440426.400150:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701279872 00000100:00100000:1.0:1787440426.400156:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701279872 00000100:00100000:1.0:1787440426.400191:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1787440426.400198:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee07b120c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+19:3309:x1874266701279872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440426.400486:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee07b120c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c+19:3309:x1874266701279872:12345-0@lo:400:kworker.0 Request processed in 288us (488us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440426.400509:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1787440426.400560:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee050359c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ad3425e2-7a90-4de2-801f-bf0de0fd7f0c:3309:1874266701279872:0@lo:400:kworker.0 00000100:00100000:0.0:1787440426.400744:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee050358e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3312:1874266701280256:0@lo:400:kworker.0 00000100:00100000:0.0:1787440426.400771:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440426.400791:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787440426.400796:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ee05035b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874266701280128:0@lo:400:kworker.0 00000100:00100000:0.0:1787440426.400812:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440426.400836:0:15051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701280000 00000100:00100000:0.0:1787440426.400840:0:15051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701280000 00000100:00100000:0.0:1787440426.400865:0:15051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787440426.400871:0:15051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee05035a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1874266701280000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787440426.400910:0:15051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee05035a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1874266701280000:12345-0@lo:400:kworker.0 Request processed in 39us (795us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440426.400916:0:15051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787440426.400932:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701280384 00000100:00100000:0.0:1787440426.400935:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701280384 00000100:00100000:0.0:1787440426.400958:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701280256 00000100:00100000:0.0:1787440426.400960:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701280256 00000100:00100000:0.0:1787440426.400970:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266701280128 00000100:00100000:0.0:1787440426.400972:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266701280128 00000100:00100000:0.0:1787440426.400981:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787440426.400985:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee050359500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1874266701280384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787440426.401010:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee050359500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1874266701280384:12345-0@lo:400:kworker.0 Request processed in 25us (946us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440426.401026:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787440426.401036:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787440426.401041:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee07f9f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874266701280256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787440426.401066:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee07f9f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874266701280256:12345-0@lo:400:kworker.0 Request processed in 24us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440426.401071:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787440426.401079:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787440426.401084:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee07f9f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874266701280128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787440426.401103:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee07f9f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874266701280128:12345-0@lo:400:kworker.0 Request processed in 19us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440426.401108:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:0.0:1787440426.401125:0:14361:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787440426.401153:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee05035b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874266701280128:0@lo:400:kworker.0 00000100:00100000:0.0:1787440426.401171:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee050358e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3312:1874266701280256:0@lo:400:kworker.0 00000100:00100000:0.0:1787440426.401191:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee050359880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874266701280000:0@lo:400:kworker.0 00000100:00100000:0.0:1787440426.401199:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ee05035b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1874266701280384:0@lo:400:kworker.0 00002000:00010000:3.0:1787440426.461908:0:15055:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 4194304 00002000:00010000:3.0:1787440426.461917:0:15055:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 1787440425 -> 1787440426 00002000:00010000:3.0:1787440426.461919:0:15055:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1787440425 -> 1787440426 00002000:00010000:3.0:1787440426.461922:0:15055:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 6151 00010000:00010000:3.0:1787440426.461935:0:15055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000038211e85/0x85f5fa77adf3d936 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440426.461949:0:15055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000038211e85/0x85f5fa77adf3d936 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440426.461974:0:15055:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000038211e85/0x85f5fa77adf3d936 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440426.461981:0:15055:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee041665c00 already unused, calling callback (ffffffffc15b52a0) 00010000:00010000:3.0:1787440426.461986:0:15055:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000038211e85/0x85f5fa77adf3d936 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440426.461994:0:15055:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000038211e85/0x85f5fa77adf3d936 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440426.462012:0:15055:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000038211e85/0x85f5fa77adf3d936 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440426.462031:0:15055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000038211e85/0x85f5fa77adf3d936 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440426.462126:0:15055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee06e6cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ebeced4c-c181-4444-bfc2-6340445251d5+25:2360:x1874266681374336:12345-192.168.206.58@tcp:4:dd.0 Request processed in 152238us (152542us total) trans 8589934598 rc 0/0 00000100:00100000:3.0:1787440426.462137:0:15055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 0 00000100:00100000:3.0:1787440426.462394:0:15055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 4 00000100:00100000:3.0:1787440426.462405:0:15055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee050359f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ebeced4c-c181-4444-bfc2-6340445251d5+24:2361:x1874266681374720:12345-192.168.206.58@tcp:4:dd.0 00010000:00010000:3.0:1787440426.462445:0:15055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b74bdf4a/0x85f5fa77adf3d952 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440426.462458:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787440426.462468:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787440426.462474:0:15055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b74bdf4a/0x85f5fa77adf3d952 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440426.462486:0:15055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b74bdf4a/0x85f5fa77adf3d952 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787440426.462638:0:7640:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934599 is committed 00000001:00080000:3.0:1787440426.462649:0:7640:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934597 is committed 00000001:00080000:3.0:1787440426.462662:0:7640:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934600 is committed 00010000:00010000:1.0:1787440426.463563:0:16598:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000733ed093/0x85f5fa77adf3d944 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440426.463576:0:16598:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000733ed093/0x85f5fa77adf3d944 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440426.463582:0:16598:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000733ed093/0x85f5fa77adf3d944 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440426.463589:0:16598:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee041665a00 already unused, calling callback (ffffffffc15b52a0) 00010000:00010000:1.0:1787440426.463593:0:16598:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000733ed093/0x85f5fa77adf3d944 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440426.463601:0:16598:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000733ed093/0x85f5fa77adf3d944 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440426.463615:0:16598:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000733ed093/0x85f5fa77adf3d944 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440426.463621:0:16598:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000733ed093/0x85f5fa77adf3d944 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440426.463689:0:16598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee050358000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ebeced4c-c181-4444-bfc2-6340445251d5+16:2361:x1874266681374464:12345-192.168.206.58@tcp:4:dd.0 Request processed in 122239us (135240us total) trans 8589934599 rc 0/0 00000100:00100000:1.0:1787440426.463698:0:16598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 2 00000100:00100000:1.0:1787440426.463735:0:16598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 5 00000100:00100000:1.0:1787440426.463753:0:16598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee0776b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ebeced4c-c181-4444-bfc2-6340445251d5+15:2361:x1874266681374848:12345-192.168.206.58@tcp:4:dd.0 00010000:00010000:1.0:1787440426.463777:0:16598:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e413252f/0x85f5fa77adf3d959 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440426.463788:0:16598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787440426.463792:0:16598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787440426.463796:0:16598:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e413252f/0x85f5fa77adf3d959 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440426.463806:0:16598:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e413252f/0x85f5fa77adf3d959 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440426.469772:0:16597:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005dfa9b49/0x85f5fa77adf3d93d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440426.469792:0:16597:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005dfa9b49/0x85f5fa77adf3d93d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440426.469802:0:16597:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005dfa9b49/0x85f5fa77adf3d93d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440426.469810:0:16597:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8edf42bdfc00 already unused, calling callback (ffffffffc15b52a0) 00010000:00010000:0.0:1787440426.469815:0:16597:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005dfa9b49/0x85f5fa77adf3d93d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440426.469824:0:16597:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005dfa9b49/0x85f5fa77adf3d93d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440426.469843:0:16597:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005dfa9b49/0x85f5fa77adf3d93d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440426.469851:0:16597:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005dfa9b49/0x85f5fa77adf3d93d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440426.469946:0:16597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee07f9f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ebeced4c-c181-4444-bfc2-6340445251d5+15:2360:x1874266681374208:12345-192.168.206.58@tcp:4:dd.0 Request processed in 139596us (160292us total) trans 8589934600 rc 0/0 00000100:00100000:0.0:1787440426.469973:0:16597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 1 00000100:00100000:0.0:1787440426.470003:0:16597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 6 00000100:00100000:0.0:1787440426.470014:0:16597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee0776ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ebeced4c-c181-4444-bfc2-6340445251d5+14:2361:x1874266681374976:12345-192.168.206.58@tcp:4:dd.0 00010000:00010000:0.0:1787440426.470042:0:16597:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000103223a1/0x85f5fa77adf3d960 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440426.470055:0:16597:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787440426.470059:0:16597:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787440426.470066:0:16597:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000103223a1/0x85f5fa77adf3d960 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440426.470078:0:16597:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000103223a1/0x85f5fa77adf3d960 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440426.525602:0:14353:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1787440426.529931:0:7640:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934601 is committed 00002000:00010000:0.0:1787440426.530647:0:16599:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 4194304 -> 7340032 00002000:00010000:0.0:1787440426.530654:0:16599:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 6151 -> 8199 00010000:00010000:0.0:1787440426.530668:0:16599:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a61f0530/0x85f5fa77adf3d94b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440426.530681:0:16599:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a61f0530/0x85f5fa77adf3d94b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440426.530691:0:16599:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a61f0530/0x85f5fa77adf3d94b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440426.530699:0:16599:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee07fb9e200 already unused, calling callback (ffffffffc15b52a0) 00010000:00010000:0.0:1787440426.530715:0:16599:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a61f0530/0x85f5fa77adf3d94b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440426.530738:0:16599:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a61f0530/0x85f5fa77adf3d94b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440426.530756:0:16599:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a61f0530/0x85f5fa77adf3d94b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440426.530764:0:16599:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a61f0530/0x85f5fa77adf3d94b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440426.530845:0:16599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee050359180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ebeced4c-c181-4444-bfc2-6340445251d5+18:2361:x1874266681374592:12345-192.168.206.58@tcp:4:dd.0 Request processed in 187626us (202330us total) trans 8589934601 rc 0/0 00000100:00100000:0.0:1787440426.530855:0:16599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 3 00000100:00100000:0.0:1787440426.530883:0:16599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 7 00000100:00100000:0.0:1787440426.530895:0:16599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee0776b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ebeced4c-c181-4444-bfc2-6340445251d5+17:2361:x1874266681375104:12345-192.168.206.58@tcp:4:dd.0 00010000:00010000:0.0:1787440426.530922:0:16599:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000027015e4c/0x85f5fa77adf3d967 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440426.530934:0:16599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787440426.530938:0:16599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787440426.530944:0:16599:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000027015e4c/0x85f5fa77adf3d967 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440426.530956:0:16599:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000027015e4c/0x85f5fa77adf3d967 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787440426.585585:0:16597:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 7340032 -> 7654321 00002000:00010000:0.0:1787440426.585595:0:16597:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 8199 -> 14343 00010000:00010000:0.0:1787440426.585609:0:16597:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000103223a1/0x85f5fa77adf3d960 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440426.585620:0:16597:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000103223a1/0x85f5fa77adf3d960 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440426.585629:0:16597:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000103223a1/0x85f5fa77adf3d960 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440426.585636:0:16597:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee04cbcec00 already unused, calling callback (ffffffffc15b52a0) 00010000:00010000:0.0:1787440426.585640:0:16597:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000103223a1/0x85f5fa77adf3d960 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440426.585648:0:16597:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000103223a1/0x85f5fa77adf3d960 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440426.585667:0:16597:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000103223a1/0x85f5fa77adf3d960 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440426.585675:0:16597:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000103223a1/0x85f5fa77adf3d960 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440426.586458:0:16597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee0776ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ebeced4c-c181-4444-bfc2-6340445251d5+19:2361:x1874266681374976:12345-192.168.206.58@tcp:4:dd.0 Request processed in 116441us (245726us total) trans 8589934604 rc 0/0 00000100:00100000:0.0:1787440426.586482:0:16597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 6 00000001:00080000:2.0:1787440426.589536:0:7640:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934604 is committed 00002000:00010000:0.0:1787440426.597574:0:15055:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 14343 -> 16391 00010000:00010000:0.0:1787440426.597594:0:15055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b74bdf4a/0x85f5fa77adf3d952 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440426.597607:0:15055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b74bdf4a/0x85f5fa77adf3d952 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440426.597616:0:15055:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b74bdf4a/0x85f5fa77adf3d952 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440426.597623:0:15055:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee041664200 already unused, calling callback (ffffffffc15b52a0) 00010000:00010000:0.0:1787440426.597629:0:15055:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b74bdf4a/0x85f5fa77adf3d952 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440426.597638:0:15055:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b74bdf4a/0x85f5fa77adf3d952 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440426.597656:0:15055:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b74bdf4a/0x85f5fa77adf3d952 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440426.597663:0:15055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b74bdf4a/0x85f5fa77adf3d952 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440426.597760:0:15055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee050359f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ebeced4c-c181-4444-bfc2-6340445251d5+11:2361:x1874266681374720:12345-192.168.206.58@tcp:4:dd.0 Request processed in 135353us (258083us total) trans 8589934602 rc 0/0 00000100:00100000:0.0:1787440426.597785:0:15055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 4 00010000:00010000:0.0:1787440426.597829:0:16598:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e413252f/0x85f5fa77adf3d959 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440426.597838:0:16598:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e413252f/0x85f5fa77adf3d959 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440426.597845:0:16598:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e413252f/0x85f5fa77adf3d959 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440426.597851:0:16598:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee07fb9ea00 already unused, calling callback (ffffffffc15b52a0) 00010000:00010000:0.0:1787440426.597855:0:16598:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e413252f/0x85f5fa77adf3d959 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440426.597863:0:16598:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e413252f/0x85f5fa77adf3d959 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440426.597873:0:16598:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e413252f/0x85f5fa77adf3d959 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440426.597879:0:16598:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e413252f/0x85f5fa77adf3d959 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440426.597910:0:16598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee0776b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ebeced4c-c181-4444-bfc2-6340445251d5+9:2361:x1874266681374848:12345-192.168.206.58@tcp:4:dd.0 Request processed in 134159us (257259us total) trans 8589934603 rc 0/0 00000100:00100000:0.0:1787440426.597916:0:16598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 5 00000001:00080000:2.0:1787440426.628991:0:7640:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934605 is committed 00010000:00010000:3.0:1787440426.629224:0:16599:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000027015e4c/0x85f5fa77adf3d967 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440426.629238:0:16599:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000027015e4c/0x85f5fa77adf3d967 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440426.629248:0:16599:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000027015e4c/0x85f5fa77adf3d967 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440426.629257:0:16599:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ee04cbce800 already unused, calling callback (ffffffffc15b52a0) 00010000:00010000:3.0:1787440426.629262:0:16599:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000027015e4c/0x85f5fa77adf3d967 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440426.629271:0:16599:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000027015e4c/0x85f5fa77adf3d967 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440426.629291:0:16599:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000027015e4c/0x85f5fa77adf3d967 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440426.629312:0:16599:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000027015e4c/0x85f5fa77adf3d967 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440426.629407:0:16599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee0776b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ebeced4c-c181-4444-bfc2-6340445251d5+5:2361:x1874266681375104:12345-192.168.206.58@tcp:4:dd.0 Request processed in 98511us (288645us total) trans 8589934605 rc 0/0 00000100:00100000:3.0:1787440426.629431:0:16599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 7 00010000:00010000:0.0:1787440427.548838:0:16029:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787440428.243836:0:16637:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:0.0:1787440428.580368:0:14354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787440428.603486:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440428.603577:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440428.603604:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440428.603641:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440428.603663:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440428.603684:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440428.603710:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.58@tcp (source: 12345-192.168.206.58@tcp) 00000100:00100000:0.0:1787440428.603741:0:16356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681375616 00000100:00100000:0.0:1787440428.603753:0:16356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681375616 00000100:00100000:0.0:1787440428.603817:0:16356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681375872 00000100:00100000:0.0:1787440428.603820:0:16356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681375872 00000100:00100000:0.0:1787440428.603835:0:16356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681375488 00000100:00100000:0.0:1787440428.603837:0:16356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681375488 00000100:00100000:0.0:1787440428.603850:0:16356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681376000 00000100:00100000:0.0:1787440428.603852:0:16356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681376000 00000100:00100000:0.0:1787440428.603869:0:16356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 18 00000100:00100000:0.0:1787440428.603880:0:16356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee079915180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ebeced4c-c181-4444-bfc2-6340445251d5+5:2362:x1874266681375616:12345-192.168.206.58@tcp:400:kworker.0 00000100:00100000:0.0:1787440428.603967:0:16356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee079915180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ebeced4c-c181-4444-bfc2-6340445251d5+5:2362:x1874266681375616:12345-192.168.206.58@tcp:400:kworker.0 Request processed in 88us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440428.603975:0:16356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 18 00000100:00100000:0.0:1787440428.603996:0:16356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 19 00000100:00100000:0.0:1787440428.604002:0:16356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee079915880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:33ce6cea-c670-4f62-bfc5-6966392caf40+5:2362:x1874266681375872:12345-192.168.206.58@tcp:400:kworker.0 00000100:00100000:0.0:1787440428.604026:0:16356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee079915880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:33ce6cea-c670-4f62-bfc5-6966392caf40+5:2362:x1874266681375872:12345-192.168.206.58@tcp:400:kworker.0 Request processed in 24us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440428.604033:0:16356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 19 00000100:00100000:0.0:1787440428.604045:0:16356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 20 00000100:00100000:0.0:1787440428.604070:0:16356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee079914a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ebeced4c-c181-4444-bfc2-6340445251d5+5:2362:x1874266681375488:12345-192.168.206.58@tcp:400:kworker.0 00000100:00100000:0.0:1787440428.604113:0:16356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee079914a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ebeced4c-c181-4444-bfc2-6340445251d5+5:2362:x1874266681375488:12345-192.168.206.58@tcp:400:kworker.0 Request processed in 44us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440428.604119:0:16356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 20 00000100:00100000:0.0:1787440428.604132:0:16356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 21 00000100:00100000:0.0:1787440428.604138:0:16356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee049045180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:33ce6cea-c670-4f62-bfc5-6966392caf40+5:2362:x1874266681376000:12345-192.168.206.58@tcp:400:kworker.0 00000100:00100000:0.0:1787440428.604163:0:16356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee049045180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:33ce6cea-c670-4f62-bfc5-6966392caf40+5:2362:x1874266681376000:12345-192.168.206.58@tcp:400:kworker.0 Request processed in 25us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440428.604168:0:16356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 21 00000100:00100000:0.0:1787440428.604189:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681375232 00000100:00100000:0.0:1787440428.604193:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681375232 00000100:00100000:0.0:1787440428.604220:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 122 00000100:00100000:0.0:1787440428.604226:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee07b123450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83c71368-e5e9-44e8-856a-ef5507fb8c2a+13:2362:x1874266681375232:12345-192.168.206.58@tcp:400:kworker.0 00000100:00100000:0.0:1787440428.604248:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee07b123450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83c71368-e5e9-44e8-856a-ef5507fb8c2a+13:2362:x1874266681375232:12345-192.168.206.58@tcp:400:kworker.0 Request processed in 23us (607us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440428.604254:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 122 00000100:00100000:0.0:1787440428.604287:0:16298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681375360 00000100:00100000:0.0:1787440428.604290:0:16298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681375360 00000100:00100000:0.0:1787440428.604317:0:16298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266681375744 00000100:00100000:0.0:1787440428.604319:0:16298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266681375744 00000100:00100000:0.0:1787440428.604341:0:16298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 30 00000100:00100000:0.0:1787440428.604348:0:16298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee07f9f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ebeced4c-c181-4444-bfc2-6340445251d5+20:2362:x1874266681375360:12345-192.168.206.58@tcp:400:kworker.0 00000100:00100000:0.0:1787440428.604382:0:16298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee07f9f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ebeced4c-c181-4444-bfc2-6340445251d5+20:2362:x1874266681375360:12345-192.168.206.58@tcp:400:kworker.0 Request processed in 35us (912us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440428.604389:0:16298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 30 00000100:00100000:0.0:1787440428.604420:0:16298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.58@tcp, seq: 31 00000100:00100000:0.0:1787440428.604427:0:16298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ee079917b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:33ce6cea-c670-4f62-bfc5-6966392caf40+6:2362:x1874266681375744:12345-192.168.206.58@tcp:400:kworker.0 00000100:00100000:0.0:1787440428.604456:0:16298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ee079917b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:33ce6cea-c670-4f62-bfc5-6966392caf40+6:2362:x1874266681375744:12345-192.168.206.58@tcp:400:kworker.0 Request processed in 30us (772us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440428.604463:0:16298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.58@tcp, seq: 31 00000100:00080000:0.0:1787440428.604484:0:14361:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787440428.604489:0:14361:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787440428.604520:0:14361:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1787440429.596773:0:14353:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 29734 lines, 29734 kept, 0 dropped, 0 bad.